Sep 10 03:39:11.667814 ip-10-0-132-138 systemd[1]: Starting Kubernetes Kubelet... Sep 10 03:39:12.069320 ip-10-0-132-138 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 03:39:12.069320 ip-10-0-132-138 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 03:39:12.069320 ip-10-0-132-138 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 03:39:12.069320 ip-10-0-132-138 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 03:39:12.069320 ip-10-0-132-138 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 03:39:12.070260 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.070176 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 03:39:12.073041 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073026 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:12.073041 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073041 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073045 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073048 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073050 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073055 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073058 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073060 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073063 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073066 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073069 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073072 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073074 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073077 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073079 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073082 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073085 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073088 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073091 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073093 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073096 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:12.073101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073099 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073101 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073104 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073108 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073113 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073116 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073119 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073122 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073125 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073127 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073130 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073133 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073137 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073141 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073144 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073147 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073150 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073153 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073156 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:12.073627 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073159 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073161 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073164 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073167 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073169 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073172 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073174 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073177 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073179 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073182 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073184 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073187 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073189 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073192 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073194 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073200 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073202 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073205 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073208 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073210 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:12.074086 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073213 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073215 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073218 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073220 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073223 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073226 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073228 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073230 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073233 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073236 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073238 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073241 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073244 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073246 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073249 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073251 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073254 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073256 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073259 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073261 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:12.074617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073264 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073266 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073269 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073271 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073274 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073277 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073280 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073284 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073295 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073298 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073301 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073305 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073332 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073335 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073338 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073341 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073344 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073347 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.073350 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:12.075099 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074028 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074035 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074038 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074041 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074044 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074048 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074051 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074055 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074059 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074062 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074065 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074068 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074071 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074073 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074076 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074079 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074082 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074084 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074087 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:12.075614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074090 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074093 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074096 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074099 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074101 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074105 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074109 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074112 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074115 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074117 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074120 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074122 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074125 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074128 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074130 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074133 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074136 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074138 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074141 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:12.076083 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074144 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074146 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074149 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074151 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074154 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074156 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074159 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074162 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074164 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074167 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074169 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074172 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074174 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074177 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074180 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074183 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074186 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074188 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074191 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074193 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:12.076602 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074196 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074198 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074201 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074204 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074206 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074208 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074211 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074214 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074216 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074219 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074222 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074224 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074226 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074231 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074234 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074237 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074240 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074242 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074245 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074248 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:12.077090 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074250 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074253 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074255 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074258 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074260 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074264 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074267 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074270 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074273 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074275 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074278 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074281 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074283 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074286 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074288 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074291 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074293 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074296 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074298 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074301 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:12.077613 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074304 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074701 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074707 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074710 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074713 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074716 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074720 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074723 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074726 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074728 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074731 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074734 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074737 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074740 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074742 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074745 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074747 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074750 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074753 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074755 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:12.078110 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074758 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074761 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074764 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074766 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074769 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074771 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074774 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074777 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074779 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074782 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074784 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074786 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074789 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074792 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074795 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074798 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074800 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074803 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074806 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074808 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:12.078614 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074811 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074813 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074817 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074821 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074824 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074828 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074831 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074834 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074836 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074840 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074843 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074845 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074848 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074850 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074853 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074855 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074858 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074860 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074863 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:12.079103 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074865 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074868 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074871 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074873 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074876 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074879 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074882 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074884 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074887 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074889 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074892 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074894 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074897 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074900 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074903 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074905 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074908 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074910 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074913 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074915 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:12.079588 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074918 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074920 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074923 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074926 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074928 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074931 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074934 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074939 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074943 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074946 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074949 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074952 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074955 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074958 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074961 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074963 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074966 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074969 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074971 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:12.080154 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074974 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.074977 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075044 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075076 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075083 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075087 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075095 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075099 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075103 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075107 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075110 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075113 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075117 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075120 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075123 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075126 2580 flags.go:64] FLAG: --cgroup-root="" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075129 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075132 2580 flags.go:64] FLAG: --client-ca-file="" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075135 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075138 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075142 2580 flags.go:64] FLAG: --cluster-domain="" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075145 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075148 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075151 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 03:39:12.080630 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075154 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075158 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075161 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075164 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075167 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075170 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075175 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075178 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075181 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075184 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075188 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075191 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075194 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075196 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075200 2580 flags.go:64] FLAG: --enable-server="true" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075204 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075208 2580 flags.go:64] FLAG: --event-burst="100" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075211 2580 flags.go:64] FLAG: --event-qps="50" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075214 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075217 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075220 2580 flags.go:64] FLAG: --eviction-hard="" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075224 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075227 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075229 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075232 2580 flags.go:64] FLAG: --eviction-soft="" Sep 10 03:39:12.081227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075235 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075238 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075241 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075244 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075247 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075250 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075252 2580 flags.go:64] FLAG: --feature-gates="" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075256 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075259 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075262 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075265 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075269 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075272 2580 flags.go:64] FLAG: --help="false" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075276 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075279 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075282 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075285 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075289 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075292 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075295 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075298 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075303 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075306 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 03:39:12.081864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075309 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075312 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075315 2580 flags.go:64] FLAG: --kube-reserved="" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075318 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075321 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075324 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075326 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075329 2580 flags.go:64] FLAG: --lock-file="" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075332 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075335 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075338 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075343 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075346 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075348 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075351 2580 flags.go:64] FLAG: --logging-format="text" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075354 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075357 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075360 2580 flags.go:64] FLAG: --manifest-url="" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075363 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075368 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075371 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075375 2580 flags.go:64] FLAG: --max-pods="110" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075379 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075382 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075385 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 03:39:12.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075388 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075391 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075394 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075397 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075404 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075408 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075411 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075414 2580 flags.go:64] FLAG: --pod-cidr="" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075417 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075422 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075425 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075428 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075431 2580 flags.go:64] FLAG: --port="10250" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075434 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075437 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c01e61956bd5eeae" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075440 2580 flags.go:64] FLAG: --qos-reserved="" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075443 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075446 2580 flags.go:64] FLAG: --register-node="true" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075449 2580 flags.go:64] FLAG: --register-with-taints="" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075452 2580 flags.go:64] FLAG: --registry-burst="10" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075455 2580 flags.go:64] FLAG: --registry-qps="5" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075458 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075460 2580 flags.go:64] FLAG: --reserved-memory="" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075464 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075467 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 03:39:12.083082 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075470 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075473 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075476 2580 flags.go:64] FLAG: --runonce="false" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075479 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075483 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075486 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075489 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075492 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075495 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075512 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075515 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075518 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075521 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075525 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075528 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075532 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075536 2580 flags.go:64] FLAG: --system-cgroups="" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075539 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075544 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075546 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075549 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075554 2580 flags.go:64] FLAG: --tls-min-version="" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075556 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075559 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075562 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 03:39:12.083727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075565 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075568 2580 flags.go:64] FLAG: --v="2" Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075572 2580 flags.go:64] FLAG: --version="false" Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075576 2580 flags.go:64] FLAG: --vmodule="" Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075579 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075583 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075694 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075698 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075701 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075704 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075707 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075711 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075714 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075717 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075719 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075722 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075725 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075727 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075730 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075732 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075736 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:12.084335 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075739 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075741 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075744 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075747 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075750 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075752 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075755 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075757 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075760 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075762 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075765 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075767 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075770 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075772 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075775 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075778 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075780 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075783 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075785 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075788 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:12.084924 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075790 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075793 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075796 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075799 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075801 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075804 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075806 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075809 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075811 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075814 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075816 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075819 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075822 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075824 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075827 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075830 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075833 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075835 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075838 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075842 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:12.085413 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075845 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075848 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075851 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075853 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075856 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075858 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075862 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075866 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075869 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075872 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075875 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075878 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075880 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075884 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075888 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075891 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075894 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075897 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:12.085959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075899 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075902 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075905 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075907 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075910 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075912 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075915 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075917 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075920 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075923 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075927 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075932 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075935 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075939 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075942 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075945 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075947 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075950 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075952 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075955 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:12.086390 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075958 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075960 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075963 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075965 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075968 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.075970 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.075976 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.082816 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.082832 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.082848 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.082855 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082926 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082931 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082935 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082939 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:12.086904 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082942 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082944 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082947 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082950 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082953 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082955 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082958 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082960 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082963 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082966 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082969 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082971 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082974 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082976 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082979 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082981 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082984 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082987 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082990 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082992 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:12.087315 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082995 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.082997 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083000 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083003 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083005 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083009 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083012 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083014 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083017 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083019 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083022 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083025 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083027 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083030 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083032 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083035 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083037 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083040 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083042 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083045 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:12.087827 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083047 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083050 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083052 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083055 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083057 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083060 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083062 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083065 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083068 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083070 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083073 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083075 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083078 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083080 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083083 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083086 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083088 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083091 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083095 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083097 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:12.088314 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083100 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083103 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083105 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083108 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083110 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083112 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083115 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083117 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083120 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083122 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083125 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083129 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083132 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083135 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083138 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083141 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083143 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083146 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083150 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:12.088813 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083153 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083156 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083159 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083162 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083164 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083167 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083170 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083172 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083175 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083179 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083183 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083186 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083189 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083191 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083194 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:12.089317 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083197 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.083202 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083310 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083315 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083318 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083320 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083323 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083326 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083330 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083334 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083337 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083339 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083342 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083344 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083347 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 03:39:12.089706 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083349 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083352 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083354 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083357 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083360 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083362 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083364 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083367 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083369 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083372 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083374 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083377 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083379 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083382 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083385 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083388 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083390 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083393 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083397 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 03:39:12.090207 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083400 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083402 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083405 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083407 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083410 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083412 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083415 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083417 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083420 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083422 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083425 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083427 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083430 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083432 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083435 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083437 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083440 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083442 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083445 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083447 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 03:39:12.090767 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083450 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083452 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083455 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083457 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083460 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083462 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083465 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083467 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083470 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083473 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083475 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083480 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083483 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083485 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083488 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083490 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083494 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083518 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 03:39:12.091467 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083523 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083526 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083529 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083532 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083534 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083537 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083540 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083542 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083545 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083548 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083550 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083553 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083555 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083558 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083560 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083563 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083565 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083568 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083570 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083573 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 03:39:12.092043 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083575 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083578 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083581 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083583 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083586 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083590 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083593 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083595 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:12.083598 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.083603 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.083703 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.086672 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.087529 2580 server.go:1019] "Starting client certificate rotation" Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.087632 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 03:39:12.092617 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.087665 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 03:39:12.092971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.090011 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 03:39:12.095159 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.095137 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 03:39:12.107573 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.107554 2580 log.go:25] "Validated CRI v1 runtime API" Sep 10 03:39:12.110297 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.110282 2580 log.go:25] "Validated CRI v1 image API" Sep 10 03:39:12.111141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.111124 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 03:39:12.114728 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.114710 2580 fs.go:135] Filesystem UUIDs: map[1f0cca74-be64-4575-af07-741a53491d78:/dev/nvme0n1p3 3b7bb783-1344-486e-973a-39cda19e0d02:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 10 03:39:12.114787 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.114728 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 03:39:12.116152 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.116136 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 03:39:12.119717 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.119610 2580 manager.go:216] Machine: {Timestamp:2026-09-10 03:39:12.118298614 +0000 UTC m=+0.337809797 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099499 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26daf642012b962f760bee348a527a SystemUUID:ec26daf6-4201-2b96-2f76-0bee348a527a BootID:667fba92-ff30-4df5-be50-f247dc203af0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:a9:d2:cd:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:a9:d2:cd:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:1f:43:cf:58:ff Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 03:39:12.119717 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.119711 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 03:39:12.119842 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.119823 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 03:39:12.122885 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.122861 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 03:39:12.123026 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.122887 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 03:39:12.124341 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.124331 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 03:39:12.124373 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.124343 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 03:39:12.124373 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.124351 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 03:39:12.124373 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.124365 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 03:39:12.125565 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.125555 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 03:39:12.129995 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.129984 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 10 03:39:12.130111 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.130102 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 03:39:12.130141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.130134 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 10 03:39:12.130168 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.130148 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 03:39:12.130194 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.130172 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 03:39:12.130194 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.130186 2580 kubelet.go:398] "Adding apiserver pod source" Sep 10 03:39:12.130250 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.130206 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 03:39:12.130606 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.130594 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 03:39:12.130680 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.130614 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 03:39:12.132804 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.132787 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 03:39:12.134814 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.134801 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 03:39:12.134875 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.134830 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 03:39:12.134993 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.134984 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 03:39:12.135032 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.134998 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 03:39:12.135032 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135004 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 03:39:12.135032 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135010 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 03:39:12.135032 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135018 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 03:39:12.135032 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135023 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 03:39:12.135532 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135523 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 03:39:12.135532 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135531 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 03:39:12.135600 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135538 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 03:39:12.135600 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135544 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 03:39:12.135600 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135552 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 03:39:12.135600 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.135560 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 03:39:12.136383 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.136372 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 03:39:12.136383 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.136383 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 03:39:12.137390 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.137355 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 03:39:12.137469 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.137444 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 03:39:12.139460 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.139434 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qj2t6" Sep 10 03:39:12.140596 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.140583 2580 server.go:1268] "Started kubelet" Sep 10 03:39:12.140676 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.140635 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 03:39:12.140727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.140707 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 03:39:12.140782 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.140748 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 03:39:12.141406 ip-10-0-132-138 systemd[1]: Started Kubernetes Kubelet. Sep 10 03:39:12.144858 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.144601 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 03:39:12.145833 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.145327 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 03:39:12.146542 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.146520 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 03:39:12.147783 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.147766 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 10 03:39:12.148617 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.148595 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qj2t6" Sep 10 03:39:12.150871 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.150854 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 03:39:12.150871 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.150864 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 03:39:12.151100 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.150994 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:12.151420 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.150303 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-138.ec2.internal.18d3d8873068479b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-138.ec2.internal,UID:ip-10-0-132-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-138.ec2.internal,},FirstTimestamp:2026-09-10 03:39:12.140543899 +0000 UTC m=+0.360055064,LastTimestamp:2026-09-10 03:39:12.140543899 +0000 UTC m=+0.360055064,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-138.ec2.internal,}" Sep 10 03:39:12.151527 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.151441 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 03:39:12.151527 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.151441 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 03:39:12.151527 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.151465 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 03:39:12.151647 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.151592 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 10 03:39:12.151647 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.151601 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 10 03:39:12.151741 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.151710 2580 factory.go:55] Registering systemd factory Sep 10 03:39:12.151741 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.151726 2580 factory.go:223] Registration of the systemd container factory successfully Sep 10 03:39:12.151949 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.151931 2580 factory.go:153] Registering CRI-O factory Sep 10 03:39:12.151949 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.151948 2580 factory.go:223] Registration of the crio container factory successfully Sep 10 03:39:12.152087 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.152036 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 03:39:12.152087 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.152064 2580 factory.go:103] Registering Raw factory Sep 10 03:39:12.152087 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.152079 2580 manager.go:1196] Started watching for new ooms in manager Sep 10 03:39:12.152462 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.152449 2580 manager.go:349] Starting recovery of all containers Sep 10 03:39:12.157953 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.157924 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:12.161271 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.161245 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-138.ec2.internal\" not found" node="ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.164176 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.164162 2580 manager.go:354] Recovery completed Sep 10 03:39:12.168955 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.168943 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:12.170768 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.170752 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:12.170838 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.170783 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:12.170838 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.170793 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:12.171379 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.171363 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 03:39:12.171379 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.171377 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 03:39:12.171531 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.171385 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:12.171531 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.171398 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 10 03:39:12.173384 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.173361 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:12.173468 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.173404 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:12.173468 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.173422 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:12.173581 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.173563 2580 policy_none.go:49] "None policy: Start" Sep 10 03:39:12.173581 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.173579 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 03:39:12.173661 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.173592 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 03:39:12.251943 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.251909 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:12.310720 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.310699 2580 policy_none.go:47] "Start" Sep 10 03:39:12.341059 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.341041 2580 manager.go:337] "Starting Device Plugin manager" Sep 10 03:39:12.341193 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.341115 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 03:39:12.341193 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.341125 2580 server.go:87] "Starting device plugin registration server" Sep 10 03:39:12.341402 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.341389 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 03:39:12.341454 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.341403 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 03:39:12.341533 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.341517 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 03:39:12.341620 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.341605 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 03:39:12.341620 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.341617 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 03:39:12.342142 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.342119 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 03:39:12.342222 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.342172 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:12.364888 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.364857 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 03:39:12.366086 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.366061 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 03:39:12.366181 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.366108 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 03:39:12.366181 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.366129 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 03:39:12.366181 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.366162 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 03:39:12.368806 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.368786 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:12.441965 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.441932 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:12.443007 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.442987 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:12.443131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.443027 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:12.443131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.443041 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:12.443131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.443071 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.449531 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.449513 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.449608 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.449536 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-138.ec2.internal\": node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:12.459131 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.459107 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:12.466824 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.466800 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal"] Sep 10 03:39:12.466903 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.466878 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:12.468368 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.468352 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:12.468450 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.468380 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:12.468450 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.468394 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:12.470481 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.470469 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:12.470620 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.470606 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.470667 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.470633 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:12.471256 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.471239 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:12.471317 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.471270 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:12.471317 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.471281 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:12.471384 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.471236 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:12.471384 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.471345 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:12.471384 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.471358 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:12.473432 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.473417 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.473488 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.473448 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 03:39:12.474238 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.474222 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientMemory" Sep 10 03:39:12.474308 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.474258 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 03:39:12.474308 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.474274 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeHasSufficientPID" Sep 10 03:39:12.495157 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.495138 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-138.ec2.internal\" not found" node="ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.499421 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.499402 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-138.ec2.internal\" not found" node="ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.553862 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.553824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c36f15fa8b0d0a13cd85f3184dea641a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal\" (UID: \"c36f15fa8b0d0a13cd85f3184dea641a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.553862 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.553869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c36f15fa8b0d0a13cd85f3184dea641a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal\" (UID: \"c36f15fa8b0d0a13cd85f3184dea641a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.554017 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.553899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8633308fe0afc9393e482bd331cb1311-config\") pod \"kube-apiserver-proxy-ip-10-0-132-138.ec2.internal\" (UID: \"8633308fe0afc9393e482bd331cb1311\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.559614 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.559599 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:12.654666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.654569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c36f15fa8b0d0a13cd85f3184dea641a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal\" (UID: \"c36f15fa8b0d0a13cd85f3184dea641a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.654666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.654620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c36f15fa8b0d0a13cd85f3184dea641a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal\" (UID: \"c36f15fa8b0d0a13cd85f3184dea641a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.654666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.654647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8633308fe0afc9393e482bd331cb1311-config\") pod \"kube-apiserver-proxy-ip-10-0-132-138.ec2.internal\" (UID: \"8633308fe0afc9393e482bd331cb1311\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.654666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.654656 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c36f15fa8b0d0a13cd85f3184dea641a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal\" (UID: \"c36f15fa8b0d0a13cd85f3184dea641a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.654910 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.654675 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c36f15fa8b0d0a13cd85f3184dea641a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal\" (UID: \"c36f15fa8b0d0a13cd85f3184dea641a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.654910 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.654685 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8633308fe0afc9393e482bd331cb1311-config\") pod \"kube-apiserver-proxy-ip-10-0-132-138.ec2.internal\" (UID: \"8633308fe0afc9393e482bd331cb1311\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.660706 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.660678 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:12.761200 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.761159 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:12.798341 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.798317 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.802989 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:12.802969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal" Sep 10 03:39:12.861925 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.861747 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:12.962667 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:12.962640 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:13.063217 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:13.063187 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:13.087801 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.087764 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 03:39:13.088258 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.087935 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 03:39:13.088258 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.087973 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 03:39:13.154130 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.154088 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 03:34:12 +0000 UTC" deadline="2028-05-28 00:38:04.89196186 +0000 UTC" Sep 10 03:39:13.154130 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.154124 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15020h58m51.737840969s" Sep 10 03:39:13.163337 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:13.163315 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:13.220995 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.220928 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:13.263485 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:13.263451 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:13.364653 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:13.364621 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:13.465566 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:13.465539 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:13.565943 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:13.565866 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:13.614568 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:13.614537 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8633308fe0afc9393e482bd331cb1311.slice/crio-1604caf29c6f18721a55c55ec78840f291c93f21649114cc67f662e81a254e13 WatchSource:0}: Error finding container 1604caf29c6f18721a55c55ec78840f291c93f21649114cc67f662e81a254e13: Status 404 returned error can't find the container with id 1604caf29c6f18721a55c55ec78840f291c93f21649114cc67f662e81a254e13 Sep 10 03:39:13.614867 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:13.614849 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36f15fa8b0d0a13cd85f3184dea641a.slice/crio-c5432cd8d0a12bb97f60f550ebcefa4afc0df887fd4656d16db66ccd66f9e6a8 WatchSource:0}: Error finding container c5432cd8d0a12bb97f60f550ebcefa4afc0df887fd4656d16db66ccd66f9e6a8: Status 404 returned error can't find the container with id c5432cd8d0a12bb97f60f550ebcefa4afc0df887fd4656d16db66ccd66f9e6a8 Sep 10 03:39:13.619230 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.619214 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:39:13.666172 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:13.666143 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-138.ec2.internal\" not found" Sep 10 03:39:13.690603 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.690580 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:13.752079 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.752040 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" Sep 10 03:39:13.764736 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.764714 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 03:39:13.765879 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.765862 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal" Sep 10 03:39:13.775217 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:13.775197 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 03:39:14.132946 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.132915 2580 apiserver.go:52] "Watching apiserver" Sep 10 03:39:14.143119 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.143091 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 03:39:14.145626 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.145590 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-zzpgg","kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5","openshift-cluster-node-tuning-operator/tuned-97ng6","openshift-image-registry/node-ca-8482s","openshift-multus/multus-additional-cni-plugins-vk84n","openshift-network-diagnostics/network-check-target-slvnb","openshift-network-operator/iptables-alerter-s6gmh","kube-system/global-pull-secret-syncer-ghxlx","openshift-dns/node-resolver-gv6n7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal","openshift-multus/multus-xj75f","openshift-multus/network-metrics-daemon-r7f5r","openshift-ovn-kubernetes/ovnkube-node-ngz62"] Sep 10 03:39:14.148541 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.148512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:14.148661 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.148622 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:14.150624 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.150599 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:14.150624 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.150669 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:14.151933 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.151911 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 03:39:14.153696 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.153140 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.155831 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.155486 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 03:39:14.155831 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.155807 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.156028 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.155833 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 03:39:14.156091 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.156040 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t9754\"" Sep 10 03:39:14.156410 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.156339 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 03:39:14.158400 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.158378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.159645 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.159284 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 03:39:14.159645 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.159337 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4cdbh\"" Sep 10 03:39:14.159645 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.159488 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:39:14.160654 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.160635 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.160830 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.160811 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 03:39:14.161313 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.161293 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 03:39:14.161415 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.161350 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ttp9s\"" Sep 10 03:39:14.161633 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.161615 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 03:39:14.162164 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-device-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.162260 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-etc-selinux\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.162260 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-sys-fs\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.162260 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbw4w\" (UniqueName: \"kubernetes.io/projected/72770130-94d4-4af8-8f92-49bb67cce161-kube-api-access-bbw4w\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.162422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162294 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.162422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-socket-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.162422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162345 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:14.162422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:14.162664 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkrvc\" (UniqueName: \"kubernetes.io/projected/213caff4-1d8b-4359-8ac8-b74d609e0e00-kube-api-access-gkrvc\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:14.162664 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-registration-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.162911 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.162850 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 03:39:14.163306 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.163284 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 03:39:14.163395 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.163315 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b4v6k\"" Sep 10 03:39:14.163604 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.163569 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 03:39:14.163753 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.163728 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 03:39:14.163879 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.163859 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 03:39:14.164007 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.163989 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 03:39:14.164602 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.164582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.164701 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.164653 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:14.167231 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.167211 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:14.169958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.169937 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 03:39:14.170222 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.170204 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4pmqc\"" Sep 10 03:39:14.170470 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.170452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.170569 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.170479 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 03:39:14.173323 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.172776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.173323 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.173292 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 03:39:14.173491 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.173298 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 03:39:14.173883 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.173850 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:14.174008 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.173965 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 03:39:14.175235 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.175213 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 03:39:14.175449 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.175419 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 03:39:14.175563 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.175455 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c5lcj\"" Sep 10 03:39:14.175563 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.175519 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 03:39:14.175563 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.175223 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 03:39:14.175759 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.175645 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k45lc\"" Sep 10 03:39:14.176128 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.176109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.177017 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.176998 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 03:39:14.178773 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.178751 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 03:39:14.178963 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.178836 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gpk6l\"" Sep 10 03:39:14.179201 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.179100 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 03:39:14.179440 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.179418 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.179537 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.179517 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:39:14.182530 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.182507 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 03:39:14.182716 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.182696 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k2cl8\"" Sep 10 03:39:14.187854 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.187832 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zkm92" Sep 10 03:39:14.193744 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.193721 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zkm92" Sep 10 03:39:14.253087 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.252763 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 03:39:14.263295 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdm2c\" (UniqueName: \"kubernetes.io/projected/d01ae2bc-55d5-4211-a419-b58cb760f7f2-kube-api-access-pdm2c\") pod \"node-resolver-gv6n7\" (UID: \"d01ae2bc-55d5-4211-a419-b58cb760f7f2\") " pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.263456 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cdde3356-c271-4915-8c9b-0201d4f8aff7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.263456 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-socket-dir-parent\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.263456 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-tuned\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.263456 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-systemd-units\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.263456 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc889041-66d1-47a7-a13e-01b24e3fa360-ovn-node-metrics-cert\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc889041-66d1-47a7-a13e-01b24e3fa360-ovnkube-script-lib\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-run-netns\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-daemon-config\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-sys\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-etc-openvswitch\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-run-ovn\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-node-log\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-etc-kubernetes\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.263770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-sysctl-conf\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-kubelet\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-run-systemd\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/350afe90-c4e6-4027-b653-bd23f6cc4e2b-host\") pod \"node-ca-8482s\" (UID: \"350afe90-c4e6-4027-b653-bd23f6cc4e2b\") " pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263883 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4e0160b7-d9ed-466d-b049-cc3faa3b3b2d-konnectivity-ca\") pod \"konnectivity-agent-zzpgg\" (UID: \"4e0160b7-d9ed-466d-b049-cc3faa3b3b2d\") " pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdde3356-c271-4915-8c9b-0201d4f8aff7-cnibin\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-system-cni-dir\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.263976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkrvc\" (UniqueName: \"kubernetes.io/projected/213caff4-1d8b-4359-8ac8-b74d609e0e00-kube-api-access-gkrvc\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-registration-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-var-lib-kubelet\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-run-netns\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc889041-66d1-47a7-a13e-01b24e3fa360-env-overrides\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-host\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264189 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-modprobe-d\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-kubernetes\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.264270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdde3356-c271-4915-8c9b-0201d4f8aff7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264291 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-registration-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-cnibin\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-var-lib-cni-multus\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-etc-selinux\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d01ae2bc-55d5-4211-a419-b58cb760f7f2-hosts-file\") pod \"node-resolver-gv6n7\" (UID: \"d01ae2bc-55d5-4211-a419-b58cb760f7f2\") " pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264369 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkpqf\" (UniqueName: \"kubernetes.io/projected/ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3-kube-api-access-mkpqf\") pod \"iptables-alerter-s6gmh\" (UID: \"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3\") " pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264447 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-run\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264508 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfzsh\" (UniqueName: \"kubernetes.io/projected/350afe90-c4e6-4027-b653-bd23f6cc4e2b-kube-api-access-dfzsh\") pod \"node-ca-8482s\" (UID: \"350afe90-c4e6-4027-b653-bd23f6cc4e2b\") " pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264539 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-etc-selinux\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdde3356-c271-4915-8c9b-0201d4f8aff7-system-cni-dir\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb5xr\" (UniqueName: \"kubernetes.io/projected/cdde3356-c271-4915-8c9b-0201d4f8aff7-kube-api-access-kb5xr\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264626 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-run-ovn-kubernetes\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-cni-netd\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.265053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264702 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-conf-dir\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264743 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbw4w\" (UniqueName: \"kubernetes.io/projected/72770130-94d4-4af8-8f92-49bb67cce161-kube-api-access-bbw4w\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-tmp\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-cni-bin\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-run-k8s-cni-cncf-io\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.264993 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6vd8\" (UniqueName: \"kubernetes.io/projected/dc889041-66d1-47a7-a13e-01b24e3fa360-kube-api-access-f6vd8\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45gkp\" (UniqueName: \"kubernetes.io/projected/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-kube-api-access-45gkp\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-sys-fs\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-sysctl-d\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265194 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-sys-fs\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265211 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/350afe90-c4e6-4027-b653-bd23f6cc4e2b-serviceca\") pod \"node-ca-8482s\" (UID: \"350afe90-c4e6-4027-b653-bd23f6cc4e2b\") " pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdde3356-c271-4915-8c9b-0201d4f8aff7-cni-binary-copy\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265278 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e910964-6cb9-4b92-b001-ccc756e54db5-cni-binary-copy\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-var-lib-cni-bin\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265332 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-hostroot\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01ae2bc-55d5-4211-a419-b58cb760f7f2-tmp-dir\") pod \"node-resolver-gv6n7\" (UID: \"d01ae2bc-55d5-4211-a419-b58cb760f7f2\") " pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.265902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265381 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f9tv\" (UniqueName: \"kubernetes.io/projected/5e910964-6cb9-4b92-b001-ccc756e54db5-kube-api-access-7f9tv\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-run-openvswitch\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-log-socket\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4e0160b7-d9ed-466d-b049-cc3faa3b3b2d-agent-certs\") pod \"konnectivity-agent-zzpgg\" (UID: \"4e0160b7-d9ed-466d-b049-cc3faa3b3b2d\") " pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cdde3356-c271-4915-8c9b-0201d4f8aff7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68bcd05d-92df-4758-a94a-30f988f2f0ed-dbus\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-slash\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3-iptables-alerter-script\") pod \"iptables-alerter-s6gmh\" (UID: \"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3\") " pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3-host-slash\") pod \"iptables-alerter-s6gmh\" (UID: \"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3\") " pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-var-lib-openvswitch\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-socket-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-sysconfig\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265756 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-systemd\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc889041-66d1-47a7-a13e-01b24e3fa360-ovnkube-config\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265831 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-cni-dir\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265855 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-var-lib-kubelet\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.266771 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-run-multus-certs\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.267591 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265908 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68bcd05d-92df-4758-a94a-30f988f2f0ed-kubelet-config\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.267591 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:14.267591 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.265960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-device-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.267591 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.266020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-lib-modules\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.267591 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.266050 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-device-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.267591 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.266066 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:14.267591 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.266145 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs podName:213caff4-1d8b-4359-8ac8-b74d609e0e00 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:14.766117473 +0000 UTC m=+2.985628626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs") pod "network-metrics-daemon-r7f5r" (UID: "213caff4-1d8b-4359-8ac8-b74d609e0e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:14.267591 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.266356 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72770130-94d4-4af8-8f92-49bb67cce161-socket-dir\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.270893 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.270866 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 03:39:14.271224 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.271205 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:14.271318 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.271231 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:14.271318 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.271246 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mfj9r for pod openshift-network-diagnostics/network-check-target-slvnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:14.271318 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.271300 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r podName:787cb2e6-d36b-412c-a1c0-9103f30d92f7 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:14.771283849 +0000 UTC m=+2.990795006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mfj9r" (UniqueName: "kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r") pod "network-check-target-slvnb" (UID: "787cb2e6-d36b-412c-a1c0-9103f30d92f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:14.275349 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.275328 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkrvc\" (UniqueName: \"kubernetes.io/projected/213caff4-1d8b-4359-8ac8-b74d609e0e00-kube-api-access-gkrvc\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:14.275450 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.275365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbw4w\" (UniqueName: \"kubernetes.io/projected/72770130-94d4-4af8-8f92-49bb67cce161-kube-api-access-bbw4w\") pod \"aws-ebs-csi-driver-node-sd7j5\" (UID: \"72770130-94d4-4af8-8f92-49bb67cce161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.367194 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc889041-66d1-47a7-a13e-01b24e3fa360-env-overrides\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.367194 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-host\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.367492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-modprobe-d\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.367492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-kubernetes\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.367492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdde3356-c271-4915-8c9b-0201d4f8aff7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.367492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-cnibin\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.367492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367312 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-host\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.367492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367461 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-modprobe-d\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.367492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367464 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-kubernetes\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.367492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-var-lib-cni-multus\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.367903 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d01ae2bc-55d5-4211-a419-b58cb760f7f2-hosts-file\") pod \"node-resolver-gv6n7\" (UID: \"d01ae2bc-55d5-4211-a419-b58cb760f7f2\") " pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.367903 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkpqf\" (UniqueName: \"kubernetes.io/projected/ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3-kube-api-access-mkpqf\") pod \"iptables-alerter-s6gmh\" (UID: \"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3\") " pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.367903 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367632 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdde3356-c271-4915-8c9b-0201d4f8aff7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.367903 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.367665 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d01ae2bc-55d5-4211-a419-b58cb760f7f2-hosts-file\") pod \"node-resolver-gv6n7\" (UID: \"d01ae2bc-55d5-4211-a419-b58cb760f7f2\") " pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.368093 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-run\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.368093 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368041 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-var-lib-cni-multus\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.368186 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfzsh\" (UniqueName: \"kubernetes.io/projected/350afe90-c4e6-4027-b653-bd23f6cc4e2b-kube-api-access-dfzsh\") pod \"node-ca-8482s\" (UID: \"350afe90-c4e6-4027-b653-bd23f6cc4e2b\") " pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.368186 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdde3356-c271-4915-8c9b-0201d4f8aff7-system-cni-dir\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.368289 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb5xr\" (UniqueName: \"kubernetes.io/projected/cdde3356-c271-4915-8c9b-0201d4f8aff7-kube-api-access-kb5xr\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.368289 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368269 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-run\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.368289 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.368289 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368277 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc889041-66d1-47a7-a13e-01b24e3fa360-env-overrides\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.368485 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-run-ovn-kubernetes\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.368485 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-cni-netd\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.368485 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368355 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdde3356-c271-4915-8c9b-0201d4f8aff7-system-cni-dir\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.368485 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-conf-dir\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.368485 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368413 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-conf-dir\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.368802 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368477 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-cni-netd\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.368802 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-tmp\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.368802 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368607 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-run-ovn-kubernetes\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.368802 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.368581 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:14.368802 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368656 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-cni-bin\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.368802 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.368702 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret podName:68bcd05d-92df-4758-a94a-30f988f2f0ed nodeName:}" failed. No retries permitted until 2026-09-10 03:39:14.868683133 +0000 UTC m=+3.088194284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret") pod "global-pull-secret-syncer-ghxlx" (UID: "68bcd05d-92df-4758-a94a-30f988f2f0ed") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:14.368802 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-run-k8s-cni-cncf-io\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.369133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368814 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-cni-bin\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.369133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vd8\" (UniqueName: \"kubernetes.io/projected/dc889041-66d1-47a7-a13e-01b24e3fa360-kube-api-access-f6vd8\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.369133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368870 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-run-k8s-cni-cncf-io\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.369133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368870 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45gkp\" (UniqueName: \"kubernetes.io/projected/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-kube-api-access-45gkp\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.369133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-sysctl-d\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.369133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/350afe90-c4e6-4027-b653-bd23f6cc4e2b-serviceca\") pod \"node-ca-8482s\" (UID: \"350afe90-c4e6-4027-b653-bd23f6cc4e2b\") " pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.369133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdde3356-c271-4915-8c9b-0201d4f8aff7-cni-binary-copy\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.369133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.368994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e910964-6cb9-4b92-b001-ccc756e54db5-cni-binary-copy\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.369548 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-var-lib-cni-bin\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.369548 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369459 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-hostroot\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.369548 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01ae2bc-55d5-4211-a419-b58cb760f7f2-tmp-dir\") pod \"node-resolver-gv6n7\" (UID: \"d01ae2bc-55d5-4211-a419-b58cb760f7f2\") " pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.369548 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f9tv\" (UniqueName: \"kubernetes.io/projected/5e910964-6cb9-4b92-b001-ccc756e54db5-kube-api-access-7f9tv\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.369751 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369585 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-run-openvswitch\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.369751 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369610 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-log-socket\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.369751 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4e0160b7-d9ed-466d-b049-cc3faa3b3b2d-agent-certs\") pod \"konnectivity-agent-zzpgg\" (UID: \"4e0160b7-d9ed-466d-b049-cc3faa3b3b2d\") " pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:14.369751 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cdde3356-c271-4915-8c9b-0201d4f8aff7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.369751 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68bcd05d-92df-4758-a94a-30f988f2f0ed-dbus\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-slash\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3-iptables-alerter-script\") pod \"iptables-alerter-s6gmh\" (UID: \"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3\") " pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3-host-slash\") pod \"iptables-alerter-s6gmh\" (UID: \"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3\") " pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369826 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-sysctl-d\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369856 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-cnibin\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369912 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-var-lib-cni-bin\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-var-lib-openvswitch\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-var-lib-openvswitch\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-sysconfig\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.370024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.369986 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-hostroot\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.370496 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.370037 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-sysconfig\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.370496 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.370355 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01ae2bc-55d5-4211-a419-b58cb760f7f2-tmp-dir\") pod \"node-resolver-gv6n7\" (UID: \"d01ae2bc-55d5-4211-a419-b58cb760f7f2\") " pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.370496 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.370420 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-run-openvswitch\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.370496 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.370483 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-log-socket\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.371308 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.371281 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68bcd05d-92df-4758-a94a-30f988f2f0ed-dbus\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.371415 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.371380 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3-host-slash\") pod \"iptables-alerter-s6gmh\" (UID: \"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3\") " pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.371890 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.371718 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cdde3356-c271-4915-8c9b-0201d4f8aff7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.371994 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.371035 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-slash\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.372093 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372067 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3-iptables-alerter-script\") pod \"iptables-alerter-s6gmh\" (UID: \"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3\") " pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.372231 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-systemd\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.372359 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc889041-66d1-47a7-a13e-01b24e3fa360-ovnkube-config\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.372359 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-cni-dir\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.372359 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-var-lib-kubelet\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.372359 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-run-multus-certs\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.372594 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68bcd05d-92df-4758-a94a-30f988f2f0ed-kubelet-config\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.372594 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-lib-modules\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.372594 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdm2c\" (UniqueName: \"kubernetes.io/projected/d01ae2bc-55d5-4211-a419-b58cb760f7f2-kube-api-access-pdm2c\") pod \"node-resolver-gv6n7\" (UID: \"d01ae2bc-55d5-4211-a419-b58cb760f7f2\") " pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.372594 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372491 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdde3356-c271-4915-8c9b-0201d4f8aff7-cni-binary-copy\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.372594 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cdde3356-c271-4915-8c9b-0201d4f8aff7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372618 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-var-lib-kubelet\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372662 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-lib-modules\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-socket-dir-parent\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-tuned\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372731 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-socket-dir-parent\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-systemd-units\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc889041-66d1-47a7-a13e-01b24e3fa360-ovn-node-metrics-cert\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc889041-66d1-47a7-a13e-01b24e3fa360-ovnkube-script-lib\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372843 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e910964-6cb9-4b92-b001-ccc756e54db5-cni-binary-copy\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-run-netns\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.372947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.372796 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-systemd\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.373497 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373212 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-systemd-units\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.373497 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373389 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc889041-66d1-47a7-a13e-01b24e3fa360-ovnkube-config\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.373497 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373494 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-cni-dir\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373731 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc889041-66d1-47a7-a13e-01b24e3fa360-ovnkube-script-lib\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373815 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-run-netns\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-daemon-config\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-sys\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-etc-openvswitch\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373940 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/350afe90-c4e6-4027-b653-bd23f6cc4e2b-serviceca\") pod \"node-ca-8482s\" (UID: \"350afe90-c4e6-4027-b653-bd23f6cc4e2b\") " pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-run-ovn\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.373990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-node-log\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374040 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cdde3356-c271-4915-8c9b-0201d4f8aff7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-etc-kubernetes\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-sysctl-conf\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374121 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-kubelet\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374139 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68bcd05d-92df-4758-a94a-30f988f2f0ed-kubelet-config\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-run-systemd\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/350afe90-c4e6-4027-b653-bd23f6cc4e2b-host\") pod \"node-ca-8482s\" (UID: \"350afe90-c4e6-4027-b653-bd23f6cc4e2b\") " pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374212 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-run-ovn\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.376282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4e0160b7-d9ed-466d-b049-cc3faa3b3b2d-konnectivity-ca\") pod \"konnectivity-agent-zzpgg\" (UID: \"4e0160b7-d9ed-466d-b049-cc3faa3b3b2d\") " pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374318 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-sys\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374325 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374379 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-node-log\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374385 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-etc-kubernetes\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374526 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-sysctl-conf\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374604 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-kubelet\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374663 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-run-systemd\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374720 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/350afe90-c4e6-4027-b653-bd23f6cc4e2b-host\") pod \"node-ca-8482s\" (UID: \"350afe90-c4e6-4027-b653-bd23f6cc4e2b\") " pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374768 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-host-run-multus-certs\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374818 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-etc-openvswitch\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374862 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdde3356-c271-4915-8c9b-0201d4f8aff7-cnibin\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374897 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-system-cni-dir\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-var-lib-kubelet\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374965 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-run-netns\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.375077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc889041-66d1-47a7-a13e-01b24e3fa360-host-run-netns\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.375129 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdde3356-c271-4915-8c9b-0201d4f8aff7-cnibin\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.375151 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-tmp\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.377227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.374898 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4e0160b7-d9ed-466d-b049-cc3faa3b3b2d-konnectivity-ca\") pod \"konnectivity-agent-zzpgg\" (UID: \"4e0160b7-d9ed-466d-b049-cc3faa3b3b2d\") " pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:14.378404 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.375193 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e910964-6cb9-4b92-b001-ccc756e54db5-system-cni-dir\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.378404 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.375246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-var-lib-kubelet\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.378404 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.375393 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e910964-6cb9-4b92-b001-ccc756e54db5-multus-daemon-config\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.378404 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.375656 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-etc-tuned\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.378404 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.376532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc889041-66d1-47a7-a13e-01b24e3fa360-ovn-node-metrics-cert\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.378404 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.377923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4e0160b7-d9ed-466d-b049-cc3faa3b3b2d-agent-certs\") pod \"konnectivity-agent-zzpgg\" (UID: \"4e0160b7-d9ed-466d-b049-cc3faa3b3b2d\") " pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:14.379567 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.379358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkpqf\" (UniqueName: \"kubernetes.io/projected/ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3-kube-api-access-mkpqf\") pod \"iptables-alerter-s6gmh\" (UID: \"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3\") " pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.379830 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.379805 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfzsh\" (UniqueName: \"kubernetes.io/projected/350afe90-c4e6-4027-b653-bd23f6cc4e2b-kube-api-access-dfzsh\") pod \"node-ca-8482s\" (UID: \"350afe90-c4e6-4027-b653-bd23f6cc4e2b\") " pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.379950 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.379929 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb5xr\" (UniqueName: \"kubernetes.io/projected/cdde3356-c271-4915-8c9b-0201d4f8aff7-kube-api-access-kb5xr\") pod \"multus-additional-cni-plugins-vk84n\" (UID: \"cdde3356-c271-4915-8c9b-0201d4f8aff7\") " pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.381352 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.381328 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f9tv\" (UniqueName: \"kubernetes.io/projected/5e910964-6cb9-4b92-b001-ccc756e54db5-kube-api-access-7f9tv\") pod \"multus-xj75f\" (UID: \"5e910964-6cb9-4b92-b001-ccc756e54db5\") " pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.381642 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.381597 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" event={"ID":"c36f15fa8b0d0a13cd85f3184dea641a","Type":"ContainerStarted","Data":"c5432cd8d0a12bb97f60f550ebcefa4afc0df887fd4656d16db66ccd66f9e6a8"} Sep 10 03:39:14.382684 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.382628 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdm2c\" (UniqueName: \"kubernetes.io/projected/d01ae2bc-55d5-4211-a419-b58cb760f7f2-kube-api-access-pdm2c\") pod \"node-resolver-gv6n7\" (UID: \"d01ae2bc-55d5-4211-a419-b58cb760f7f2\") " pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.383365 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.383023 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal" event={"ID":"8633308fe0afc9393e482bd331cb1311","Type":"ContainerStarted","Data":"1604caf29c6f18721a55c55ec78840f291c93f21649114cc67f662e81a254e13"} Sep 10 03:39:14.383365 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.383238 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45gkp\" (UniqueName: \"kubernetes.io/projected/bcca23cc-de6e-40d4-a5f4-ebc6f080cb42-kube-api-access-45gkp\") pod \"tuned-97ng6\" (UID: \"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42\") " pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.383365 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.383253 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6vd8\" (UniqueName: \"kubernetes.io/projected/dc889041-66d1-47a7-a13e-01b24e3fa360-kube-api-access-f6vd8\") pod \"ovnkube-node-ngz62\" (UID: \"dc889041-66d1-47a7-a13e-01b24e3fa360\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.410655 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.410628 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 03:39:14.467515 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.467465 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" Sep 10 03:39:14.477755 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.477726 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-97ng6" Sep 10 03:39:14.481791 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:14.481739 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72770130_94d4_4af8_8f92_49bb67cce161.slice/crio-1e909d1858dc8871f2fad424f61adde9428a22f443b6c0e6da21ba0166648eae WatchSource:0}: Error finding container 1e909d1858dc8871f2fad424f61adde9428a22f443b6c0e6da21ba0166648eae: Status 404 returned error can't find the container with id 1e909d1858dc8871f2fad424f61adde9428a22f443b6c0e6da21ba0166648eae Sep 10 03:39:14.489382 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.489344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8482s" Sep 10 03:39:14.493124 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.493103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vk84n" Sep 10 03:39:14.503053 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.503031 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:14.503676 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:14.503651 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350afe90_c4e6_4027_b653_bd23f6cc4e2b.slice/crio-54cafcfddda9682634a6aca1460d64a1da3b588847fa067880faa4a1de591d4b WatchSource:0}: Error finding container 54cafcfddda9682634a6aca1460d64a1da3b588847fa067880faa4a1de591d4b: Status 404 returned error can't find the container with id 54cafcfddda9682634a6aca1460d64a1da3b588847fa067880faa4a1de591d4b Sep 10 03:39:14.504312 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:14.504288 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdde3356_c271_4915_8c9b_0201d4f8aff7.slice/crio-c7f0131dd091a6a43232d5824ed0dc57f136d403864f2268f41f9156df6363d4 WatchSource:0}: Error finding container c7f0131dd091a6a43232d5824ed0dc57f136d403864f2268f41f9156df6363d4: Status 404 returned error can't find the container with id c7f0131dd091a6a43232d5824ed0dc57f136d403864f2268f41f9156df6363d4 Sep 10 03:39:14.511836 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.511811 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:14.514130 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:14.514095 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0160b7_d9ed_466d_b049_cc3faa3b3b2d.slice/crio-4dd60c54e049428f1fb6fd13670bb34b78863f5895734be5a5cc56a343d7cb07 WatchSource:0}: Error finding container 4dd60c54e049428f1fb6fd13670bb34b78863f5895734be5a5cc56a343d7cb07: Status 404 returned error can't find the container with id 4dd60c54e049428f1fb6fd13670bb34b78863f5895734be5a5cc56a343d7cb07 Sep 10 03:39:14.520174 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.520152 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gv6n7" Sep 10 03:39:14.523197 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:14.523174 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc889041_66d1_47a7_a13e_01b24e3fa360.slice/crio-f681e0b1dd50b95da4656d4447d19247eff0bbbc58070069a3a4e2382990ba02 WatchSource:0}: Error finding container f681e0b1dd50b95da4656d4447d19247eff0bbbc58070069a3a4e2382990ba02: Status 404 returned error can't find the container with id f681e0b1dd50b95da4656d4447d19247eff0bbbc58070069a3a4e2382990ba02 Sep 10 03:39:14.529877 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.529853 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6gmh" Sep 10 03:39:14.530981 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:14.530956 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01ae2bc_55d5_4211_a419_b58cb760f7f2.slice/crio-3edd74dc32c8d8f87aee276cfb78c12c41e00402299d9e8c88acdd166db66e99 WatchSource:0}: Error finding container 3edd74dc32c8d8f87aee276cfb78c12c41e00402299d9e8c88acdd166db66e99: Status 404 returned error can't find the container with id 3edd74dc32c8d8f87aee276cfb78c12c41e00402299d9e8c88acdd166db66e99 Sep 10 03:39:14.536455 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.536432 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xj75f" Sep 10 03:39:14.542276 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:14.542229 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5dcd4e_a6e2_4c1a_9103_e75df88d93b3.slice/crio-7e862ce1bbadba7ff0fe14b6622304eac71796f8733046012eaa05a7bae074d5 WatchSource:0}: Error finding container 7e862ce1bbadba7ff0fe14b6622304eac71796f8733046012eaa05a7bae074d5: Status 404 returned error can't find the container with id 7e862ce1bbadba7ff0fe14b6622304eac71796f8733046012eaa05a7bae074d5 Sep 10 03:39:14.552162 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:39:14.552136 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e910964_6cb9_4b92_b001_ccc756e54db5.slice/crio-ed1288c3bfe1c9271f4916812bd6d41d8fbb19abc236514097c5106ac04c11e7 WatchSource:0}: Error finding container ed1288c3bfe1c9271f4916812bd6d41d8fbb19abc236514097c5106ac04c11e7: Status 404 returned error can't find the container with id ed1288c3bfe1c9271f4916812bd6d41d8fbb19abc236514097c5106ac04c11e7 Sep 10 03:39:14.777810 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.777767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:14.778011 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.777832 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:14.778011 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.777973 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:14.778011 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.777964 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:14.778011 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.778001 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:14.778011 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.778012 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mfj9r for pod openshift-network-diagnostics/network-check-target-slvnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:14.778296 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.778060 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs podName:213caff4-1d8b-4359-8ac8-b74d609e0e00 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:15.778042632 +0000 UTC m=+3.997553794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs") pod "network-metrics-daemon-r7f5r" (UID: "213caff4-1d8b-4359-8ac8-b74d609e0e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:14.778296 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.778076 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r podName:787cb2e6-d36b-412c-a1c0-9103f30d92f7 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:15.778068735 +0000 UTC m=+3.997579887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mfj9r" (UniqueName: "kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r") pod "network-check-target-slvnb" (UID: "787cb2e6-d36b-412c-a1c0-9103f30d92f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:14.878413 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:14.878373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:14.878626 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.878576 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:14.878710 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:14.878661 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret podName:68bcd05d-92df-4758-a94a-30f988f2f0ed nodeName:}" failed. No retries permitted until 2026-09-10 03:39:15.878638825 +0000 UTC m=+4.098150004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret") pod "global-pull-secret-syncer-ghxlx" (UID: "68bcd05d-92df-4758-a94a-30f988f2f0ed") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:15.197659 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.197617 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 03:34:14 +0000 UTC" deadline="2028-04-11 00:08:49.096327522 +0000 UTC" Sep 10 03:39:15.197659 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.197656 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13892h29m33.898675988s" Sep 10 03:39:15.367462 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.367424 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:15.367662 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.367625 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:15.367767 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.367748 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:15.367868 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.367847 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:15.387258 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.387219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8482s" event={"ID":"350afe90-c4e6-4027-b653-bd23f6cc4e2b","Type":"ContainerStarted","Data":"54cafcfddda9682634a6aca1460d64a1da3b588847fa067880faa4a1de591d4b"} Sep 10 03:39:15.388998 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.388969 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xj75f" event={"ID":"5e910964-6cb9-4b92-b001-ccc756e54db5","Type":"ContainerStarted","Data":"ed1288c3bfe1c9271f4916812bd6d41d8fbb19abc236514097c5106ac04c11e7"} Sep 10 03:39:15.392122 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.392094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6gmh" event={"ID":"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3","Type":"ContainerStarted","Data":"7e862ce1bbadba7ff0fe14b6622304eac71796f8733046012eaa05a7bae074d5"} Sep 10 03:39:15.394075 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.394047 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gv6n7" event={"ID":"d01ae2bc-55d5-4211-a419-b58cb760f7f2","Type":"ContainerStarted","Data":"3edd74dc32c8d8f87aee276cfb78c12c41e00402299d9e8c88acdd166db66e99"} Sep 10 03:39:15.396115 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.396087 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zzpgg" event={"ID":"4e0160b7-d9ed-466d-b049-cc3faa3b3b2d","Type":"ContainerStarted","Data":"4dd60c54e049428f1fb6fd13670bb34b78863f5895734be5a5cc56a343d7cb07"} Sep 10 03:39:15.397907 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.397882 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vk84n" event={"ID":"cdde3356-c271-4915-8c9b-0201d4f8aff7","Type":"ContainerStarted","Data":"c7f0131dd091a6a43232d5824ed0dc57f136d403864f2268f41f9156df6363d4"} Sep 10 03:39:15.399677 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.399621 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-97ng6" event={"ID":"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42","Type":"ContainerStarted","Data":"048b35a8c34766db2c60a12f16a516714331d05b3c3d8f95145210d78803e326"} Sep 10 03:39:15.401210 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.401185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" event={"ID":"72770130-94d4-4af8-8f92-49bb67cce161","Type":"ContainerStarted","Data":"1e909d1858dc8871f2fad424f61adde9428a22f443b6c0e6da21ba0166648eae"} Sep 10 03:39:15.402686 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.402630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerStarted","Data":"f681e0b1dd50b95da4656d4447d19247eff0bbbc58070069a3a4e2382990ba02"} Sep 10 03:39:15.784749 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.784692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:15.784956 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.784766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:15.784956 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.784902 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:15.785081 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.784967 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs podName:213caff4-1d8b-4359-8ac8-b74d609e0e00 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:17.784947372 +0000 UTC m=+6.004458552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs") pod "network-metrics-daemon-r7f5r" (UID: "213caff4-1d8b-4359-8ac8-b74d609e0e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:15.785081 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.785059 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:15.785081 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.785077 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:15.785262 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.785092 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mfj9r for pod openshift-network-diagnostics/network-check-target-slvnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:15.785262 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.785129 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r podName:787cb2e6-d36b-412c-a1c0-9103f30d92f7 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:17.785116889 +0000 UTC m=+6.004628048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mfj9r" (UniqueName: "kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r") pod "network-check-target-slvnb" (UID: "787cb2e6-d36b-412c-a1c0-9103f30d92f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:15.885172 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:15.885126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:15.885371 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.885329 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:15.885436 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:15.885394 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret podName:68bcd05d-92df-4758-a94a-30f988f2f0ed nodeName:}" failed. No retries permitted until 2026-09-10 03:39:17.88537483 +0000 UTC m=+6.104886008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret") pod "global-pull-secret-syncer-ghxlx" (UID: "68bcd05d-92df-4758-a94a-30f988f2f0ed") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:16.198377 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:16.198331 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 03:34:14 +0000 UTC" deadline="2028-06-14 04:55:04.81106821 +0000 UTC" Sep 10 03:39:16.198377 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:16.198372 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15433h15m48.61270111s" Sep 10 03:39:16.370181 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:16.369626 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:16.370181 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:16.369763 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:17.367352 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:17.366656 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:17.367352 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.366786 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:17.367352 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:17.367167 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:17.367352 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.367273 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:17.799781 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:17.799742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:17.799966 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:17.799862 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:17.800040 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.799993 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:17.800040 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.800012 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:17.800040 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.800024 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mfj9r for pod openshift-network-diagnostics/network-check-target-slvnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:17.800184 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.800087 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r podName:787cb2e6-d36b-412c-a1c0-9103f30d92f7 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:21.800068969 +0000 UTC m=+10.019580144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mfj9r" (UniqueName: "kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r") pod "network-check-target-slvnb" (UID: "787cb2e6-d36b-412c-a1c0-9103f30d92f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:17.800265 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.800250 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:17.800321 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.800300 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs podName:213caff4-1d8b-4359-8ac8-b74d609e0e00 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:21.800285569 +0000 UTC m=+10.019796740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs") pod "network-metrics-daemon-r7f5r" (UID: "213caff4-1d8b-4359-8ac8-b74d609e0e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:17.900310 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:17.900269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:17.900556 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.900444 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:17.900556 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:17.900522 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret podName:68bcd05d-92df-4758-a94a-30f988f2f0ed nodeName:}" failed. No retries permitted until 2026-09-10 03:39:21.900485889 +0000 UTC m=+10.119997057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret") pod "global-pull-secret-syncer-ghxlx" (UID: "68bcd05d-92df-4758-a94a-30f988f2f0ed") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:18.368237 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:18.367610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:18.368237 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:18.367735 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:19.366907 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:19.366873 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:19.367095 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:19.367006 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:19.367095 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:19.367092 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:19.367207 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:19.367181 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:20.367131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:20.367094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:20.367677 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:20.367234 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:21.366839 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:21.366809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:21.366991 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.366952 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:21.367121 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:21.367103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:21.367218 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.367195 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:21.833779 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:21.833385 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:21.833779 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:21.833449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:21.833779 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.833543 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:21.833779 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.833563 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:21.833779 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.833566 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:21.833779 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.833577 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mfj9r for pod openshift-network-diagnostics/network-check-target-slvnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:21.833779 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.833619 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r podName:787cb2e6-d36b-412c-a1c0-9103f30d92f7 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:29.833603648 +0000 UTC m=+18.053114814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mfj9r" (UniqueName: "kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r") pod "network-check-target-slvnb" (UID: "787cb2e6-d36b-412c-a1c0-9103f30d92f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:21.833779 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.833636 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs podName:213caff4-1d8b-4359-8ac8-b74d609e0e00 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:29.83362723 +0000 UTC m=+18.053138381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs") pod "network-metrics-daemon-r7f5r" (UID: "213caff4-1d8b-4359-8ac8-b74d609e0e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:21.934178 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:21.934143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:21.934351 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.934311 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:21.934420 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:21.934387 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret podName:68bcd05d-92df-4758-a94a-30f988f2f0ed nodeName:}" failed. No retries permitted until 2026-09-10 03:39:29.934367395 +0000 UTC m=+18.153878549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret") pod "global-pull-secret-syncer-ghxlx" (UID: "68bcd05d-92df-4758-a94a-30f988f2f0ed") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:22.367165 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:22.367135 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:22.367264 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:22.367239 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:23.367062 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:23.366697 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:23.367062 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:23.366826 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:23.367321 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:23.367207 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:23.367697 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:23.367319 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:24.366919 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:24.366877 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:24.367120 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:24.367007 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:25.367294 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:25.367259 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:25.367791 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:25.367265 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:25.367791 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:25.367386 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:25.367791 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:25.367479 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:26.366841 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:26.366813 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:26.369840 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:26.367247 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:27.367377 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:27.367343 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:27.367377 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:27.367366 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:27.367646 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:27.367473 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:27.367646 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:27.367626 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:28.367254 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:28.367230 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:28.367563 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:28.367321 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:29.366322 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:29.366290 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:29.366564 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:29.366291 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:29.366564 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.366406 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:29.366564 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.366515 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:29.886444 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:29.886403 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:29.886910 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:29.886471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:29.886910 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.886605 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:29.886910 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.886626 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:29.886910 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.886637 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:29.886910 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.886653 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mfj9r for pod openshift-network-diagnostics/network-check-target-slvnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:29.886910 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.886695 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs podName:213caff4-1d8b-4359-8ac8-b74d609e0e00 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:45.886674661 +0000 UTC m=+34.106185815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs") pod "network-metrics-daemon-r7f5r" (UID: "213caff4-1d8b-4359-8ac8-b74d609e0e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:29.886910 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.886716 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r podName:787cb2e6-d36b-412c-a1c0-9103f30d92f7 nodeName:}" failed. No retries permitted until 2026-09-10 03:39:45.886707418 +0000 UTC m=+34.106218574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mfj9r" (UniqueName: "kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r") pod "network-check-target-slvnb" (UID: "787cb2e6-d36b-412c-a1c0-9103f30d92f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:29.987381 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:29.987336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:29.987594 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.987539 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:29.987662 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:29.987615 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret podName:68bcd05d-92df-4758-a94a-30f988f2f0ed nodeName:}" failed. No retries permitted until 2026-09-10 03:39:45.987597588 +0000 UTC m=+34.207108753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret") pod "global-pull-secret-syncer-ghxlx" (UID: "68bcd05d-92df-4758-a94a-30f988f2f0ed") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:30.366662 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:30.366629 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:30.366831 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:30.366767 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:31.367007 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:31.366964 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:31.367416 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:31.367086 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:31.367416 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:31.367141 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:31.367416 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:31.367225 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:32.366993 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:32.366841 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:32.367099 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:32.367057 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:33.366788 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.366620 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:33.366933 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.366620 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:33.366933 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:33.366867 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:33.367024 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:33.366956 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:33.441703 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.441677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal" event={"ID":"8633308fe0afc9393e482bd331cb1311","Type":"ContainerStarted","Data":"374f4b263f4411997c07b6f4b62374f11ef2217cc5fddecb71203e4d5dc6bee2"} Sep 10 03:39:33.443281 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.443260 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xj75f" event={"ID":"5e910964-6cb9-4b92-b001-ccc756e54db5","Type":"ContainerStarted","Data":"a042fb496285ff673699045fa6bd91a38615f6de460955a7b9fee5c732462889"} Sep 10 03:39:33.444668 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.444646 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gv6n7" event={"ID":"d01ae2bc-55d5-4211-a419-b58cb760f7f2","Type":"ContainerStarted","Data":"20a910fa64d1ab0ccc7b74c4ed024b8d92529f3139157d91d2a86025beba3b7d"} Sep 10 03:39:33.446033 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.446013 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zzpgg" event={"ID":"4e0160b7-d9ed-466d-b049-cc3faa3b3b2d","Type":"ContainerStarted","Data":"b3c72837eab574e4e9ce9770b18823bfc373d4121795a051bd4f45a64897763b"} Sep 10 03:39:33.447448 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.447428 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdde3356-c271-4915-8c9b-0201d4f8aff7" containerID="8b18ac607ab6e9b743dd760598fe819948454c0d211b635ba890397cb5f8ae7c" exitCode=0 Sep 10 03:39:33.447562 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.447457 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vk84n" event={"ID":"cdde3356-c271-4915-8c9b-0201d4f8aff7","Type":"ContainerDied","Data":"8b18ac607ab6e9b743dd760598fe819948454c0d211b635ba890397cb5f8ae7c"} Sep 10 03:39:33.449032 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.448943 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-97ng6" event={"ID":"bcca23cc-de6e-40d4-a5f4-ebc6f080cb42","Type":"ContainerStarted","Data":"0390cd8b6cbe3f1d555a8084918858a3cee7ff984b365209907416e44737e96a"} Sep 10 03:39:33.450324 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.450302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" event={"ID":"72770130-94d4-4af8-8f92-49bb67cce161","Type":"ContainerStarted","Data":"2a76d4b3031c61fcd4fde036711dcf5f1507ab2e56dd314e22148b9a801947c4"} Sep 10 03:39:33.451838 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.451818 2580 generic.go:356] "Generic (PLEG): container finished" podID="c36f15fa8b0d0a13cd85f3184dea641a" containerID="9dd8da615fe7db2d9c935654baaa2254b78afbf420f152aa2e5264abf67d38e8" exitCode=0 Sep 10 03:39:33.451929 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.451893 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" event={"ID":"c36f15fa8b0d0a13cd85f3184dea641a","Type":"ContainerDied","Data":"9dd8da615fe7db2d9c935654baaa2254b78afbf420f152aa2e5264abf67d38e8"} Sep 10 03:39:33.454782 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.454764 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:39:33.455136 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.455118 2580 generic.go:356] "Generic (PLEG): container finished" podID="dc889041-66d1-47a7-a13e-01b24e3fa360" containerID="82c01c3cfa0f0d5f73ad02057168d30ced6dafffd2502471e02f7bb4f8eed238" exitCode=1 Sep 10 03:39:33.455204 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.455179 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerStarted","Data":"a33bc97902e1c2aa59b7a03d214f22dec2cafa70ab7b3283993faa6d0d1396c2"} Sep 10 03:39:33.455250 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.455232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerStarted","Data":"f7863833f3f0fa6ea8767021b9b9e991cc1090c349cad065745c027bb9afb022"} Sep 10 03:39:33.455295 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.455272 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerStarted","Data":"30163a65979aad7dd5a724924612d606a38cea484f69e6341929d6ab04f09c9b"} Sep 10 03:39:33.455335 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.455305 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerStarted","Data":"b1ba19c935553aa1ed03a96eedb830c2dcd01a9cf3b47e9cd1cff5d8e5b02800"} Sep 10 03:39:33.455373 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.455335 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerDied","Data":"82c01c3cfa0f0d5f73ad02057168d30ced6dafffd2502471e02f7bb4f8eed238"} Sep 10 03:39:33.455420 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.455375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerStarted","Data":"cb6c5f0a5a7b193175c66d79fd3cf6485b77376165f8bc0ad7e0339c8a2fe3c7"} Sep 10 03:39:33.457757 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.457678 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-138.ec2.internal" podStartSLOduration=19.457667193 podStartE2EDuration="19.457667193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:33.457351795 +0000 UTC m=+21.676862969" watchObservedRunningTime="2026-09-10 03:39:33.457667193 +0000 UTC m=+21.677178366" Sep 10 03:39:33.458778 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.458755 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8482s" event={"ID":"350afe90-c4e6-4027-b653-bd23f6cc4e2b","Type":"ContainerStarted","Data":"1a8687630e55035f763913df869470f1d9e5dd718a27efd56fbdd76010633467"} Sep 10 03:39:33.524376 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.524199 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zzpgg" podStartSLOduration=11.359355468 podStartE2EDuration="21.524184399s" totalImagesPullingTime="10.164828931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:33.508925983 +0000 UTC m=+21.728437156" watchObservedRunningTime="2026-09-10 03:39:33.524184399 +0000 UTC m=+21.743695564" Sep 10 03:39:33.524943 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.524903 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xj75f" podStartSLOduration=3.4382325959999998 podStartE2EDuration="21.524890001s" totalImagesPullingTime="18.086657405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:33.524493987 +0000 UTC m=+21.744005156" watchObservedRunningTime="2026-09-10 03:39:33.524890001 +0000 UTC m=+21.744401175" Sep 10 03:39:33.541746 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.541644 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-97ng6" podStartSLOduration=3.753750905 podStartE2EDuration="21.541624024s" totalImagesPullingTime="17.787873119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:33.541110958 +0000 UTC m=+21.760622133" watchObservedRunningTime="2026-09-10 03:39:33.541624024 +0000 UTC m=+21.761135199" Sep 10 03:39:33.556008 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.555948 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gv6n7" podStartSLOduration=3.8381139490000002 podStartE2EDuration="21.555928489s" totalImagesPullingTime="17.71781454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:33.555565933 +0000 UTC m=+21.775077107" watchObservedRunningTime="2026-09-10 03:39:33.555928489 +0000 UTC m=+21.775439667" Sep 10 03:39:33.573613 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.573561 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8482s" podStartSLOduration=3.8586516299999998 podStartE2EDuration="21.573541609s" totalImagesPullingTime="17.714889979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:33.573019721 +0000 UTC m=+21.792530895" watchObservedRunningTime="2026-09-10 03:39:33.573541609 +0000 UTC m=+21.793052782" Sep 10 03:39:33.995162 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:33.995142 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 03:39:34.253398 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.253363 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:34.254071 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.254048 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:34.356811 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.356704 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T03:39:33.995157747Z","UUID":"dbde185f-879a-4ba0-bd1c-40901af30677","Handler":null,"Name":"","Endpoint":""} Sep 10 03:39:34.358408 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.358378 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 03:39:34.358408 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.358406 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 03:39:34.366934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.366914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:34.367062 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:34.367035 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:34.462332 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.462294 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6gmh" event={"ID":"ff5dcd4e-a6e2-4c1a-9103-e75df88d93b3","Type":"ContainerStarted","Data":"1f68453f626a15f1582530d99e602b80f47d576553a6e97f4ba758493778fdd7"} Sep 10 03:39:34.464546 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.464524 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" event={"ID":"72770130-94d4-4af8-8f92-49bb67cce161","Type":"ContainerStarted","Data":"860b40695d108fdc29933091454464b5135fdfc3517aa1aecfcba7629cb4806e"} Sep 10 03:39:34.466604 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.466567 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" event={"ID":"c36f15fa8b0d0a13cd85f3184dea641a","Type":"ContainerStarted","Data":"ab2e31643cce8acab445271ae83f1b4c639679350233b7fedb8838950ef6f7de"} Sep 10 03:39:34.467381 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.467358 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:34.467730 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.467713 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zzpgg" Sep 10 03:39:34.477709 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.477652 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s6gmh" podStartSLOduration=4.802817374 podStartE2EDuration="22.477637703s" totalImagesPullingTime="17.674820329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:34.477427025 +0000 UTC m=+22.696938200" watchObservedRunningTime="2026-09-10 03:39:34.477637703 +0000 UTC m=+22.697148876" Sep 10 03:39:34.508905 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:34.508817 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-138.ec2.internal" podStartSLOduration=20.50879841 podStartE2EDuration="20.50879841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:34.508606758 +0000 UTC m=+22.728117928" watchObservedRunningTime="2026-09-10 03:39:34.50879841 +0000 UTC m=+22.728309589" Sep 10 03:39:35.366971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:35.366937 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:35.367146 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:35.367049 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:35.367146 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:35.367109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:35.367264 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:35.367220 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:35.472154 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:35.472114 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" event={"ID":"72770130-94d4-4af8-8f92-49bb67cce161","Type":"ContainerStarted","Data":"fd7a4f4b2f1c2ab92c80ba2fbb238771a358b41553770cd8090759f17bf1480b"} Sep 10 03:39:35.476070 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:35.476048 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:39:35.476591 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:35.476558 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerStarted","Data":"d5dbb22b621f1039a6d9b9870e79e1ae35fa3dd018ea22df8b291850acc1c8ea"} Sep 10 03:39:35.491751 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:35.491709 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd7j5" podStartSLOduration=3.822920152 podStartE2EDuration="23.491691114s" totalImagesPullingTime="19.668770962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:35.491546704 +0000 UTC m=+23.711057898" watchObservedRunningTime="2026-09-10 03:39:35.491691114 +0000 UTC m=+23.711202288" Sep 10 03:39:36.366606 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:36.366574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:36.366893 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:36.366726 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:37.366967 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:37.366932 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:37.367411 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:37.366931 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:37.367411 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:37.367147 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:37.367411 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:37.367268 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:38.366701 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:38.366494 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:38.366870 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:38.366772 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:38.486966 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:38.486938 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:39:38.487473 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:38.487314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerStarted","Data":"ef24e1c1380fb6c371d9a566bb52ed4c92c9635da6a03a17e4e0c5422222d66f"} Sep 10 03:39:38.487571 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:38.487557 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:38.487651 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:38.487637 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:38.487776 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:38.487760 2580 scope.go:117] "RemoveContainer" containerID="82c01c3cfa0f0d5f73ad02057168d30ced6dafffd2502471e02f7bb4f8eed238" Sep 10 03:39:38.489317 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:38.489293 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdde3356-c271-4915-8c9b-0201d4f8aff7" containerID="44e6c2ceff15bfc423c3b5e598073639add16a11397555c13fffa569396fd95a" exitCode=0 Sep 10 03:39:38.489422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:38.489330 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vk84n" event={"ID":"cdde3356-c271-4915-8c9b-0201d4f8aff7","Type":"ContainerDied","Data":"44e6c2ceff15bfc423c3b5e598073639add16a11397555c13fffa569396fd95a"} Sep 10 03:39:38.507336 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:38.507315 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:39.122447 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.122417 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gv6n7_d01ae2bc-55d5-4211-a419-b58cb760f7f2/dns-node-resolver/0.log" Sep 10 03:39:39.366901 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.366875 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:39.366901 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.366900 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:39.367038 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:39.366987 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:39.367130 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:39.367109 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:39.495749 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.495717 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:39:39.496487 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.496153 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" event={"ID":"dc889041-66d1-47a7-a13e-01b24e3fa360","Type":"ContainerStarted","Data":"13ea915558d637e519508d5014090dc1c8bdb02e74f27b400e19bb2da20a4531"} Sep 10 03:39:39.496487 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.496440 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:39.498719 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.498671 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdde3356-c271-4915-8c9b-0201d4f8aff7" containerID="299f063ee608deb6443a27a745acf7a94235ca06983d2b44e8afe5bd0e6368ac" exitCode=0 Sep 10 03:39:39.498719 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.498713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vk84n" event={"ID":"cdde3356-c271-4915-8c9b-0201d4f8aff7","Type":"ContainerDied","Data":"299f063ee608deb6443a27a745acf7a94235ca06983d2b44e8afe5bd0e6368ac"} Sep 10 03:39:39.501745 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.501722 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-slvnb"] Sep 10 03:39:39.501876 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.501835 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:39.501950 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:39.501916 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:39.504990 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.504969 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r7f5r"] Sep 10 03:39:39.505079 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.505069 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:39.505241 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:39.505217 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:39.505736 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.505717 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ghxlx"] Sep 10 03:39:39.505815 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.505806 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:39.506047 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:39.506023 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:39.514604 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.514573 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:39:39.530722 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.530676 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" podStartSLOduration=9.743279553 podStartE2EDuration="27.530662436s" totalImagesPullingTime="17.787382883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:39.530528645 +0000 UTC m=+27.750039818" watchObservedRunningTime="2026-09-10 03:39:39.530662436 +0000 UTC m=+27.750173600" Sep 10 03:39:39.705019 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:39.704996 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8482s_350afe90-c4e6-4027-b653-bd23f6cc4e2b/node-ca/0.log" Sep 10 03:39:40.503611 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:40.503491 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdde3356-c271-4915-8c9b-0201d4f8aff7" containerID="30cae472742110238ea99027bedce3902f806175e6811683828dc901ac77bf25" exitCode=0 Sep 10 03:39:40.503611 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:40.503532 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vk84n" event={"ID":"cdde3356-c271-4915-8c9b-0201d4f8aff7","Type":"ContainerDied","Data":"30cae472742110238ea99027bedce3902f806175e6811683828dc901ac77bf25"} Sep 10 03:39:41.366952 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:41.366912 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:41.366952 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:41.366936 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:41.366952 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:41.366961 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:41.367183 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:41.367096 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:41.367183 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:41.367129 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:41.367295 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:41.367267 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:43.366731 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:43.366695 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:43.367141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:43.366696 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:43.367141 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:43.366834 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:43.367141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:43.366700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:43.367141 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:43.366923 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:43.367141 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:43.367030 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:45.366399 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:45.366367 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:45.366900 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:45.366370 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:45.366900 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:45.366473 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:45.366900 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:45.366369 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:45.366900 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:45.366588 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:45.366900 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:45.366719 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:45.904141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:45.904089 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:45.904141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:45.904138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:45.904410 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:45.904225 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:45.904410 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:45.904245 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 03:39:45.904410 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:45.904270 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 03:39:45.904410 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:45.904276 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs podName:213caff4-1d8b-4359-8ac8-b74d609e0e00 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:17.904263074 +0000 UTC m=+66.123774224 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs") pod "network-metrics-daemon-r7f5r" (UID: "213caff4-1d8b-4359-8ac8-b74d609e0e00") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 03:39:45.904410 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:45.904282 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mfj9r for pod openshift-network-diagnostics/network-check-target-slvnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:45.904410 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:45.904328 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r podName:787cb2e6-d36b-412c-a1c0-9103f30d92f7 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:17.904317039 +0000 UTC m=+66.123828191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mfj9r" (UniqueName: "kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r") pod "network-check-target-slvnb" (UID: "787cb2e6-d36b-412c-a1c0-9103f30d92f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 03:39:46.004676 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:46.004640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:46.004862 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:46.004786 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:46.004862 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:46.004851 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret podName:68bcd05d-92df-4758-a94a-30f988f2f0ed nodeName:}" failed. No retries permitted until 2026-09-10 03:40:18.004836421 +0000 UTC m=+66.224347576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret") pod "global-pull-secret-syncer-ghxlx" (UID: "68bcd05d-92df-4758-a94a-30f988f2f0ed") : object "kube-system"/"original-pull-secret" not registered Sep 10 03:39:46.520312 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:46.520275 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdde3356-c271-4915-8c9b-0201d4f8aff7" containerID="3d2094191574323e29bf82e21b75d3a140d9c7847cf0707efeacffb45e4c838e" exitCode=0 Sep 10 03:39:46.520792 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:46.520350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vk84n" event={"ID":"cdde3356-c271-4915-8c9b-0201d4f8aff7","Type":"ContainerDied","Data":"3d2094191574323e29bf82e21b75d3a140d9c7847cf0707efeacffb45e4c838e"} Sep 10 03:39:47.366970 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:47.366934 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:47.367131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:47.367040 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:47.367131 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:47.367043 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:47.367131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:47.367046 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:47.367131 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:47.367121 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:47.367263 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:47.367200 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:47.525801 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:47.525767 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdde3356-c271-4915-8c9b-0201d4f8aff7" containerID="5220b3ae3bc739299a2e59d82b8ffa37f7c89ab3fdc53ed1e216560eb2d9c3fa" exitCode=0 Sep 10 03:39:47.526157 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:47.525829 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vk84n" event={"ID":"cdde3356-c271-4915-8c9b-0201d4f8aff7","Type":"ContainerDied","Data":"5220b3ae3bc739299a2e59d82b8ffa37f7c89ab3fdc53ed1e216560eb2d9c3fa"} Sep 10 03:39:48.531467 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:48.531215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vk84n" event={"ID":"cdde3356-c271-4915-8c9b-0201d4f8aff7","Type":"ContainerStarted","Data":"7cc47d7088a17f123b1b0dcea13313a76f44528b2186aa357a7ccd9008bd790e"} Sep 10 03:39:48.553469 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:48.553426 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vk84n" podStartSLOduration=12.121904854 podStartE2EDuration="36.553411241s" totalImagesPullingTime="24.431506387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:39:48.551833754 +0000 UTC m=+36.771344927" watchObservedRunningTime="2026-09-10 03:39:48.553411241 +0000 UTC m=+36.772922414" Sep 10 03:39:49.367255 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:49.367178 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:49.367255 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:49.367202 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:49.367255 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:49.367212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:49.367564 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:49.367275 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:49.367564 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:49.367351 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:49.367564 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:49.367440 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:51.366492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:51.366458 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:51.366965 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:51.366458 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:51.366965 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:51.366578 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:51.366965 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:51.366458 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:51.366965 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:51.366637 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:51.366965 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:51.366704 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:53.366415 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:53.366388 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:53.366870 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:53.366390 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:53.366870 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:53.366485 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:53.366870 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:53.366389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:53.366870 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:53.366615 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:53.366870 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:53.366692 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:55.366803 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:55.366771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:55.367186 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:55.366817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:55.367186 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:55.366870 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:55.367186 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:55.366882 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:55.367186 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:55.366943 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:55.367186 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:55.366990 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:57.367099 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:57.367068 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:57.367467 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:57.367164 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:57.367467 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:57.367174 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:39:57.367467 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:57.367247 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:57.367467 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:57.367284 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:57.367467 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:57.367341 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:59.366729 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:59.366701 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:39:59.367091 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:59.366703 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:39:59.367091 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:59.366796 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:39:59.367091 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:39:59.366709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:39:59.367091 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:59.366877 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:39:59.367091 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:39:59.366981 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:40:01.366894 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:01.366851 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:40:01.367387 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:01.366953 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:40:01.367387 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:01.366959 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:40:01.367387 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:01.366985 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:40:01.367387 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:01.367069 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:40:01.367387 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:01.367118 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:40:03.367381 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.367282 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:40:03.367834 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.367390 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:40:03.367834 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:03.367402 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghxlx" podUID="68bcd05d-92df-4758-a94a-30f988f2f0ed" Sep 10 03:40:03.367834 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.367418 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:40:03.367834 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:03.367479 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-slvnb" podUID="787cb2e6-d36b-412c-a1c0-9103f30d92f7" Sep 10 03:40:03.367834 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:03.367643 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r7f5r" podUID="213caff4-1d8b-4359-8ac8-b74d609e0e00" Sep 10 03:40:03.613712 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.613683 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-138.ec2.internal" event="NodeReady" Sep 10 03:40:03.613879 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.613823 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 03:40:03.660351 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.660273 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5x2qg"] Sep 10 03:40:03.662090 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.662072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.663272 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.663249 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fxgkh"] Sep 10 03:40:03.664438 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.664420 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5z68m\"" Sep 10 03:40:03.664552 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.664536 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 03:40:03.664624 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.664607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 03:40:03.665037 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.665020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.667726 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.667709 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 03:40:03.667841 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.667822 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 03:40:03.667911 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.667844 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 03:40:03.667911 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.667860 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 03:40:03.668212 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.668197 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2nrct\"" Sep 10 03:40:03.675614 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.675591 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5x2qg"] Sep 10 03:40:03.689071 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.689046 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fxgkh"] Sep 10 03:40:03.762692 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.762662 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vmt6r"] Sep 10 03:40:03.765185 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.765169 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vmt6r" Sep 10 03:40:03.767902 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.767881 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tssz\"" Sep 10 03:40:03.768017 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.767901 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 03:40:03.768017 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.767884 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 03:40:03.768017 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.767885 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 03:40:03.773923 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.773903 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vmt6r"] Sep 10 03:40:03.839702 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.839664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43359135-c5e7-4c06-b70b-dc2ae58a540c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.839702 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.839704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xklvq\" (UniqueName: \"kubernetes.io/projected/43359135-c5e7-4c06-b70b-dc2ae58a540c-kube-api-access-xklvq\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.839958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.839722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c697cf34-832b-43ef-9df9-28fbc080a2ae-metrics-tls\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.839958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.839781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43359135-c5e7-4c06-b70b-dc2ae58a540c-crio-socket\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.839958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.839829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c697cf34-832b-43ef-9df9-28fbc080a2ae-tmp-dir\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.839958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.839854 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43359135-c5e7-4c06-b70b-dc2ae58a540c-data-volume\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.839958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.839889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c697cf34-832b-43ef-9df9-28fbc080a2ae-config-volume\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.839958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.839932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43359135-c5e7-4c06-b70b-dc2ae58a540c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.839958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.839958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thpgv\" (UniqueName: \"kubernetes.io/projected/c697cf34-832b-43ef-9df9-28fbc080a2ae-kube-api-access-thpgv\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.940594 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43359135-c5e7-4c06-b70b-dc2ae58a540c-crio-socket\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.940762 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940610 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c697cf34-832b-43ef-9df9-28fbc080a2ae-tmp-dir\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.940762 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43359135-c5e7-4c06-b70b-dc2ae58a540c-data-volume\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.940762 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c697cf34-832b-43ef-9df9-28fbc080a2ae-config-volume\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.940762 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940682 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43359135-c5e7-4c06-b70b-dc2ae58a540c-crio-socket\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.940762 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43359135-c5e7-4c06-b70b-dc2ae58a540c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.940762 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thpgv\" (UniqueName: \"kubernetes.io/projected/c697cf34-832b-43ef-9df9-28fbc080a2ae-kube-api-access-thpgv\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.940762 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljcdh\" (UniqueName: \"kubernetes.io/projected/a2981f7e-ec7d-49ac-a492-324e19bab605-kube-api-access-ljcdh\") pod \"ingress-canary-vmt6r\" (UID: \"a2981f7e-ec7d-49ac-a492-324e19bab605\") " pod="openshift-ingress-canary/ingress-canary-vmt6r" Sep 10 03:40:03.941086 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43359135-c5e7-4c06-b70b-dc2ae58a540c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.941086 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xklvq\" (UniqueName: \"kubernetes.io/projected/43359135-c5e7-4c06-b70b-dc2ae58a540c-kube-api-access-xklvq\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.941086 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c697cf34-832b-43ef-9df9-28fbc080a2ae-metrics-tls\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.941086 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940984 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43359135-c5e7-4c06-b70b-dc2ae58a540c-data-volume\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.941086 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.940994 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c697cf34-832b-43ef-9df9-28fbc080a2ae-tmp-dir\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.941086 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.941036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2981f7e-ec7d-49ac-a492-324e19bab605-cert\") pod \"ingress-canary-vmt6r\" (UID: \"a2981f7e-ec7d-49ac-a492-324e19bab605\") " pod="openshift-ingress-canary/ingress-canary-vmt6r" Sep 10 03:40:03.941396 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.941371 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c697cf34-832b-43ef-9df9-28fbc080a2ae-config-volume\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.941447 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.941371 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43359135-c5e7-4c06-b70b-dc2ae58a540c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.944585 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.944567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43359135-c5e7-4c06-b70b-dc2ae58a540c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.944652 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.944593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c697cf34-832b-43ef-9df9-28fbc080a2ae-metrics-tls\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.948422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.948390 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thpgv\" (UniqueName: \"kubernetes.io/projected/c697cf34-832b-43ef-9df9-28fbc080a2ae-kube-api-access-thpgv\") pod \"dns-default-5x2qg\" (UID: \"c697cf34-832b-43ef-9df9-28fbc080a2ae\") " pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.948782 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.948760 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xklvq\" (UniqueName: \"kubernetes.io/projected/43359135-c5e7-4c06-b70b-dc2ae58a540c-kube-api-access-xklvq\") pod \"insights-runtime-extractor-fxgkh\" (UID: \"43359135-c5e7-4c06-b70b-dc2ae58a540c\") " pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:03.971791 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.971756 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:03.977311 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:03.977292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fxgkh" Sep 10 03:40:04.042185 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.042159 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljcdh\" (UniqueName: \"kubernetes.io/projected/a2981f7e-ec7d-49ac-a492-324e19bab605-kube-api-access-ljcdh\") pod \"ingress-canary-vmt6r\" (UID: \"a2981f7e-ec7d-49ac-a492-324e19bab605\") " pod="openshift-ingress-canary/ingress-canary-vmt6r" Sep 10 03:40:04.042299 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.042207 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2981f7e-ec7d-49ac-a492-324e19bab605-cert\") pod \"ingress-canary-vmt6r\" (UID: \"a2981f7e-ec7d-49ac-a492-324e19bab605\") " pod="openshift-ingress-canary/ingress-canary-vmt6r" Sep 10 03:40:04.045528 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.045349 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2981f7e-ec7d-49ac-a492-324e19bab605-cert\") pod \"ingress-canary-vmt6r\" (UID: \"a2981f7e-ec7d-49ac-a492-324e19bab605\") " pod="openshift-ingress-canary/ingress-canary-vmt6r" Sep 10 03:40:04.051206 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.051172 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljcdh\" (UniqueName: \"kubernetes.io/projected/a2981f7e-ec7d-49ac-a492-324e19bab605-kube-api-access-ljcdh\") pod \"ingress-canary-vmt6r\" (UID: \"a2981f7e-ec7d-49ac-a492-324e19bab605\") " pod="openshift-ingress-canary/ingress-canary-vmt6r" Sep 10 03:40:04.073825 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.073774 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vmt6r" Sep 10 03:40:04.257217 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.257139 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5x2qg"] Sep 10 03:40:04.261868 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.260524 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fxgkh"] Sep 10 03:40:04.263959 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:04.263935 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43359135_c5e7_4c06_b70b_dc2ae58a540c.slice/crio-182c0e1a5c7595f3dc2ee8bf281797c7878377530cb13fc0bad8e65d197e0277 WatchSource:0}: Error finding container 182c0e1a5c7595f3dc2ee8bf281797c7878377530cb13fc0bad8e65d197e0277: Status 404 returned error can't find the container with id 182c0e1a5c7595f3dc2ee8bf281797c7878377530cb13fc0bad8e65d197e0277 Sep 10 03:40:04.340304 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.340278 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vmt6r"] Sep 10 03:40:04.342777 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:04.342756 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2981f7e_ec7d_49ac_a492_324e19bab605.slice/crio-9b9fe3f06a15a802cc53cea142c2385684eca7c420376bc46f405973fe2fc7d8 WatchSource:0}: Error finding container 9b9fe3f06a15a802cc53cea142c2385684eca7c420376bc46f405973fe2fc7d8: Status 404 returned error can't find the container with id 9b9fe3f06a15a802cc53cea142c2385684eca7c420376bc46f405973fe2fc7d8 Sep 10 03:40:04.568913 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.568814 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5x2qg" event={"ID":"c697cf34-832b-43ef-9df9-28fbc080a2ae","Type":"ContainerStarted","Data":"21bc15a1bca445335c7bcaa64a5e2357b50e390558ace40544bb88ffc2241612"} Sep 10 03:40:04.569959 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.569933 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vmt6r" event={"ID":"a2981f7e-ec7d-49ac-a492-324e19bab605","Type":"ContainerStarted","Data":"9b9fe3f06a15a802cc53cea142c2385684eca7c420376bc46f405973fe2fc7d8"} Sep 10 03:40:04.571195 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.571173 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fxgkh" event={"ID":"43359135-c5e7-4c06-b70b-dc2ae58a540c","Type":"ContainerStarted","Data":"23944a17ec0f2294ecf411621eadc55e7748eaa029c5a5e22ebe5171b97077ac"} Sep 10 03:40:04.571280 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:04.571211 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fxgkh" event={"ID":"43359135-c5e7-4c06-b70b-dc2ae58a540c","Type":"ContainerStarted","Data":"182c0e1a5c7595f3dc2ee8bf281797c7878377530cb13fc0bad8e65d197e0277"} Sep 10 03:40:05.367242 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.367210 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:40:05.367411 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.367256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:40:05.367685 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.367655 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:40:05.371294 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.371274 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 03:40:05.371385 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.371330 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 03:40:05.371385 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.371375 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjm65\"" Sep 10 03:40:05.371520 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.371331 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vqcf\"" Sep 10 03:40:05.371520 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.371279 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 03:40:05.371632 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.371605 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 03:40:05.576653 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.576615 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fxgkh" event={"ID":"43359135-c5e7-4c06-b70b-dc2ae58a540c","Type":"ContainerStarted","Data":"a65dd2c6c32e6d406dbe667704130d9aeac2a889d4daa579098e8a6e16a412e9"} Sep 10 03:40:05.677130 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.677094 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vcj4h"] Sep 10 03:40:05.679423 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.679394 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.682422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.682113 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 03:40:05.682422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.682222 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 03:40:05.682422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.682241 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 03:40:05.682422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.682366 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-chbjl\"" Sep 10 03:40:05.682737 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.682520 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 03:40:05.682737 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.682589 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 03:40:05.688995 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.688922 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vcj4h"] Sep 10 03:40:05.855541 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.855485 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shdzw\" (UniqueName: \"kubernetes.io/projected/e62dbf17-1121-4d11-b99d-f16b3a95742d-kube-api-access-shdzw\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.855729 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.855601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62dbf17-1121-4d11-b99d-f16b3a95742d-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.855729 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.855638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e62dbf17-1121-4d11-b99d-f16b3a95742d-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.855729 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.855710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e62dbf17-1121-4d11-b99d-f16b3a95742d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.956521 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.956422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62dbf17-1121-4d11-b99d-f16b3a95742d-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.956521 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.956469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e62dbf17-1121-4d11-b99d-f16b3a95742d-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.956889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.956558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e62dbf17-1121-4d11-b99d-f16b3a95742d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.956889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.956619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shdzw\" (UniqueName: \"kubernetes.io/projected/e62dbf17-1121-4d11-b99d-f16b3a95742d-kube-api-access-shdzw\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.957351 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.957320 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e62dbf17-1121-4d11-b99d-f16b3a95742d-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.959542 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.959516 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e62dbf17-1121-4d11-b99d-f16b3a95742d-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.959650 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.959565 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e62dbf17-1121-4d11-b99d-f16b3a95742d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.967471 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.967432 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shdzw\" (UniqueName: \"kubernetes.io/projected/e62dbf17-1121-4d11-b99d-f16b3a95742d-kube-api-access-shdzw\") pod \"prometheus-operator-6f4946db56-vcj4h\" (UID: \"e62dbf17-1121-4d11-b99d-f16b3a95742d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:05.991820 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:05.991743 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" Sep 10 03:40:06.431475 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:06.431391 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vcj4h"] Sep 10 03:40:06.435101 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:06.435077 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62dbf17_1121_4d11_b99d_f16b3a95742d.slice/crio-a99af8ecd7101eff3e2293c1ad2be0dfb4e43e5e46f962e1232dde1de61110c5 WatchSource:0}: Error finding container a99af8ecd7101eff3e2293c1ad2be0dfb4e43e5e46f962e1232dde1de61110c5: Status 404 returned error can't find the container with id a99af8ecd7101eff3e2293c1ad2be0dfb4e43e5e46f962e1232dde1de61110c5 Sep 10 03:40:06.581998 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:06.581910 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5x2qg" event={"ID":"c697cf34-832b-43ef-9df9-28fbc080a2ae","Type":"ContainerStarted","Data":"58a636cfe6681190efeb557e16c5bd6b0cfff28408dda7f2850cd2cfda1790a3"} Sep 10 03:40:06.581998 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:06.581981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5x2qg" event={"ID":"c697cf34-832b-43ef-9df9-28fbc080a2ae","Type":"ContainerStarted","Data":"0d6f91fdc1381de464f5ae775594ba57947de32f02a70dd7e3972b94687868c4"} Sep 10 03:40:06.582482 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:06.582031 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:06.583879 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:06.583853 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" event={"ID":"e62dbf17-1121-4d11-b99d-f16b3a95742d","Type":"ContainerStarted","Data":"a99af8ecd7101eff3e2293c1ad2be0dfb4e43e5e46f962e1232dde1de61110c5"} Sep 10 03:40:06.600919 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:06.600857 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5x2qg" podStartSLOduration=1.677016848 podStartE2EDuration="3.600835647s" totalImagesPullingTime="1.923818799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:06.600654489 +0000 UTC m=+54.820165663" watchObservedRunningTime="2026-09-10 03:40:06.600835647 +0000 UTC m=+54.820346823" Sep 10 03:40:07.367107 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.367072 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-657c68b9bd-65gtw"] Sep 10 03:40:07.369047 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.369028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.371610 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.371584 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wsqw5\"" Sep 10 03:40:07.371857 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.371837 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 03:40:07.373976 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.372705 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 03:40:07.373976 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.373044 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 03:40:07.373976 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.373179 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 03:40:07.373976 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.373045 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 03:40:07.373976 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.373252 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 03:40:07.374281 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.374005 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 03:40:07.385817 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.385798 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657c68b9bd-65gtw"] Sep 10 03:40:07.468968 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.468928 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-config\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.469141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.468974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8h4v\" (UniqueName: \"kubernetes.io/projected/bf00790b-8446-4b3e-87a3-2a87bf68e03f-kube-api-access-w8h4v\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.469141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.469004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-serving-cert\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.469141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.469028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-service-ca\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.469141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.469057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-oauth-serving-cert\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.469141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.469134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-oauth-config\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.569547 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.569487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-config\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.569713 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.569568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8h4v\" (UniqueName: \"kubernetes.io/projected/bf00790b-8446-4b3e-87a3-2a87bf68e03f-kube-api-access-w8h4v\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.569713 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.569592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-serving-cert\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.569713 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.569609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-service-ca\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.569713 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.569626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-oauth-serving-cert\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.569919 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.569771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-oauth-config\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.570216 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.570174 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-config\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.570314 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.570234 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-service-ca\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.570314 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.570256 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-oauth-serving-cert\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.572071 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.572037 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-oauth-config\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.572166 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.572151 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-serving-cert\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.579061 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.579038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8h4v\" (UniqueName: \"kubernetes.io/projected/bf00790b-8446-4b3e-87a3-2a87bf68e03f-kube-api-access-w8h4v\") pod \"console-657c68b9bd-65gtw\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.680568 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.680534 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:07.962284 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:07.962251 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657c68b9bd-65gtw"] Sep 10 03:40:07.965304 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:07.965274 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf00790b_8446_4b3e_87a3_2a87bf68e03f.slice/crio-64ef7053e52e1f3632a9884b20ee3c62ccf81e9a08ede1ad87c5153d76a764fc WatchSource:0}: Error finding container 64ef7053e52e1f3632a9884b20ee3c62ccf81e9a08ede1ad87c5153d76a764fc: Status 404 returned error can't find the container with id 64ef7053e52e1f3632a9884b20ee3c62ccf81e9a08ede1ad87c5153d76a764fc Sep 10 03:40:08.590975 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:08.590943 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657c68b9bd-65gtw" event={"ID":"bf00790b-8446-4b3e-87a3-2a87bf68e03f","Type":"ContainerStarted","Data":"64ef7053e52e1f3632a9884b20ee3c62ccf81e9a08ede1ad87c5153d76a764fc"} Sep 10 03:40:08.592944 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:08.592920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fxgkh" event={"ID":"43359135-c5e7-4c06-b70b-dc2ae58a540c","Type":"ContainerStarted","Data":"73c9e617891da9812191adee064fd453579152d2c0fe200bdf3b516df32bd771"} Sep 10 03:40:08.594359 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:08.594339 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vmt6r" event={"ID":"a2981f7e-ec7d-49ac-a492-324e19bab605","Type":"ContainerStarted","Data":"38d7390f7c1c316a27982ce76888ce052126562b315ffb00692214ef57b726b4"} Sep 10 03:40:08.611155 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:08.611111 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fxgkh" podStartSLOduration=2.423161305 podStartE2EDuration="5.611097136s" totalImagesPullingTime="3.187935831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:40:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:08.610565201 +0000 UTC m=+56.830076375" watchObservedRunningTime="2026-09-10 03:40:08.611097136 +0000 UTC m=+56.830608308" Sep 10 03:40:08.626003 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:08.625960 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vmt6r" podStartSLOduration=2.376331742 podStartE2EDuration="5.625945437s" totalImagesPullingTime="3.249613695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:08.625087493 +0000 UTC m=+56.844598667" watchObservedRunningTime="2026-09-10 03:40:08.625945437 +0000 UTC m=+56.845456606" Sep 10 03:40:09.546901 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.546863 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d5fcdf5d9-t995n"] Sep 10 03:40:09.549177 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.549150 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.559918 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.559886 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 03:40:09.562249 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.562106 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5fcdf5d9-t995n"] Sep 10 03:40:09.600557 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.600518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" event={"ID":"e62dbf17-1121-4d11-b99d-f16b3a95742d","Type":"ContainerStarted","Data":"366199c208ce9d679c49829cbfe6754ae19494a2334c135dab9a18513860ab3a"} Sep 10 03:40:09.600725 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.600588 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" event={"ID":"e62dbf17-1121-4d11-b99d-f16b3a95742d","Type":"ContainerStarted","Data":"e34e35bcdc95fdee4b6613dfaa5654b1fa1fe2326c37d6cb0ce1b46fe274388a"} Sep 10 03:40:09.617787 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.617740 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-vcj4h" podStartSLOduration=2.32286166 podStartE2EDuration="4.617723221s" totalImagesPullingTime="2.294861561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:09.61709825 +0000 UTC m=+57.836609424" watchObservedRunningTime="2026-09-10 03:40:09.617723221 +0000 UTC m=+57.837234393" Sep 10 03:40:09.687569 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.687535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-serving-cert\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.687569 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.687583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-trusted-ca-bundle\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.687992 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.687754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-console-config\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.687992 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.687785 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-oauth-serving-cert\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.687992 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.687808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sphc2\" (UniqueName: \"kubernetes.io/projected/7171ce61-7b01-485c-a369-7a689881bafb-kube-api-access-sphc2\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.687992 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.687858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-oauth-config\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.687992 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.687886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-service-ca\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.788980 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.788943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-trusted-ca-bundle\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.789481 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.789454 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-console-config\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.789631 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.789492 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-oauth-serving-cert\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.789631 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.789532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sphc2\" (UniqueName: \"kubernetes.io/projected/7171ce61-7b01-485c-a369-7a689881bafb-kube-api-access-sphc2\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.789631 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.789561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-oauth-config\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.789631 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.789582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-service-ca\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.789631 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.789612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-serving-cert\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.790052 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.790006 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-trusted-ca-bundle\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.790312 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.790288 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-oauth-serving-cert\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.790415 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.790393 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-console-config\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.790561 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.790538 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-service-ca\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.792352 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.792311 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-oauth-config\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.792445 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.792422 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-serving-cert\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.798767 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.798707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sphc2\" (UniqueName: \"kubernetes.io/projected/7171ce61-7b01-485c-a369-7a689881bafb-kube-api-access-sphc2\") pod \"console-5d5fcdf5d9-t995n\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:09.865518 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:09.865469 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:10.143221 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:10.143144 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5fcdf5d9-t995n"] Sep 10 03:40:10.146553 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:10.146489 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7171ce61_7b01_485c_a369_7a689881bafb.slice/crio-5a3c4b23e34bfbfe4a264a2621451182b5db852f057de5b98d51b8b96a7de849 WatchSource:0}: Error finding container 5a3c4b23e34bfbfe4a264a2621451182b5db852f057de5b98d51b8b96a7de849: Status 404 returned error can't find the container with id 5a3c4b23e34bfbfe4a264a2621451182b5db852f057de5b98d51b8b96a7de849 Sep 10 03:40:10.605273 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:10.605237 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5fcdf5d9-t995n" event={"ID":"7171ce61-7b01-485c-a369-7a689881bafb","Type":"ContainerStarted","Data":"5a3c4b23e34bfbfe4a264a2621451182b5db852f057de5b98d51b8b96a7de849"} Sep 10 03:40:11.027065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.027030 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth"] Sep 10 03:40:11.032719 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.032696 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.035729 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.035440 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 03:40:11.035729 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.035440 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 03:40:11.036944 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.036923 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-w8n99\"" Sep 10 03:40:11.039974 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.039905 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth"] Sep 10 03:40:11.045363 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.045341 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4f5kp"] Sep 10 03:40:11.047389 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.047371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.049686 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.049665 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn"] Sep 10 03:40:11.050021 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.049998 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 03:40:11.050126 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.049999 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4kxjr\"" Sep 10 03:40:11.050126 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.050117 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 03:40:11.050353 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.050335 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 03:40:11.051949 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.051922 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.054264 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.054241 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 03:40:11.054361 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.054342 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mkvnv\"" Sep 10 03:40:11.054448 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.054432 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 03:40:11.054625 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.054608 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 03:40:11.062741 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.062722 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn"] Sep 10 03:40:11.099794 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.099757 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.099971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.099799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2d3c496-697d-4216-9fc1-9a2b621aad37-metrics-client-ca\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.099971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.099850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f38bea70-9e6e-4979-aa25-ca04d3518f75-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.099971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.099886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg6l9\" (UniqueName: \"kubernetes.io/projected/bce28c71-dfa0-48fe-a1c7-aec6945ac989-kube-api-access-lg6l9\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.100100 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.099992 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7j4l\" (UniqueName: \"kubernetes.io/projected/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-api-access-q7j4l\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.100100 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bce28c71-dfa0-48fe-a1c7-aec6945ac989-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.100100 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bce28c71-dfa0-48fe-a1c7-aec6945ac989-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.100100 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-tls\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.100258 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.100258 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2d3c496-697d-4216-9fc1-9a2b621aad37-root\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.100258 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-accelerators-collector-config\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.100258 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.100258 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bce28c71-dfa0-48fe-a1c7-aec6945ac989-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.100458 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.100458 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100299 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2d3c496-697d-4216-9fc1-9a2b621aad37-sys\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.100458 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-textfile\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.100458 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-wtmp\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.100458 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2dbn\" (UniqueName: \"kubernetes.io/projected/b2d3c496-697d-4216-9fc1-9a2b621aad37-kube-api-access-c2dbn\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.100458 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.100427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f38bea70-9e6e-4979-aa25-ca04d3518f75-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.205308 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-wtmp\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.205476 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2dbn\" (UniqueName: \"kubernetes.io/projected/b2d3c496-697d-4216-9fc1-9a2b621aad37-kube-api-access-c2dbn\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.205476 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f38bea70-9e6e-4979-aa25-ca04d3518f75-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.205476 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.205476 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2d3c496-697d-4216-9fc1-9a2b621aad37-metrics-client-ca\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.205476 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-wtmp\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.205476 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f38bea70-9e6e-4979-aa25-ca04d3518f75-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.205862 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg6l9\" (UniqueName: \"kubernetes.io/projected/bce28c71-dfa0-48fe-a1c7-aec6945ac989-kube-api-access-lg6l9\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.205862 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:11.205551 2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 10 03:40:11.205862 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:11.205617 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-tls podName:f38bea70-9e6e-4979-aa25-ca04d3518f75 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:11.705596869 +0000 UTC m=+59.925108038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-b9lfn" (UID: "f38bea70-9e6e-4979-aa25-ca04d3518f75") : secret "kube-state-metrics-tls" not found Sep 10 03:40:11.205862 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7j4l\" (UniqueName: \"kubernetes.io/projected/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-api-access-q7j4l\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.205862 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bce28c71-dfa0-48fe-a1c7-aec6945ac989-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.205862 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bce28c71-dfa0-48fe-a1c7-aec6945ac989-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.205862 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-tls\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.205862 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:11.205839 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 10 03:40:11.205862 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2d3c496-697d-4216-9fc1-9a2b621aad37-root\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:11.205903 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce28c71-dfa0-48fe-a1c7-aec6945ac989-openshift-state-metrics-tls podName:bce28c71-dfa0-48fe-a1c7-aec6945ac989 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:11.705886951 +0000 UTC m=+59.925398117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bce28c71-dfa0-48fe-a1c7-aec6945ac989-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-h6cth" (UID: "bce28c71-dfa0-48fe-a1c7-aec6945ac989") : secret "openshift-state-metrics-tls" not found Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f38bea70-9e6e-4979-aa25-ca04d3518f75-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-accelerators-collector-config\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205933 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2d3c496-697d-4216-9fc1-9a2b621aad37-root\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:11.205970 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.205990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bce28c71-dfa0-48fe-a1c7-aec6945ac989-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:11.206031 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-tls podName:b2d3c496-697d-4216-9fc1-9a2b621aad37 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:11.706014522 +0000 UTC m=+59.925525685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-tls") pod "node-exporter-4f5kp" (UID: "b2d3c496-697d-4216-9fc1-9a2b621aad37") : secret "node-exporter-tls" not found Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206075 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2d3c496-697d-4216-9fc1-9a2b621aad37-metrics-client-ca\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2d3c496-697d-4216-9fc1-9a2b621aad37-sys\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-textfile\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206198 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2d3c496-697d-4216-9fc1-9a2b621aad37-sys\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.206344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206233 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f38bea70-9e6e-4979-aa25-ca04d3518f75-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.207131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206392 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-textfile\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.207131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-accelerators-collector-config\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.207131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206676 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.207131 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.206913 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bce28c71-dfa0-48fe-a1c7-aec6945ac989-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.208251 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.208226 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.208337 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.208324 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bce28c71-dfa0-48fe-a1c7-aec6945ac989-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.208612 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.208585 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.216627 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.216593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2dbn\" (UniqueName: \"kubernetes.io/projected/b2d3c496-697d-4216-9fc1-9a2b621aad37-kube-api-access-c2dbn\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.216794 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.216778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7j4l\" (UniqueName: \"kubernetes.io/projected/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-api-access-q7j4l\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.217001 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.216985 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg6l9\" (UniqueName: \"kubernetes.io/projected/bce28c71-dfa0-48fe-a1c7-aec6945ac989-kube-api-access-lg6l9\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.519480 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.519452 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngz62" Sep 10 03:40:11.609968 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.609671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5fcdf5d9-t995n" event={"ID":"7171ce61-7b01-485c-a369-7a689881bafb","Type":"ContainerStarted","Data":"f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141"} Sep 10 03:40:11.611408 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.611382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657c68b9bd-65gtw" event={"ID":"bf00790b-8446-4b3e-87a3-2a87bf68e03f","Type":"ContainerStarted","Data":"acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503"} Sep 10 03:40:11.650849 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.650804 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d5fcdf5d9-t995n" podStartSLOduration=1.570412374 podStartE2EDuration="2.650789292s" totalImagesPullingTime="1.080376918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:11.633097472 +0000 UTC m=+59.852608646" watchObservedRunningTime="2026-09-10 03:40:11.650789292 +0000 UTC m=+59.870300465" Sep 10 03:40:11.651320 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.651299 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-657c68b9bd-65gtw" podStartSLOduration=1.391961403 podStartE2EDuration="4.651294122s" totalImagesPullingTime="3.259332719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:11.650090992 +0000 UTC m=+59.869602166" watchObservedRunningTime="2026-09-10 03:40:11.651294122 +0000 UTC m=+59.870805295" Sep 10 03:40:11.710511 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.710476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.711111 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.710708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bce28c71-dfa0-48fe-a1c7-aec6945ac989-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.711111 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.710768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-tls\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:11.711298 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:11.711143 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 03:40:11.711298 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:11.711193 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-tls podName:b2d3c496-697d-4216-9fc1-9a2b621aad37 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:12.711180164 +0000 UTC m=+60.930691316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-tls") pod "node-exporter-4f5kp" (UID: "b2d3c496-697d-4216-9fc1-9a2b621aad37") : secret "node-exporter-tls" not found Sep 10 03:40:11.712997 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.712968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f38bea70-9e6e-4979-aa25-ca04d3518f75-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-b9lfn\" (UID: \"f38bea70-9e6e-4979-aa25-ca04d3518f75\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:11.713198 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.713180 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bce28c71-dfa0-48fe-a1c7-aec6945ac989-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-h6cth\" (UID: \"bce28c71-dfa0-48fe-a1c7-aec6945ac989\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.944115 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.944091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" Sep 10 03:40:11.965289 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:11.965265 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" Sep 10 03:40:12.217081 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.217054 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth"] Sep 10 03:40:12.243128 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.243110 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn"] Sep 10 03:40:12.253487 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:12.253456 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38bea70_9e6e_4979_aa25_ca04d3518f75.slice/crio-d93bcfef15115a1ce936bf401b93fb00b850030c7268a22d107f2514643cc9c1 WatchSource:0}: Error finding container d93bcfef15115a1ce936bf401b93fb00b850030c7268a22d107f2514643cc9c1: Status 404 returned error can't find the container with id d93bcfef15115a1ce936bf401b93fb00b850030c7268a22d107f2514643cc9c1 Sep 10 03:40:12.616060 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.615966 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" event={"ID":"bce28c71-dfa0-48fe-a1c7-aec6945ac989","Type":"ContainerStarted","Data":"9d92126ff5572db305e138a750dbbdda8c4a68969c57b92002099c1222c31ffc"} Sep 10 03:40:12.616060 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.616030 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" event={"ID":"bce28c71-dfa0-48fe-a1c7-aec6945ac989","Type":"ContainerStarted","Data":"0f56c3c4b5069091f81b898d8800c46327c69e612bea0501b7c7e2d2ab57fe21"} Sep 10 03:40:12.616060 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.616056 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" event={"ID":"bce28c71-dfa0-48fe-a1c7-aec6945ac989","Type":"ContainerStarted","Data":"aedb51c1d70e4ab393db8d315feb22c94590e5bf18b150a57dae04720786a3fe"} Sep 10 03:40:12.617067 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.617032 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" event={"ID":"f38bea70-9e6e-4979-aa25-ca04d3518f75","Type":"ContainerStarted","Data":"d93bcfef15115a1ce936bf401b93fb00b850030c7268a22d107f2514643cc9c1"} Sep 10 03:40:12.719012 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.718975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-tls\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:12.721104 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.721086 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2d3c496-697d-4216-9fc1-9a2b621aad37-node-exporter-tls\") pod \"node-exporter-4f5kp\" (UID: \"b2d3c496-697d-4216-9fc1-9a2b621aad37\") " pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:12.861939 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.861904 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4kxjr\"" Sep 10 03:40:12.869906 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:12.869832 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4f5kp" Sep 10 03:40:12.880915 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:12.880888 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d3c496_697d_4216_9fc1_9a2b621aad37.slice/crio-b3019a532d3024799dbc7ca8d15a45fc54287225f060c316b4095413eee41dfd WatchSource:0}: Error finding container b3019a532d3024799dbc7ca8d15a45fc54287225f060c316b4095413eee41dfd: Status 404 returned error can't find the container with id b3019a532d3024799dbc7ca8d15a45fc54287225f060c316b4095413eee41dfd Sep 10 03:40:13.032860 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.032825 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68964d946b-9p6xg"] Sep 10 03:40:13.036178 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.036156 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.039224 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.039039 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 03:40:13.039224 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.039074 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2xnwr\"" Sep 10 03:40:13.039224 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.039141 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 03:40:13.039444 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.039252 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 03:40:13.039444 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.039350 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 03:40:13.039444 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.039406 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 03:40:13.039444 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.039422 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3lnqug6valrsk\"" Sep 10 03:40:13.048380 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.048360 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68964d946b-9p6xg"] Sep 10 03:40:13.122116 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.122033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.122116 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.122082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-grpc-tls\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.122328 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.122153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-tls\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.122328 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.122194 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.122328 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.122235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-metrics-client-ca\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.122328 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.122269 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.122554 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.122381 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfx46\" (UniqueName: \"kubernetes.io/projected/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-kube-api-access-sfx46\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.122554 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.122434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.223100 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.223068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfx46\" (UniqueName: \"kubernetes.io/projected/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-kube-api-access-sfx46\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.223279 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.223113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.223279 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.223183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.223279 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.223211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-grpc-tls\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.224134 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.223419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-tls\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.224134 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.223616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.224134 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.223679 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-metrics-client-ca\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.224134 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.223981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.230122 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.226715 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.230122 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.226728 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.230122 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.226908 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.230122 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.227602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-metrics-client-ca\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.230122 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.229127 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-tls\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.230122 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.229979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-grpc-tls\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.230580 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.230494 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.231634 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.231604 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfx46\" (UniqueName: \"kubernetes.io/projected/ab3b7483-7e14-417a-ae4b-22656e6a2ffa-kube-api-access-sfx46\") pod \"thanos-querier-68964d946b-9p6xg\" (UID: \"ab3b7483-7e14-417a-ae4b-22656e6a2ffa\") " pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.348076 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.348046 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:13.622615 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.622578 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" event={"ID":"bce28c71-dfa0-48fe-a1c7-aec6945ac989","Type":"ContainerStarted","Data":"2307087e8bb852fffb77ecd5a244225b76c54c7b6adba0077e75706fac6f1916"} Sep 10 03:40:13.623914 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.623885 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4f5kp" event={"ID":"b2d3c496-697d-4216-9fc1-9a2b621aad37","Type":"ContainerStarted","Data":"b3019a532d3024799dbc7ca8d15a45fc54287225f060c316b4095413eee41dfd"} Sep 10 03:40:13.640291 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.640176 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h6cth" podStartSLOduration=1.547059757 podStartE2EDuration="2.640162315s" totalImagesPullingTime="1.093102558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:13.63943383 +0000 UTC m=+61.858945004" watchObservedRunningTime="2026-09-10 03:40:13.640162315 +0000 UTC m=+61.859673487" Sep 10 03:40:13.658748 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:13.658720 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68964d946b-9p6xg"] Sep 10 03:40:13.828778 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:13.828742 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3b7483_7e14_417a_ae4b_22656e6a2ffa.slice/crio-75f0ef1f3d9ea82885528a77aab1ebe069406495570048fcf3ea9889339718b5 WatchSource:0}: Error finding container 75f0ef1f3d9ea82885528a77aab1ebe069406495570048fcf3ea9889339718b5: Status 404 returned error can't find the container with id 75f0ef1f3d9ea82885528a77aab1ebe069406495570048fcf3ea9889339718b5 Sep 10 03:40:14.630229 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:14.630191 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" event={"ID":"f38bea70-9e6e-4979-aa25-ca04d3518f75","Type":"ContainerStarted","Data":"a299df3a78a2fd642fddfaec53b45d9d1ad67ca41312ab6216d403d30926436e"} Sep 10 03:40:14.630652 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:14.630258 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" event={"ID":"f38bea70-9e6e-4979-aa25-ca04d3518f75","Type":"ContainerStarted","Data":"ae335d5752e411590c792ca5119242611faa22589a3306243969eb46c7f5efe7"} Sep 10 03:40:14.630652 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:14.630280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" event={"ID":"f38bea70-9e6e-4979-aa25-ca04d3518f75","Type":"ContainerStarted","Data":"dfaf47bd6e9ddb6eb5a6a35720848a8cef8185c9cc751fa37abe24bb12bf9d61"} Sep 10 03:40:14.632250 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:14.632218 2580 generic.go:356] "Generic (PLEG): container finished" podID="b2d3c496-697d-4216-9fc1-9a2b621aad37" containerID="3a6e55150a548f201c0466009f728300d9f1953b3968704312885d6e0fa0f5fb" exitCode=0 Sep 10 03:40:14.632360 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:14.632306 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4f5kp" event={"ID":"b2d3c496-697d-4216-9fc1-9a2b621aad37","Type":"ContainerDied","Data":"3a6e55150a548f201c0466009f728300d9f1953b3968704312885d6e0fa0f5fb"} Sep 10 03:40:14.634334 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:14.634306 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" event={"ID":"ab3b7483-7e14-417a-ae4b-22656e6a2ffa","Type":"ContainerStarted","Data":"75f0ef1f3d9ea82885528a77aab1ebe069406495570048fcf3ea9889339718b5"} Sep 10 03:40:14.649120 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:14.649076 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b9lfn" podStartSLOduration=2.033411028 podStartE2EDuration="3.649061165s" totalImagesPullingTime="1.615650137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:14.647882083 +0000 UTC m=+62.867393280" watchObservedRunningTime="2026-09-10 03:40:14.649061165 +0000 UTC m=+62.868572348" Sep 10 03:40:15.436906 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.436854 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-649c97f8f9-v6k5b"] Sep 10 03:40:15.453246 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.453214 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-649c97f8f9-v6k5b"] Sep 10 03:40:15.453415 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.453329 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.456090 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.456067 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 03:40:15.456223 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.456204 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q8zd8\"" Sep 10 03:40:15.457476 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.457247 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 03:40:15.457476 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.457299 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eaargfg5kqd05\"" Sep 10 03:40:15.457476 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.457254 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 03:40:15.457716 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.457632 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 03:40:15.546878 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.546844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae9ca4de-22e6-4fe0-88af-74b1280114bc-metrics-server-audit-profiles\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.546878 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.546880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae9ca4de-22e6-4fe0-88af-74b1280114bc-audit-log\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.547083 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.546953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae9ca4de-22e6-4fe0-88af-74b1280114bc-secret-metrics-server-client-certs\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.547083 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.547042 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae9ca4de-22e6-4fe0-88af-74b1280114bc-client-ca-bundle\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.547183 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.547102 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae9ca4de-22e6-4fe0-88af-74b1280114bc-secret-metrics-server-tls\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.547183 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.547137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae9ca4de-22e6-4fe0-88af-74b1280114bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.547279 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.547184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbvh7\" (UniqueName: \"kubernetes.io/projected/ae9ca4de-22e6-4fe0-88af-74b1280114bc-kube-api-access-bbvh7\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.640541 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.640485 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4f5kp" event={"ID":"b2d3c496-697d-4216-9fc1-9a2b621aad37","Type":"ContainerStarted","Data":"a79cd47afd2b089937226db0a70ee58c3f98b6ef135541f19025bd2152fd910a"} Sep 10 03:40:15.640987 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.640568 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4f5kp" event={"ID":"b2d3c496-697d-4216-9fc1-9a2b621aad37","Type":"ContainerStarted","Data":"e3ed190725b7797fd09f4d73b4f29032d86814b9fe37b1a5eff2d627a72358fe"} Sep 10 03:40:15.648579 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.648555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae9ca4de-22e6-4fe0-88af-74b1280114bc-secret-metrics-server-tls\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.648690 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.648598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae9ca4de-22e6-4fe0-88af-74b1280114bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.648690 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.648625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbvh7\" (UniqueName: \"kubernetes.io/projected/ae9ca4de-22e6-4fe0-88af-74b1280114bc-kube-api-access-bbvh7\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.648690 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.648649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae9ca4de-22e6-4fe0-88af-74b1280114bc-metrics-server-audit-profiles\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.648690 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.648680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae9ca4de-22e6-4fe0-88af-74b1280114bc-audit-log\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.648870 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.648729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae9ca4de-22e6-4fe0-88af-74b1280114bc-secret-metrics-server-client-certs\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.648870 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.648800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae9ca4de-22e6-4fe0-88af-74b1280114bc-client-ca-bundle\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.649262 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.649236 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae9ca4de-22e6-4fe0-88af-74b1280114bc-audit-log\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.649469 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.649447 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae9ca4de-22e6-4fe0-88af-74b1280114bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.649915 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.649887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae9ca4de-22e6-4fe0-88af-74b1280114bc-metrics-server-audit-profiles\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.651624 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.651596 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae9ca4de-22e6-4fe0-88af-74b1280114bc-secret-metrics-server-tls\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.651782 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.651761 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae9ca4de-22e6-4fe0-88af-74b1280114bc-secret-metrics-server-client-certs\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.651782 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.651778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae9ca4de-22e6-4fe0-88af-74b1280114bc-client-ca-bundle\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.656261 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.656241 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbvh7\" (UniqueName: \"kubernetes.io/projected/ae9ca4de-22e6-4fe0-88af-74b1280114bc-kube-api-access-bbvh7\") pod \"metrics-server-649c97f8f9-v6k5b\" (UID: \"ae9ca4de-22e6-4fe0-88af-74b1280114bc\") " pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.658185 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.658135 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4f5kp" podStartSLOduration=3.023506268 podStartE2EDuration="4.658119931s" totalImagesPullingTime="1.574016548s" totalInitContainerRuntime="60.597115ms" isStatefulPod=true podCreationTimestamp="2026-09-10 03:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:15.657346141 +0000 UTC m=+63.876857315" watchObservedRunningTime="2026-09-10 03:40:15.658119931 +0000 UTC m=+63.877631106" Sep 10 03:40:15.765418 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.765351 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:15.825042 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.825000 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg"] Sep 10 03:40:15.839582 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.839400 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657c68b9bd-65gtw"] Sep 10 03:40:15.839582 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.839450 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg"] Sep 10 03:40:15.839780 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.839592 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:15.842121 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.842094 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 03:40:15.842121 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.842118 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-h6gc7\"" Sep 10 03:40:15.852709 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.852684 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f5fb495b4-pxthb"] Sep 10 03:40:15.877639 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.877606 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5fb495b4-pxthb"] Sep 10 03:40:15.877777 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.877722 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:15.950929 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.950894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-serving-cert\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:15.951038 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.950941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrght\" (UniqueName: \"kubernetes.io/projected/585faa66-ef27-4fa8-8d23-ee49240ff450-kube-api-access-lrght\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:15.951038 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.950963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/883e49d9-190d-496f-aa11-f5e1dddba025-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-wztwg\" (UID: \"883e49d9-190d-496f-aa11-f5e1dddba025\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:15.951119 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.951036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-console-config\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:15.951119 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.951070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-oauth-config\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:15.951119 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.951089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-trusted-ca-bundle\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:15.951119 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.951109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-oauth-serving-cert\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:15.951246 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.951166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-service-ca\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:15.951246 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:15.951181 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfwx7\" (UniqueName: \"kubernetes.io/projected/883e49d9-190d-496f-aa11-f5e1dddba025-kube-api-access-pfwx7\") pod \"monitoring-plugin-85bbbbbf4-wztwg\" (UID: \"883e49d9-190d-496f-aa11-f5e1dddba025\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:16.052239 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.052163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-service-ca\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.052239 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.052196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwx7\" (UniqueName: \"kubernetes.io/projected/883e49d9-190d-496f-aa11-f5e1dddba025-kube-api-access-pfwx7\") pod \"monitoring-plugin-85bbbbbf4-wztwg\" (UID: \"883e49d9-190d-496f-aa11-f5e1dddba025\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:16.052239 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.052226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-serving-cert\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.052483 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.052249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrght\" (UniqueName: \"kubernetes.io/projected/585faa66-ef27-4fa8-8d23-ee49240ff450-kube-api-access-lrght\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.052483 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.052265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/883e49d9-190d-496f-aa11-f5e1dddba025-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-wztwg\" (UID: \"883e49d9-190d-496f-aa11-f5e1dddba025\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:16.052483 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.052321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-console-config\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.052483 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.052344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-oauth-config\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.052483 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.052363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-trusted-ca-bundle\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.052727 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:16.052532 2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 10 03:40:16.052727 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.052565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-oauth-serving-cert\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.052727 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:16.052602 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883e49d9-190d-496f-aa11-f5e1dddba025-monitoring-plugin-cert podName:883e49d9-190d-496f-aa11-f5e1dddba025 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:16.55258038 +0000 UTC m=+64.772091531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/883e49d9-190d-496f-aa11-f5e1dddba025-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-wztwg" (UID: "883e49d9-190d-496f-aa11-f5e1dddba025") : secret "monitoring-plugin-cert" not found Sep 10 03:40:16.053044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.053022 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-service-ca\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.053146 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.053062 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-console-config\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.053284 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.053265 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-oauth-serving-cert\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.053698 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.053672 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-trusted-ca-bundle\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.054989 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.054967 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-oauth-config\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.055074 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.054976 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-serving-cert\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.060752 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.060728 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrght\" (UniqueName: \"kubernetes.io/projected/585faa66-ef27-4fa8-8d23-ee49240ff450-kube-api-access-lrght\") pod \"console-6f5fb495b4-pxthb\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.060837 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.060768 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfwx7\" (UniqueName: \"kubernetes.io/projected/883e49d9-190d-496f-aa11-f5e1dddba025-kube-api-access-pfwx7\") pod \"monitoring-plugin-85bbbbbf4-wztwg\" (UID: \"883e49d9-190d-496f-aa11-f5e1dddba025\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:16.188984 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.188951 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:16.220323 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.220296 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-649c97f8f9-v6k5b"] Sep 10 03:40:16.319564 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:16.319485 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9ca4de_22e6_4fe0_88af_74b1280114bc.slice/crio-20d08eff6b351365b544fb9eabb4d3d0eeb09e90056d3eea6ac32e56cf4e0e6c WatchSource:0}: Error finding container 20d08eff6b351365b544fb9eabb4d3d0eeb09e90056d3eea6ac32e56cf4e0e6c: Status 404 returned error can't find the container with id 20d08eff6b351365b544fb9eabb4d3d0eeb09e90056d3eea6ac32e56cf4e0e6c Sep 10 03:40:16.555636 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.555609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/883e49d9-190d-496f-aa11-f5e1dddba025-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-wztwg\" (UID: \"883e49d9-190d-496f-aa11-f5e1dddba025\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:16.555790 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:16.555773 2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 10 03:40:16.555865 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:16.555853 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883e49d9-190d-496f-aa11-f5e1dddba025-monitoring-plugin-cert podName:883e49d9-190d-496f-aa11-f5e1dddba025 nodeName:}" failed. No retries permitted until 2026-09-10 03:40:17.555832208 +0000 UTC m=+65.775343380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/883e49d9-190d-496f-aa11-f5e1dddba025-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-wztwg" (UID: "883e49d9-190d-496f-aa11-f5e1dddba025") : secret "monitoring-plugin-cert" not found Sep 10 03:40:16.589323 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.589299 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5x2qg" Sep 10 03:40:16.619048 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.619010 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5fb495b4-pxthb"] Sep 10 03:40:16.623280 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:16.623248 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585faa66_ef27_4fa8_8d23_ee49240ff450.slice/crio-4c4c8341242f01c4f43ef92c75d8c4eece2ab58c41e77bced751afa92f2e5ff0 WatchSource:0}: Error finding container 4c4c8341242f01c4f43ef92c75d8c4eece2ab58c41e77bced751afa92f2e5ff0: Status 404 returned error can't find the container with id 4c4c8341242f01c4f43ef92c75d8c4eece2ab58c41e77bced751afa92f2e5ff0 Sep 10 03:40:16.651446 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.651419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" event={"ID":"ab3b7483-7e14-417a-ae4b-22656e6a2ffa","Type":"ContainerStarted","Data":"c23b7b14e5006e7a3c7914d4096525a7ddc197d4ac451e4806815d0c732940d6"} Sep 10 03:40:16.651914 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.651520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" event={"ID":"ab3b7483-7e14-417a-ae4b-22656e6a2ffa","Type":"ContainerStarted","Data":"714afc985c87c3daee42b1ab4d89a33e5c419bf5b02868c13d73024e33ce6358"} Sep 10 03:40:16.652837 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.652815 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5fb495b4-pxthb" event={"ID":"585faa66-ef27-4fa8-8d23-ee49240ff450","Type":"ContainerStarted","Data":"4c4c8341242f01c4f43ef92c75d8c4eece2ab58c41e77bced751afa92f2e5ff0"} Sep 10 03:40:16.654121 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:16.654098 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" event={"ID":"ae9ca4de-22e6-4fe0-88af-74b1280114bc","Type":"ContainerStarted","Data":"20d08eff6b351365b544fb9eabb4d3d0eeb09e90056d3eea6ac32e56cf4e0e6c"} Sep 10 03:40:17.243166 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.243040 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 03:40:17.246129 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.246105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.248826 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.248801 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 03:40:17.252170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.251276 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 03:40:17.252170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.251326 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 03:40:17.252170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.251278 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 03:40:17.252170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.251551 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 03:40:17.252170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.251636 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qc7wn\"" Sep 10 03:40:17.252170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.251738 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 03:40:17.252170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.251828 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 03:40:17.252170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.251928 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 03:40:17.252170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.252020 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4h60phpl56eh0\"" Sep 10 03:40:17.253230 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.252849 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 03:40:17.253230 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.252968 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 03:40:17.253230 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.253055 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 03:40:17.253230 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.253092 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 03:40:17.253230 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.253142 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 03:40:17.253874 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.253854 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 03:40:17.264433 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.264409 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 03:40:17.364038 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364008 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364226 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fljl7\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-kube-api-access-fljl7\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364226 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364226 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364377 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364377 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364377 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364494 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364494 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364412 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364494 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364637 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364524 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364637 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364637 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364637 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364827 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364827 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364827 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364827 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364827 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364795 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.364827 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.364821 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466168 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466343 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fljl7\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-kube-api-access-fljl7\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466343 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466343 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466262 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466343 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466343 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466343 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466343 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466403 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466459 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.466934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.467464 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.466947 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.467464 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.467257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.469323 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.469296 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.470722 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.470079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.471331 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.471705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.471874 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-web-config\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.471938 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.472012 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.472071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.472097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.472961 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.473444 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.473459 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474065 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.473795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config-out\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474668 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.474443 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.474827 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.474805 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.476340 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.476296 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.477096 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.476894 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.479074 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.478691 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fljl7\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-kube-api-access-fljl7\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.479074 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.479021 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.479074 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.479021 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.480485 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.480460 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.560038 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.559729 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:17.573836 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.573689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/883e49d9-190d-496f-aa11-f5e1dddba025-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-wztwg\" (UID: \"883e49d9-190d-496f-aa11-f5e1dddba025\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:17.579058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.579002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/883e49d9-190d-496f-aa11-f5e1dddba025-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-wztwg\" (UID: \"883e49d9-190d-496f-aa11-f5e1dddba025\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:17.652923 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.652888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:17.663364 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.663330 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" event={"ID":"ab3b7483-7e14-417a-ae4b-22656e6a2ffa","Type":"ContainerStarted","Data":"a01152a6647e678cf9019a2133446270bbcb222488577f4c576c8eaae2b5023f"} Sep 10 03:40:17.665401 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.665199 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5fb495b4-pxthb" event={"ID":"585faa66-ef27-4fa8-8d23-ee49240ff450","Type":"ContainerStarted","Data":"e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41"} Sep 10 03:40:17.680988 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.680962 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:17.687514 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.687437 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f5fb495b4-pxthb" podStartSLOduration=2.6874166600000002 podStartE2EDuration="2.68741666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:17.684246659 +0000 UTC m=+65.903757832" watchObservedRunningTime="2026-09-10 03:40:17.68741666 +0000 UTC m=+65.906927837" Sep 10 03:40:17.978285 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.978251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:40:17.978466 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.978396 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:40:17.980978 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.980954 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 03:40:17.981104 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.980954 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 03:40:17.991381 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.991361 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 03:40:17.991644 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:17.991619 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/213caff4-1d8b-4359-8ac8-b74d609e0e00-metrics-certs\") pod \"network-metrics-daemon-r7f5r\" (UID: \"213caff4-1d8b-4359-8ac8-b74d609e0e00\") " pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:40:18.001944 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.001922 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfj9r\" (UniqueName: \"kubernetes.io/projected/787cb2e6-d36b-412c-a1c0-9103f30d92f7-kube-api-access-mfj9r\") pod \"network-check-target-slvnb\" (UID: \"787cb2e6-d36b-412c-a1c0-9103f30d92f7\") " pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:40:18.079470 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.079300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:40:18.081904 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.081881 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 03:40:18.092144 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.092092 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68bcd05d-92df-4758-a94a-30f988f2f0ed-original-pull-secret\") pod \"global-pull-secret-syncer-ghxlx\" (UID: \"68bcd05d-92df-4758-a94a-30f988f2f0ed\") " pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:40:18.283437 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.283408 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjm65\"" Sep 10 03:40:18.291768 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.291745 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:40:18.292231 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.292215 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6vqcf\"" Sep 10 03:40:18.296539 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.296526 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghxlx" Sep 10 03:40:18.300269 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.300247 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r7f5r" Sep 10 03:40:18.343340 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.343222 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg"] Sep 10 03:40:18.356964 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.356864 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 03:40:18.382066 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:18.382027 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14aa2795_c000_42e4_a50e_32c1ba26bb4b.slice/crio-813946a0cbc60de85bb8874c1ec77913da8e3af883b9dfad78030dd9ca347415 WatchSource:0}: Error finding container 813946a0cbc60de85bb8874c1ec77913da8e3af883b9dfad78030dd9ca347415: Status 404 returned error can't find the container with id 813946a0cbc60de85bb8874c1ec77913da8e3af883b9dfad78030dd9ca347415 Sep 10 03:40:18.568848 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.568821 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-slvnb"] Sep 10 03:40:18.571362 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:18.571331 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787cb2e6_d36b_412c_a1c0_9103f30d92f7.slice/crio-b14bc75c27c2d173190c78f7f6554d4ec64eebdc3fe630c03e14aeb13249349f WatchSource:0}: Error finding container b14bc75c27c2d173190c78f7f6554d4ec64eebdc3fe630c03e14aeb13249349f: Status 404 returned error can't find the container with id b14bc75c27c2d173190c78f7f6554d4ec64eebdc3fe630c03e14aeb13249349f Sep 10 03:40:18.588072 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.588042 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ghxlx"] Sep 10 03:40:18.590637 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:18.590611 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68bcd05d_92df_4758_a94a_30f988f2f0ed.slice/crio-6d1be8799212fa7454075dae710fd851f756d6c3006a49bf6e4c4680195d5b3c WatchSource:0}: Error finding container 6d1be8799212fa7454075dae710fd851f756d6c3006a49bf6e4c4680195d5b3c: Status 404 returned error can't find the container with id 6d1be8799212fa7454075dae710fd851f756d6c3006a49bf6e4c4680195d5b3c Sep 10 03:40:18.604740 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.604716 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r7f5r"] Sep 10 03:40:18.606854 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:40:18.606833 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213caff4_1d8b_4359_8ac8_b74d609e0e00.slice/crio-e6718bec48c94872509b63ee3bb5998796b20c0b7bfd2b1995e5c504c71d46f5 WatchSource:0}: Error finding container e6718bec48c94872509b63ee3bb5998796b20c0b7bfd2b1995e5c504c71d46f5: Status 404 returned error can't find the container with id e6718bec48c94872509b63ee3bb5998796b20c0b7bfd2b1995e5c504c71d46f5 Sep 10 03:40:18.672310 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.672275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" event={"ID":"ab3b7483-7e14-417a-ae4b-22656e6a2ffa","Type":"ContainerStarted","Data":"64b775b3ed93313d4e392e081da20b337dadb31f51e7183a9879a8c7fed3a4c6"} Sep 10 03:40:18.672705 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.672347 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" event={"ID":"ab3b7483-7e14-417a-ae4b-22656e6a2ffa","Type":"ContainerStarted","Data":"d54eaf4d076e58a41c587fddeb789c137554c08dff3ff7dcd10e841b5c6d94cb"} Sep 10 03:40:18.672705 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.672388 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" event={"ID":"ab3b7483-7e14-417a-ae4b-22656e6a2ffa","Type":"ContainerStarted","Data":"4026281c72fb504add394dd19438f47ad1533bc8b378042b44748a7f9d9cf866"} Sep 10 03:40:18.672705 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.672432 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:18.674021 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.673999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" event={"ID":"ae9ca4de-22e6-4fe0-88af-74b1280114bc","Type":"ContainerStarted","Data":"99d325afb7880be07e740e7809c024b8dd5900db296ddd4002a9039cf4133320"} Sep 10 03:40:18.675303 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.675284 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r7f5r" event={"ID":"213caff4-1d8b-4359-8ac8-b74d609e0e00","Type":"ContainerStarted","Data":"e6718bec48c94872509b63ee3bb5998796b20c0b7bfd2b1995e5c504c71d46f5"} Sep 10 03:40:18.676414 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.676386 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ghxlx" event={"ID":"68bcd05d-92df-4758-a94a-30f988f2f0ed","Type":"ContainerStarted","Data":"6d1be8799212fa7454075dae710fd851f756d6c3006a49bf6e4c4680195d5b3c"} Sep 10 03:40:18.677632 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.677613 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-slvnb" event={"ID":"787cb2e6-d36b-412c-a1c0-9103f30d92f7","Type":"ContainerStarted","Data":"b14bc75c27c2d173190c78f7f6554d4ec64eebdc3fe630c03e14aeb13249349f"} Sep 10 03:40:18.678759 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.678741 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerStarted","Data":"813946a0cbc60de85bb8874c1ec77913da8e3af883b9dfad78030dd9ca347415"} Sep 10 03:40:18.679929 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.679910 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" event={"ID":"883e49d9-190d-496f-aa11-f5e1dddba025","Type":"ContainerStarted","Data":"238eb0ce6fc686a01778813cd4096daf6e4c5609486e89cb08ff97959da566c2"} Sep 10 03:40:18.693263 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.693221 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" podStartSLOduration=1.806537188 podStartE2EDuration="5.693205121s" totalImagesPullingTime="3.886667933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:18.693106929 +0000 UTC m=+66.912618102" watchObservedRunningTime="2026-09-10 03:40:18.693205121 +0000 UTC m=+66.912716294" Sep 10 03:40:18.711631 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:18.711591 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" podStartSLOduration=1.984811514 podStartE2EDuration="3.711578132s" totalImagesPullingTime="1.726766618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:18.710546414 +0000 UTC m=+66.930057584" watchObservedRunningTime="2026-09-10 03:40:18.711578132 +0000 UTC m=+66.931089305" Sep 10 03:40:19.867531 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:19.866527 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:19.867531 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:19.866637 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:19.874439 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:19.874381 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:20.701386 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:20.701358 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:21.701681 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:21.701562 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r7f5r" event={"ID":"213caff4-1d8b-4359-8ac8-b74d609e0e00","Type":"ContainerStarted","Data":"b57c8624b91ea69752bb0f3df9ecfb062b944ab76d1b4eac09fccf531f8b5d14"} Sep 10 03:40:21.701681 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:21.701632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r7f5r" event={"ID":"213caff4-1d8b-4359-8ac8-b74d609e0e00","Type":"ContainerStarted","Data":"88f6ab3ee13711e913bce0b1697492cbc75f40f0da1e24c003a40d16dd4740ea"} Sep 10 03:40:21.703599 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:21.703569 2580 generic.go:356] "Generic (PLEG): container finished" podID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerID="eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552" exitCode=0 Sep 10 03:40:21.703730 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:21.703659 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerDied","Data":"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552"} Sep 10 03:40:21.705473 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:21.705448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" event={"ID":"883e49d9-190d-496f-aa11-f5e1dddba025","Type":"ContainerStarted","Data":"09d3145249d5f9fd4dd8db4a710a20bde269482181669eef5388083302df5563"} Sep 10 03:40:21.717915 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:21.717873 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r7f5r" podStartSLOduration=67.510398246 podStartE2EDuration="1m9.717855435s" totalImagesPullingTime="2.207457189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:21.717362644 +0000 UTC m=+69.936873818" watchObservedRunningTime="2026-09-10 03:40:21.717855435 +0000 UTC m=+69.937366609" Sep 10 03:40:21.733401 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:21.733355 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" podStartSLOduration=4.265074538 podStartE2EDuration="6.733337494s" totalImagesPullingTime="2.468262956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:21.731413372 +0000 UTC m=+69.950924548" watchObservedRunningTime="2026-09-10 03:40:21.733337494 +0000 UTC m=+69.952848668" Sep 10 03:40:22.709643 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:22.709607 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:22.716425 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:22.716403 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-wztwg" Sep 10 03:40:24.695665 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:24.695638 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68964d946b-9p6xg" Sep 10 03:40:24.720511 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:24.720472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ghxlx" event={"ID":"68bcd05d-92df-4758-a94a-30f988f2f0ed","Type":"ContainerStarted","Data":"a045f5960dbeb45a4600f759525d0c99fab963375e941dc7d0350423a7f8e8f2"} Sep 10 03:40:24.722409 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:24.722372 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-slvnb" event={"ID":"787cb2e6-d36b-412c-a1c0-9103f30d92f7","Type":"ContainerStarted","Data":"eef393501715d29b9707ce2aa8bea5a3724fdad93b27d64b5366fc3f21a9430f"} Sep 10 03:40:24.763584 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:24.763537 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-slvnb" podStartSLOduration=67.411353517 podStartE2EDuration="1m12.76351923s" totalImagesPullingTime="5.352165713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:24.762168089 +0000 UTC m=+72.981679262" watchObservedRunningTime="2026-09-10 03:40:24.76351923 +0000 UTC m=+72.983030404" Sep 10 03:40:24.763909 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:24.763867 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ghxlx" podStartSLOduration=67.425288555 podStartE2EDuration="1m12.763853451s" totalImagesPullingTime="5.338564896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:24.744376667 +0000 UTC m=+72.963887845" watchObservedRunningTime="2026-09-10 03:40:24.763853451 +0000 UTC m=+72.983364625" Sep 10 03:40:25.727593 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:25.727544 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:40:26.189200 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:26.189157 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:26.189382 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:26.189239 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:26.194451 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:26.194427 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:26.734431 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:26.734408 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerStarted","Data":"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136"} Sep 10 03:40:26.738383 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:26.738361 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:40:26.789380 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:26.788843 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5fcdf5d9-t995n"] Sep 10 03:40:27.741712 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:27.741677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerStarted","Data":"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63"} Sep 10 03:40:27.742105 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:27.741745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerStarted","Data":"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11"} Sep 10 03:40:27.742105 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:27.741774 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerStarted","Data":"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad"} Sep 10 03:40:27.742105 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:27.741801 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerStarted","Data":"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794"} Sep 10 03:40:27.742105 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:27.741825 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerStarted","Data":"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d"} Sep 10 03:40:27.778934 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:27.778879 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.385460923 podStartE2EDuration="10.778862931s" totalImagesPullingTime="7.365868107s" totalInitContainerRuntime="27.533901ms" isStatefulPod=false podCreationTimestamp="2026-09-10 03:40:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:40:27.775994881 +0000 UTC m=+75.995506056" watchObservedRunningTime="2026-09-10 03:40:27.778862931 +0000 UTC m=+75.998374161" Sep 10 03:40:32.560440 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:32.560400 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:40:35.766491 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:35.766361 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:35.766491 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:35.766466 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:40.866333 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:40.866266 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-657c68b9bd-65gtw" podUID="bf00790b-8446-4b3e-87a3-2a87bf68e03f" containerName="console" containerID="cri-o://acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503" gracePeriod=15 Sep 10 03:40:41.109439 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.109414 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:41.294973 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.294933 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-serving-cert\") pod \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " Sep 10 03:40:41.294973 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.294983 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-oauth-config\") pod \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " Sep 10 03:40:41.295237 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.295009 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-service-ca\") pod \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " Sep 10 03:40:41.295237 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.295029 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-oauth-serving-cert\") pod \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " Sep 10 03:40:41.295237 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.295081 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-config\") pod \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " Sep 10 03:40:41.295237 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.295097 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8h4v\" (UniqueName: \"kubernetes.io/projected/bf00790b-8446-4b3e-87a3-2a87bf68e03f-kube-api-access-w8h4v\") pod \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\" (UID: \"bf00790b-8446-4b3e-87a3-2a87bf68e03f\") " Sep 10 03:40:41.295560 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.295529 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-service-ca" (OuterVolumeSpecName: "service-ca") pod "bf00790b-8446-4b3e-87a3-2a87bf68e03f" (UID: "bf00790b-8446-4b3e-87a3-2a87bf68e03f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:40:41.295651 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.295552 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bf00790b-8446-4b3e-87a3-2a87bf68e03f" (UID: "bf00790b-8446-4b3e-87a3-2a87bf68e03f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:40:41.295651 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.295560 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-config" (OuterVolumeSpecName: "console-config") pod "bf00790b-8446-4b3e-87a3-2a87bf68e03f" (UID: "bf00790b-8446-4b3e-87a3-2a87bf68e03f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:40:41.297560 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.297528 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf00790b-8446-4b3e-87a3-2a87bf68e03f-kube-api-access-w8h4v" (OuterVolumeSpecName: "kube-api-access-w8h4v") pod "bf00790b-8446-4b3e-87a3-2a87bf68e03f" (UID: "bf00790b-8446-4b3e-87a3-2a87bf68e03f"). InnerVolumeSpecName "kube-api-access-w8h4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:40:41.297560 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.297534 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bf00790b-8446-4b3e-87a3-2a87bf68e03f" (UID: "bf00790b-8446-4b3e-87a3-2a87bf68e03f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:40:41.297694 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.297604 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bf00790b-8446-4b3e-87a3-2a87bf68e03f" (UID: "bf00790b-8446-4b3e-87a3-2a87bf68e03f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:40:41.395930 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.395889 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-oauth-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:41.395930 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.395921 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:41.395930 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.395932 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8h4v\" (UniqueName: \"kubernetes.io/projected/bf00790b-8446-4b3e-87a3-2a87bf68e03f-kube-api-access-w8h4v\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:41.395930 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.395941 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:41.396191 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.395949 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf00790b-8446-4b3e-87a3-2a87bf68e03f-console-oauth-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:41.396191 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.395958 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf00790b-8446-4b3e-87a3-2a87bf68e03f-service-ca\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:41.801449 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.801408 2580 generic.go:356] "Generic (PLEG): container finished" podID="bf00790b-8446-4b3e-87a3-2a87bf68e03f" containerID="acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503" exitCode=0 Sep 10 03:40:41.801666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.801468 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657c68b9bd-65gtw" Sep 10 03:40:41.801666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.801478 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657c68b9bd-65gtw" event={"ID":"bf00790b-8446-4b3e-87a3-2a87bf68e03f","Type":"ContainerDied","Data":"acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503"} Sep 10 03:40:41.801666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.801551 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657c68b9bd-65gtw" event={"ID":"bf00790b-8446-4b3e-87a3-2a87bf68e03f","Type":"ContainerDied","Data":"64ef7053e52e1f3632a9884b20ee3c62ccf81e9a08ede1ad87c5153d76a764fc"} Sep 10 03:40:41.801666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.801592 2580 scope.go:117] "RemoveContainer" containerID="acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503" Sep 10 03:40:41.810469 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.810446 2580 scope.go:117] "RemoveContainer" containerID="acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503" Sep 10 03:40:41.810807 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:41.810784 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503\": container with ID starting with acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503 not found: ID does not exist" containerID="acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503" Sep 10 03:40:41.810880 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.810814 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503"} err="failed to get container status \"acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503\": rpc error: code = NotFound desc = could not find container \"acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503\": container with ID starting with acbd402cf56c7d8cb42cce0361037ee386ba0e38d73ae808e6632a04c75ad503 not found: ID does not exist" Sep 10 03:40:41.822510 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.822469 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657c68b9bd-65gtw"] Sep 10 03:40:41.825823 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:41.825796 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657c68b9bd-65gtw"] Sep 10 03:40:42.371685 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:42.371652 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf00790b-8446-4b3e-87a3-2a87bf68e03f" path="/var/lib/kubelet/pods/bf00790b-8446-4b3e-87a3-2a87bf68e03f/volumes" Sep 10 03:40:51.813560 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:51.813492 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d5fcdf5d9-t995n" podUID="7171ce61-7b01-485c-a369-7a689881bafb" containerName="console" containerID="cri-o://f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141" gracePeriod=15 Sep 10 03:40:52.052173 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.052144 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:52.086422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.086341 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-trusted-ca-bundle\") pod \"7171ce61-7b01-485c-a369-7a689881bafb\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " Sep 10 03:40:52.086422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.086387 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sphc2\" (UniqueName: \"kubernetes.io/projected/7171ce61-7b01-485c-a369-7a689881bafb-kube-api-access-sphc2\") pod \"7171ce61-7b01-485c-a369-7a689881bafb\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " Sep 10 03:40:52.086422 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.086408 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-serving-cert\") pod \"7171ce61-7b01-485c-a369-7a689881bafb\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " Sep 10 03:40:52.086687 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.086433 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-oauth-config\") pod \"7171ce61-7b01-485c-a369-7a689881bafb\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " Sep 10 03:40:52.086687 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.086483 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-console-config\") pod \"7171ce61-7b01-485c-a369-7a689881bafb\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " Sep 10 03:40:52.086687 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.086530 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-service-ca\") pod \"7171ce61-7b01-485c-a369-7a689881bafb\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " Sep 10 03:40:52.086687 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.086572 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-oauth-serving-cert\") pod \"7171ce61-7b01-485c-a369-7a689881bafb\" (UID: \"7171ce61-7b01-485c-a369-7a689881bafb\") " Sep 10 03:40:52.086979 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.086944 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-service-ca" (OuterVolumeSpecName: "service-ca") pod "7171ce61-7b01-485c-a369-7a689881bafb" (UID: "7171ce61-7b01-485c-a369-7a689881bafb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:40:52.087106 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.087012 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-console-config" (OuterVolumeSpecName: "console-config") pod "7171ce61-7b01-485c-a369-7a689881bafb" (UID: "7171ce61-7b01-485c-a369-7a689881bafb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:40:52.087171 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.087100 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7171ce61-7b01-485c-a369-7a689881bafb" (UID: "7171ce61-7b01-485c-a369-7a689881bafb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:40:52.087364 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.087329 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7171ce61-7b01-485c-a369-7a689881bafb" (UID: "7171ce61-7b01-485c-a369-7a689881bafb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:40:52.088787 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.088760 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7171ce61-7b01-485c-a369-7a689881bafb-kube-api-access-sphc2" (OuterVolumeSpecName: "kube-api-access-sphc2") pod "7171ce61-7b01-485c-a369-7a689881bafb" (UID: "7171ce61-7b01-485c-a369-7a689881bafb"). InnerVolumeSpecName "kube-api-access-sphc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:40:52.089144 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.089113 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7171ce61-7b01-485c-a369-7a689881bafb" (UID: "7171ce61-7b01-485c-a369-7a689881bafb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:40:52.089228 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.089173 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7171ce61-7b01-485c-a369-7a689881bafb" (UID: "7171ce61-7b01-485c-a369-7a689881bafb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:40:52.188019 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.187985 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-trusted-ca-bundle\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:52.188019 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.188014 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sphc2\" (UniqueName: \"kubernetes.io/projected/7171ce61-7b01-485c-a369-7a689881bafb-kube-api-access-sphc2\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:52.188019 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.188026 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:52.188252 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.188038 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7171ce61-7b01-485c-a369-7a689881bafb-console-oauth-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:52.188252 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.188051 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-console-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:52.188252 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.188063 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-service-ca\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:52.188252 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.188072 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7171ce61-7b01-485c-a369-7a689881bafb-oauth-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:40:52.846576 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.846542 2580 generic.go:356] "Generic (PLEG): container finished" podID="7171ce61-7b01-485c-a369-7a689881bafb" containerID="f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141" exitCode=0 Sep 10 03:40:52.846576 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.846579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5fcdf5d9-t995n" event={"ID":"7171ce61-7b01-485c-a369-7a689881bafb","Type":"ContainerDied","Data":"f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141"} Sep 10 03:40:52.846990 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.846608 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5fcdf5d9-t995n" Sep 10 03:40:52.846990 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.846622 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5fcdf5d9-t995n" event={"ID":"7171ce61-7b01-485c-a369-7a689881bafb","Type":"ContainerDied","Data":"5a3c4b23e34bfbfe4a264a2621451182b5db852f057de5b98d51b8b96a7de849"} Sep 10 03:40:52.846990 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.846641 2580 scope.go:117] "RemoveContainer" containerID="f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141" Sep 10 03:40:52.856542 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.856525 2580 scope.go:117] "RemoveContainer" containerID="f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141" Sep 10 03:40:52.857138 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:40:52.857115 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141\": container with ID starting with f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141 not found: ID does not exist" containerID="f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141" Sep 10 03:40:52.857243 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.857142 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141"} err="failed to get container status \"f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141\": rpc error: code = NotFound desc = could not find container \"f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141\": container with ID starting with f0e2a0cd8fa33647b9c284c89c7fa3c69ebc791df35636ff6e7f71cb85491141 not found: ID does not exist" Sep 10 03:40:52.868541 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.868517 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5fcdf5d9-t995n"] Sep 10 03:40:52.869695 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:52.869676 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d5fcdf5d9-t995n"] Sep 10 03:40:53.266960 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:53.266932 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vmt6r_a2981f7e-ec7d-49ac-a492-324e19bab605/serve-healthcheck-canary/0.log" Sep 10 03:40:54.371581 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:54.371548 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7171ce61-7b01-485c-a369-7a689881bafb" path="/var/lib/kubelet/pods/7171ce61-7b01-485c-a369-7a689881bafb/volumes" Sep 10 03:40:55.771386 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:55.771360 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:55.775092 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:55.775067 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-649c97f8f9-v6k5b" Sep 10 03:40:56.737344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:40:56.737313 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-slvnb" Sep 10 03:41:17.560677 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:17.560629 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:17.580379 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:17.580351 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:17.960347 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:17.960317 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:35.591430 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.591388 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 03:41:35.592982 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.592707 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" gracePeriod=600 Sep 10 03:41:35.592982 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.592767 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy-web" containerID="cri-o://411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" gracePeriod=600 Sep 10 03:41:35.592982 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.592852 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="prometheus" containerID="cri-o://95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" gracePeriod=600 Sep 10 03:41:35.592982 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.592902 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="thanos-sidecar" containerID="cri-o://8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" gracePeriod=600 Sep 10 03:41:35.592982 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.592919 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="config-reloader" containerID="cri-o://762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" gracePeriod=600 Sep 10 03:41:35.592982 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.592917 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy" containerID="cri-o://81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" gracePeriod=600 Sep 10 03:41:35.840965 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.840940 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:35.966801 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.966766 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-metrics-client-certs\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.966801 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.966800 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config-out\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.966816 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-0\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.966846 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-db\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.966864 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-tls\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.966884 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-kubelet-serving-ca-bundle\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.966914 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-thanos-prometheus-http-client-file\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.966945 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-1\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.966975 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967008 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-grpc-tls\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967054 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fljl7\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-kube-api-access-fljl7\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967099 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-kube-rbac-proxy\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967124 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-serving-certs-ca-bundle\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967153 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-tls-assets\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967181 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-2\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967208 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967240 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-metrics-client-ca\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967274 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-web-config\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967305 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967338 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-trusted-ca-bundle\") pod \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\" (UID: \"14aa2795-c000-42e4-a50e-32c1ba26bb4b\") " Sep 10 03:41:35.967428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967362 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:41:35.967982 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967619 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:35.967982 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967698 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:41:35.968091 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967978 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:41:35.968091 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967987 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:41:35.968091 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.967991 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:41:35.968973 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.968475 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:41:35.969726 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.969699 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:35.970461 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.970434 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:41:35.970574 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.970457 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:35.970731 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.970709 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:35.970869 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.970793 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:35.970978 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.970931 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config-out" (OuterVolumeSpecName: "config-out") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 03:41:35.971038 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.971003 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:41:35.971266 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.971217 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:41:35.971626 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.971604 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:35.971799 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.971771 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config" (OuterVolumeSpecName: "config") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:35.971883 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.971865 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:35.971986 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.971968 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-kube-api-access-fljl7" (OuterVolumeSpecName: "kube-api-access-fljl7") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "kube-api-access-fljl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:41:35.972433 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.972417 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:35.982124 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:35.982107 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-web-config" (OuterVolumeSpecName: "web-config") pod "14aa2795-c000-42e4-a50e-32c1ba26bb4b" (UID: "14aa2795-c000-42e4-a50e-32c1ba26bb4b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:41:36.014459 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014423 2580 generic.go:356] "Generic (PLEG): container finished" podID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerID="79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" exitCode=0 Sep 10 03:41:36.014459 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014454 2580 generic.go:356] "Generic (PLEG): container finished" podID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerID="81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" exitCode=0 Sep 10 03:41:36.014459 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014461 2580 generic.go:356] "Generic (PLEG): container finished" podID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerID="411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" exitCode=0 Sep 10 03:41:36.014674 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014467 2580 generic.go:356] "Generic (PLEG): container finished" podID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerID="8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" exitCode=0 Sep 10 03:41:36.014674 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014473 2580 generic.go:356] "Generic (PLEG): container finished" podID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerID="762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" exitCode=0 Sep 10 03:41:36.014674 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014479 2580 generic.go:356] "Generic (PLEG): container finished" podID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerID="95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" exitCode=0 Sep 10 03:41:36.014674 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014517 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.014674 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014514 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerDied","Data":"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63"} Sep 10 03:41:36.014674 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014651 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerDied","Data":"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11"} Sep 10 03:41:36.014851 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014695 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerDied","Data":"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad"} Sep 10 03:41:36.014851 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014714 2580 scope.go:117] "RemoveContainer" containerID="79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" Sep 10 03:41:36.014851 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014721 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerDied","Data":"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794"} Sep 10 03:41:36.014851 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerDied","Data":"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d"} Sep 10 03:41:36.014851 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014771 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerDied","Data":"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136"} Sep 10 03:41:36.014851 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.014794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"14aa2795-c000-42e4-a50e-32c1ba26bb4b","Type":"ContainerDied","Data":"813946a0cbc60de85bb8874c1ec77913da8e3af883b9dfad78030dd9ca347415"} Sep 10 03:41:36.022738 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.022723 2580 scope.go:117] "RemoveContainer" containerID="81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" Sep 10 03:41:36.029438 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.029423 2580 scope.go:117] "RemoveContainer" containerID="411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" Sep 10 03:41:36.035572 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.035557 2580 scope.go:117] "RemoveContainer" containerID="8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" Sep 10 03:41:36.040221 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.040195 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 03:41:36.042196 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.042179 2580 scope.go:117] "RemoveContainer" containerID="762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" Sep 10 03:41:36.046313 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.046294 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 03:41:36.049376 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.049361 2580 scope.go:117] "RemoveContainer" containerID="95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" Sep 10 03:41:36.056353 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.056337 2580 scope.go:117] "RemoveContainer" containerID="eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552" Sep 10 03:41:36.062625 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.062609 2580 scope.go:117] "RemoveContainer" containerID="79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" Sep 10 03:41:36.062896 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:41:36.062877 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": container with ID starting with 79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63 not found: ID does not exist" containerID="79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" Sep 10 03:41:36.062962 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.062910 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63"} err="failed to get container status \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": rpc error: code = NotFound desc = could not find container \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": container with ID starting with 79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63 not found: ID does not exist" Sep 10 03:41:36.062962 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.062936 2580 scope.go:117] "RemoveContainer" containerID="81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" Sep 10 03:41:36.063218 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:41:36.063199 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": container with ID starting with 81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11 not found: ID does not exist" containerID="81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" Sep 10 03:41:36.063255 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.063224 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11"} err="failed to get container status \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": rpc error: code = NotFound desc = could not find container \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": container with ID starting with 81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11 not found: ID does not exist" Sep 10 03:41:36.063255 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.063240 2580 scope.go:117] "RemoveContainer" containerID="411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" Sep 10 03:41:36.063457 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:41:36.063440 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": container with ID starting with 411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad not found: ID does not exist" containerID="411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" Sep 10 03:41:36.063559 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.063464 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad"} err="failed to get container status \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": rpc error: code = NotFound desc = could not find container \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": container with ID starting with 411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad not found: ID does not exist" Sep 10 03:41:36.063559 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.063483 2580 scope.go:117] "RemoveContainer" containerID="8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" Sep 10 03:41:36.063766 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:41:36.063744 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": container with ID starting with 8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794 not found: ID does not exist" containerID="8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" Sep 10 03:41:36.063853 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.063770 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794"} err="failed to get container status \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": rpc error: code = NotFound desc = could not find container \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": container with ID starting with 8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794 not found: ID does not exist" Sep 10 03:41:36.063853 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.063789 2580 scope.go:117] "RemoveContainer" containerID="762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" Sep 10 03:41:36.064054 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:41:36.064036 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": container with ID starting with 762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d not found: ID does not exist" containerID="762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" Sep 10 03:41:36.064162 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.064066 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d"} err="failed to get container status \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": rpc error: code = NotFound desc = could not find container \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": container with ID starting with 762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d not found: ID does not exist" Sep 10 03:41:36.064162 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.064082 2580 scope.go:117] "RemoveContainer" containerID="95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" Sep 10 03:41:36.064339 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:41:36.064320 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": container with ID starting with 95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136 not found: ID does not exist" containerID="95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" Sep 10 03:41:36.064438 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.064342 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136"} err="failed to get container status \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": rpc error: code = NotFound desc = could not find container \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": container with ID starting with 95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136 not found: ID does not exist" Sep 10 03:41:36.064438 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.064357 2580 scope.go:117] "RemoveContainer" containerID="eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552" Sep 10 03:41:36.064643 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:41:36.064633 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": container with ID starting with eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552 not found: ID does not exist" containerID="eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552" Sep 10 03:41:36.064689 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.064656 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552"} err="failed to get container status \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": rpc error: code = NotFound desc = could not find container \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": container with ID starting with eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552 not found: ID does not exist" Sep 10 03:41:36.064689 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.064669 2580 scope.go:117] "RemoveContainer" containerID="79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" Sep 10 03:41:36.064933 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.064913 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63"} err="failed to get container status \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": rpc error: code = NotFound desc = could not find container \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": container with ID starting with 79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63 not found: ID does not exist" Sep 10 03:41:36.065007 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.064933 2580 scope.go:117] "RemoveContainer" containerID="81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" Sep 10 03:41:36.069653 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069617 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11"} err="failed to get container status \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": rpc error: code = NotFound desc = could not find container \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": container with ID starting with 81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11 not found: ID does not exist" Sep 10 03:41:36.069653 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069652 2580 scope.go:117] "RemoveContainer" containerID="411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" Sep 10 03:41:36.069921 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069898 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-grpc-tls\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.069980 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069932 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fljl7\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-kube-api-access-fljl7\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.069980 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069946 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-kube-rbac-proxy\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.069980 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069960 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.069980 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069973 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/14aa2795-c000-42e4-a50e-32c1ba26bb4b-tls-assets\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069984 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069895 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad"} err="failed to get container status \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": rpc error: code = NotFound desc = could not find container \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": container with ID starting with 411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad not found: ID does not exist" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.069996 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070000 2580 scope.go:117] "RemoveContainer" containerID="8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070008 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-metrics-client-ca\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070021 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-web-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070033 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070045 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070058 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-metrics-client-certs\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070069 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-config-out\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070080 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070091 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/14aa2795-c000-42e4-a50e-32c1ba26bb4b-prometheus-k8s-db\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070103 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070115 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14aa2795-c000-42e4-a50e-32c1ba26bb4b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070128 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070140 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/14aa2795-c000-42e4-a50e-32c1ba26bb4b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:41:36.070685 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070242 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794"} err="failed to get container status \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": rpc error: code = NotFound desc = could not find container \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": container with ID starting with 8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794 not found: ID does not exist" Sep 10 03:41:36.070685 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070264 2580 scope.go:117] "RemoveContainer" containerID="762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" Sep 10 03:41:36.070685 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070523 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d"} err="failed to get container status \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": rpc error: code = NotFound desc = could not find container \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": container with ID starting with 762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d not found: ID does not exist" Sep 10 03:41:36.070685 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070542 2580 scope.go:117] "RemoveContainer" containerID="95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" Sep 10 03:41:36.070826 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070772 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136"} err="failed to get container status \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": rpc error: code = NotFound desc = could not find container \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": container with ID starting with 95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136 not found: ID does not exist" Sep 10 03:41:36.070826 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070789 2580 scope.go:117] "RemoveContainer" containerID="eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552" Sep 10 03:41:36.070990 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070975 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552"} err="failed to get container status \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": rpc error: code = NotFound desc = could not find container \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": container with ID starting with eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552 not found: ID does not exist" Sep 10 03:41:36.071031 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.070990 2580 scope.go:117] "RemoveContainer" containerID="79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" Sep 10 03:41:36.071287 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.071264 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63"} err="failed to get container status \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": rpc error: code = NotFound desc = could not find container \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": container with ID starting with 79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63 not found: ID does not exist" Sep 10 03:41:36.071334 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.071291 2580 scope.go:117] "RemoveContainer" containerID="81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" Sep 10 03:41:36.071659 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.071634 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11"} err="failed to get container status \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": rpc error: code = NotFound desc = could not find container \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": container with ID starting with 81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11 not found: ID does not exist" Sep 10 03:41:36.071742 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.071660 2580 scope.go:117] "RemoveContainer" containerID="411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" Sep 10 03:41:36.071958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.071936 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad"} err="failed to get container status \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": rpc error: code = NotFound desc = could not find container \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": container with ID starting with 411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad not found: ID does not exist" Sep 10 03:41:36.071958 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.071956 2580 scope.go:117] "RemoveContainer" containerID="8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" Sep 10 03:41:36.072188 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.072173 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794"} err="failed to get container status \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": rpc error: code = NotFound desc = could not find container \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": container with ID starting with 8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794 not found: ID does not exist" Sep 10 03:41:36.072245 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.072188 2580 scope.go:117] "RemoveContainer" containerID="762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" Sep 10 03:41:36.072623 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.072582 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d"} err="failed to get container status \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": rpc error: code = NotFound desc = could not find container \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": container with ID starting with 762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d not found: ID does not exist" Sep 10 03:41:36.072748 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.072626 2580 scope.go:117] "RemoveContainer" containerID="95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" Sep 10 03:41:36.073029 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.073002 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136"} err="failed to get container status \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": rpc error: code = NotFound desc = could not find container \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": container with ID starting with 95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136 not found: ID does not exist" Sep 10 03:41:36.073115 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.073030 2580 scope.go:117] "RemoveContainer" containerID="eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552" Sep 10 03:41:36.073350 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.073329 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552"} err="failed to get container status \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": rpc error: code = NotFound desc = could not find container \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": container with ID starting with eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552 not found: ID does not exist" Sep 10 03:41:36.073473 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.073455 2580 scope.go:117] "RemoveContainer" containerID="79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" Sep 10 03:41:36.073794 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.073771 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63"} err="failed to get container status \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": rpc error: code = NotFound desc = could not find container \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": container with ID starting with 79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63 not found: ID does not exist" Sep 10 03:41:36.073858 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.073797 2580 scope.go:117] "RemoveContainer" containerID="81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" Sep 10 03:41:36.074101 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074084 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11"} err="failed to get container status \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": rpc error: code = NotFound desc = could not find container \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": container with ID starting with 81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11 not found: ID does not exist" Sep 10 03:41:36.074155 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074103 2580 scope.go:117] "RemoveContainer" containerID="411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" Sep 10 03:41:36.074366 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074345 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad"} err="failed to get container status \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": rpc error: code = NotFound desc = could not find container \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": container with ID starting with 411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad not found: ID does not exist" Sep 10 03:41:36.074467 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074366 2580 scope.go:117] "RemoveContainer" containerID="8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" Sep 10 03:41:36.074467 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074374 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 03:41:36.074637 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074617 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794"} err="failed to get container status \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": rpc error: code = NotFound desc = could not find container \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": container with ID starting with 8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794 not found: ID does not exist" Sep 10 03:41:36.074705 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074638 2580 scope.go:117] "RemoveContainer" containerID="762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" Sep 10 03:41:36.074746 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074707 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="config-reloader" Sep 10 03:41:36.074746 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074719 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="config-reloader" Sep 10 03:41:36.074746 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074735 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy-web" Sep 10 03:41:36.074746 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074744 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy-web" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074754 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074763 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074779 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy-thanos" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074786 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy-thanos" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074797 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf00790b-8446-4b3e-87a3-2a87bf68e03f" containerName="console" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074803 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf00790b-8446-4b3e-87a3-2a87bf68e03f" containerName="console" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074811 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="init-config-reloader" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074818 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="init-config-reloader" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074825 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="prometheus" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074831 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="prometheus" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074842 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="thanos-sidecar" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074849 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="thanos-sidecar" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074851 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d"} err="failed to get container status \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": rpc error: code = NotFound desc = could not find container \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": container with ID starting with 762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d not found: ID does not exist" Sep 10 03:41:36.074889 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074869 2580 scope.go:117] "RemoveContainer" containerID="95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074859 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7171ce61-7b01-485c-a369-7a689881bafb" containerName="console" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074911 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7171ce61-7b01-485c-a369-7a689881bafb" containerName="console" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074982 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="config-reloader" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.074993 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075002 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy-web" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075013 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="thanos-sidecar" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075024 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7171ce61-7b01-485c-a369-7a689881bafb" containerName="console" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075035 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="prometheus" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075045 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" containerName="kube-rbac-proxy-thanos" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075053 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf00790b-8446-4b3e-87a3-2a87bf68e03f" containerName="console" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075142 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136"} err="failed to get container status \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": rpc error: code = NotFound desc = could not find container \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": container with ID starting with 95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136 not found: ID does not exist" Sep 10 03:41:36.075344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075171 2580 scope.go:117] "RemoveContainer" containerID="eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552" Sep 10 03:41:36.075770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075405 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552"} err="failed to get container status \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": rpc error: code = NotFound desc = could not find container \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": container with ID starting with eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552 not found: ID does not exist" Sep 10 03:41:36.075770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075425 2580 scope.go:117] "RemoveContainer" containerID="79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" Sep 10 03:41:36.075770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075680 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63"} err="failed to get container status \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": rpc error: code = NotFound desc = could not find container \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": container with ID starting with 79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63 not found: ID does not exist" Sep 10 03:41:36.075770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075697 2580 scope.go:117] "RemoveContainer" containerID="81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" Sep 10 03:41:36.075928 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075899 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11"} err="failed to get container status \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": rpc error: code = NotFound desc = could not find container \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": container with ID starting with 81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11 not found: ID does not exist" Sep 10 03:41:36.075928 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.075918 2580 scope.go:117] "RemoveContainer" containerID="411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" Sep 10 03:41:36.076136 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.076119 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad"} err="failed to get container status \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": rpc error: code = NotFound desc = could not find container \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": container with ID starting with 411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad not found: ID does not exist" Sep 10 03:41:36.076187 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.076135 2580 scope.go:117] "RemoveContainer" containerID="8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" Sep 10 03:41:36.076374 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.076355 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794"} err="failed to get container status \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": rpc error: code = NotFound desc = could not find container \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": container with ID starting with 8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794 not found: ID does not exist" Sep 10 03:41:36.076435 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.076375 2580 scope.go:117] "RemoveContainer" containerID="762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" Sep 10 03:41:36.076687 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.076655 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d"} err="failed to get container status \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": rpc error: code = NotFound desc = could not find container \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": container with ID starting with 762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d not found: ID does not exist" Sep 10 03:41:36.076687 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.076680 2580 scope.go:117] "RemoveContainer" containerID="95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" Sep 10 03:41:36.076996 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.076968 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136"} err="failed to get container status \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": rpc error: code = NotFound desc = could not find container \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": container with ID starting with 95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136 not found: ID does not exist" Sep 10 03:41:36.077073 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.076997 2580 scope.go:117] "RemoveContainer" containerID="eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552" Sep 10 03:41:36.077302 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.077280 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552"} err="failed to get container status \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": rpc error: code = NotFound desc = could not find container \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": container with ID starting with eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552 not found: ID does not exist" Sep 10 03:41:36.077362 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.077304 2580 scope.go:117] "RemoveContainer" containerID="79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63" Sep 10 03:41:36.077613 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.077592 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63"} err="failed to get container status \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": rpc error: code = NotFound desc = could not find container \"79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63\": container with ID starting with 79e7f70ad277360057cec4499598497f30080393b6137a322731c08f03f21c63 not found: ID does not exist" Sep 10 03:41:36.077613 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.077611 2580 scope.go:117] "RemoveContainer" containerID="81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11" Sep 10 03:41:36.077931 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.077903 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11"} err="failed to get container status \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": rpc error: code = NotFound desc = could not find container \"81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11\": container with ID starting with 81b970ad836cbf06814e69b0626974d19c929f413b80519249f11e564b9eaf11 not found: ID does not exist" Sep 10 03:41:36.077931 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.077931 2580 scope.go:117] "RemoveContainer" containerID="411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad" Sep 10 03:41:36.078200 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.078179 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad"} err="failed to get container status \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": rpc error: code = NotFound desc = could not find container \"411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad\": container with ID starting with 411594e89bd2db5a4fd346c1509e4b320c8b230810e9cca048ccd6ac4ed0c1ad not found: ID does not exist" Sep 10 03:41:36.078200 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.078198 2580 scope.go:117] "RemoveContainer" containerID="8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794" Sep 10 03:41:36.078457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.078438 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794"} err="failed to get container status \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": rpc error: code = NotFound desc = could not find container \"8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794\": container with ID starting with 8a6c500c211e5e5eab684fed8fc21cdebeeff4b30da4a153dd858d7d6ae6b794 not found: ID does not exist" Sep 10 03:41:36.078523 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.078457 2580 scope.go:117] "RemoveContainer" containerID="762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d" Sep 10 03:41:36.078746 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.078731 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d"} err="failed to get container status \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": rpc error: code = NotFound desc = could not find container \"762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d\": container with ID starting with 762cd7882e30cd34f397aaa4fbee13bd3a4c60e1389fc3a3550eb055d642733d not found: ID does not exist" Sep 10 03:41:36.078795 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.078747 2580 scope.go:117] "RemoveContainer" containerID="95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136" Sep 10 03:41:36.078936 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.078919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.079003 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.078974 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136"} err="failed to get container status \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": rpc error: code = NotFound desc = could not find container \"95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136\": container with ID starting with 95ec6dcc1a1c7591d679fa2d824001706e0fed28cdf97fa6a6b7afd121d58136 not found: ID does not exist" Sep 10 03:41:36.079003 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.078991 2580 scope.go:117] "RemoveContainer" containerID="eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552" Sep 10 03:41:36.079306 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.079276 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552"} err="failed to get container status \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": rpc error: code = NotFound desc = could not find container \"eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552\": container with ID starting with eee0e7e828af91295917b1366043f679cf5ea2915de906a8f2bb24f28eb4f552 not found: ID does not exist" Sep 10 03:41:36.081624 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.081608 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 03:41:36.081691 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.081611 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 03:41:36.081930 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.081903 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 03:41:36.082057 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082038 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 03:41:36.082174 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082159 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 03:41:36.082242 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082176 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 03:41:36.082242 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082181 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qc7wn\"" Sep 10 03:41:36.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082437 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 03:41:36.082457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082453 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 03:41:36.082628 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082470 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 03:41:36.082628 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082545 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 03:41:36.082741 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082667 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 03:41:36.082817 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082802 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4h60phpl56eh0\"" Sep 10 03:41:36.082892 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.082874 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 03:41:36.087826 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.087810 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 03:41:36.088212 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.088197 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 03:41:36.099212 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.099188 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 03:41:36.271624 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271624 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271624 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271624 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271850 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271850 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271850 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271746 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271850 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271775 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-config\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271850 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/347df3e6-52d4-4747-82e4-981b383d8a13-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271850 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.271850 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.272058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.272058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.272058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.272058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm6bd\" (UniqueName: \"kubernetes.io/projected/347df3e6-52d4-4747-82e4-981b383d8a13-kube-api-access-qm6bd\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.272058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.271977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.272058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.272044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.272229 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.272059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.272229 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.272079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/347df3e6-52d4-4747-82e4-981b383d8a13-config-out\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.272229 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.272108 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-web-config\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.370868 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.370835 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14aa2795-c000-42e4-a50e-32c1ba26bb4b" path="/var/lib/kubelet/pods/14aa2795-c000-42e4-a50e-32c1ba26bb4b/volumes" Sep 10 03:41:36.373202 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373264 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373264 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/347df3e6-52d4-4747-82e4-981b383d8a13-config-out\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373339 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-web-config\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373339 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373339 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373469 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373527 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373570 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373543 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373618 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373668 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373725 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-config\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373725 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/347df3e6-52d4-4747-82e4-981b383d8a13-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373831 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373831 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373757 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373831 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373831 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.373831 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.374077 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm6bd\" (UniqueName: \"kubernetes.io/projected/347df3e6-52d4-4747-82e4-981b383d8a13-kube-api-access-qm6bd\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.374077 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.373886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.374181 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.374117 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.376151 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.374732 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.376151 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.375302 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.376337 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.376181 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/347df3e6-52d4-4747-82e4-981b383d8a13-config-out\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.376428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.376407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.376490 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.376438 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.376627 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.376487 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-web-config\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.376627 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.376495 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.376840 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.376822 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/347df3e6-52d4-4747-82e4-981b383d8a13-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.376944 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.376925 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.377006 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.376970 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.377603 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.377276 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.377603 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.377360 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.377603 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.377554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.378517 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.378477 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/347df3e6-52d4-4747-82e4-981b383d8a13-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.378611 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.378592 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.379225 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.379201 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-config\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.379225 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.379219 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.379337 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.379287 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/347df3e6-52d4-4747-82e4-981b383d8a13-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.386347 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.386326 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm6bd\" (UniqueName: \"kubernetes.io/projected/347df3e6-52d4-4747-82e4-981b383d8a13-kube-api-access-qm6bd\") pod \"prometheus-k8s-0\" (UID: \"347df3e6-52d4-4747-82e4-981b383d8a13\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.388257 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.388243 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:36.667392 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:36.667209 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 03:41:36.669763 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:41:36.669736 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347df3e6_52d4_4747_82e4_981b383d8a13.slice/crio-34da4961b20288f5d13d3eb7136a193930cb1bca1cf833eb0528ae57321b64f7 WatchSource:0}: Error finding container 34da4961b20288f5d13d3eb7136a193930cb1bca1cf833eb0528ae57321b64f7: Status 404 returned error can't find the container with id 34da4961b20288f5d13d3eb7136a193930cb1bca1cf833eb0528ae57321b64f7 Sep 10 03:41:37.020868 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:37.020828 2580 generic.go:356] "Generic (PLEG): container finished" podID="347df3e6-52d4-4747-82e4-981b383d8a13" containerID="47f9e05e35d7b1a1a00e924ecde50fc843e9190dde6e1ec042d8b5adf7ab577e" exitCode=0 Sep 10 03:41:37.021032 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:37.020914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"347df3e6-52d4-4747-82e4-981b383d8a13","Type":"ContainerDied","Data":"47f9e05e35d7b1a1a00e924ecde50fc843e9190dde6e1ec042d8b5adf7ab577e"} Sep 10 03:41:37.021032 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:37.020994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"347df3e6-52d4-4747-82e4-981b383d8a13","Type":"ContainerStarted","Data":"34da4961b20288f5d13d3eb7136a193930cb1bca1cf833eb0528ae57321b64f7"} Sep 10 03:41:38.029709 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.029672 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"347df3e6-52d4-4747-82e4-981b383d8a13","Type":"ContainerStarted","Data":"80816f6f0aee7c0aae1950ee7ce019f00fc4a2ddfe6dc93aa70bdef767a20890"} Sep 10 03:41:38.030054 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.029755 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"347df3e6-52d4-4747-82e4-981b383d8a13","Type":"ContainerStarted","Data":"8e161a95bc49ae627913d3daef43bd7329ef0c4fdaa4d6d34535811bd34ac8c3"} Sep 10 03:41:38.030054 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.029797 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"347df3e6-52d4-4747-82e4-981b383d8a13","Type":"ContainerStarted","Data":"fbdea8eb4b549d6ea5f604882ce5835d39757a75343ea14908a4953ca6fc78e1"} Sep 10 03:41:38.030054 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.029837 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"347df3e6-52d4-4747-82e4-981b383d8a13","Type":"ContainerStarted","Data":"082f0f371431e3239081284dd94520f06579414dd43de5411455cd74e1b5f7d9"} Sep 10 03:41:38.030054 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.029877 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"347df3e6-52d4-4747-82e4-981b383d8a13","Type":"ContainerStarted","Data":"127d3ec2424ecb1f26afbb54550d659f2228c8b9047c5616c2861774cd7a2ccc"} Sep 10 03:41:38.030054 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.029913 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"347df3e6-52d4-4747-82e4-981b383d8a13","Type":"ContainerStarted","Data":"423fd9f62bf1db80a5aa9d06dc0c3358b199fdc4edd4a9a511ce1795a265a75f"} Sep 10 03:41:38.066530 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.066460 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.04731185 podStartE2EDuration="2.066442815s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.130965ms" isStatefulPod=false podCreationTimestamp="2026-09-10 03:41:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:41:38.06353721 +0000 UTC m=+146.283048383" watchObservedRunningTime="2026-09-10 03:41:38.066442815 +0000 UTC m=+146.285954024" Sep 10 03:41:38.541161 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.541129 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dcbfdd844-wqh2t"] Sep 10 03:41:38.543763 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.543745 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.559998 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.559972 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dcbfdd844-wqh2t"] Sep 10 03:41:38.594284 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.594251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-service-ca\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.594425 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.594305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpfhv\" (UniqueName: \"kubernetes.io/projected/762467b3-8a1a-43b7-a0c2-c76897523d10-kube-api-access-zpfhv\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.594425 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.594387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-trusted-ca-bundle\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.594425 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.594413 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-oauth-serving-cert\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.594609 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.594432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-oauth-config\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.594609 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.594461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-serving-cert\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.594609 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.594560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-console-config\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.695312 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.695280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpfhv\" (UniqueName: \"kubernetes.io/projected/762467b3-8a1a-43b7-a0c2-c76897523d10-kube-api-access-zpfhv\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.695445 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.695326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-trusted-ca-bundle\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.695445 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.695342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-oauth-serving-cert\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.695445 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.695365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-oauth-config\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.695445 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.695402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-serving-cert\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.695662 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.695456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-console-config\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.695662 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.695492 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-service-ca\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.696184 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.696154 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-oauth-serving-cert\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.696310 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.696184 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-service-ca\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.696310 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.696201 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-console-config\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.696310 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.696243 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-trusted-ca-bundle\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.697834 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.697807 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-serving-cert\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.697940 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.697830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-oauth-config\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.703737 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.703714 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpfhv\" (UniqueName: \"kubernetes.io/projected/762467b3-8a1a-43b7-a0c2-c76897523d10-kube-api-access-zpfhv\") pod \"console-6dcbfdd844-wqh2t\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:38.852350 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:38.852280 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:39.121005 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:39.120927 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dcbfdd844-wqh2t"] Sep 10 03:41:39.124837 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:41:39.124812 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762467b3_8a1a_43b7_a0c2_c76897523d10.slice/crio-5fe8103834db870d4873b36e8aee4892bde61cdd00fe67c0e43d94dcbdc0e953 WatchSource:0}: Error finding container 5fe8103834db870d4873b36e8aee4892bde61cdd00fe67c0e43d94dcbdc0e953: Status 404 returned error can't find the container with id 5fe8103834db870d4873b36e8aee4892bde61cdd00fe67c0e43d94dcbdc0e953 Sep 10 03:41:40.040650 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:40.040612 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcbfdd844-wqh2t" event={"ID":"762467b3-8a1a-43b7-a0c2-c76897523d10","Type":"ContainerStarted","Data":"df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b"} Sep 10 03:41:40.040830 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:40.040700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcbfdd844-wqh2t" event={"ID":"762467b3-8a1a-43b7-a0c2-c76897523d10","Type":"ContainerStarted","Data":"5fe8103834db870d4873b36e8aee4892bde61cdd00fe67c0e43d94dcbdc0e953"} Sep 10 03:41:40.069487 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:40.069434 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dcbfdd844-wqh2t" podStartSLOduration=2.069417837 podStartE2EDuration="2.069417837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:41:40.067746127 +0000 UTC m=+148.287257304" watchObservedRunningTime="2026-09-10 03:41:40.069417837 +0000 UTC m=+148.288929010" Sep 10 03:41:41.388764 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:41.388721 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:41:48.852971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:48.852936 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:48.853466 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:48.853001 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:48.857598 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:48.857580 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:49.082577 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:49.082548 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:41:49.126298 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:41:49.126221 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5fb495b4-pxthb"] Sep 10 03:42:14.147554 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.147493 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f5fb495b4-pxthb" podUID="585faa66-ef27-4fa8-8d23-ee49240ff450" containerName="console" containerID="cri-o://e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41" gracePeriod=15 Sep 10 03:42:14.388556 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.388529 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:42:14.500627 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.500599 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrght\" (UniqueName: \"kubernetes.io/projected/585faa66-ef27-4fa8-8d23-ee49240ff450-kube-api-access-lrght\") pod \"585faa66-ef27-4fa8-8d23-ee49240ff450\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " Sep 10 03:42:14.500627 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.500636 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-oauth-config\") pod \"585faa66-ef27-4fa8-8d23-ee49240ff450\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " Sep 10 03:42:14.500881 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.500666 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-trusted-ca-bundle\") pod \"585faa66-ef27-4fa8-8d23-ee49240ff450\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " Sep 10 03:42:14.500881 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.500692 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-serving-cert\") pod \"585faa66-ef27-4fa8-8d23-ee49240ff450\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " Sep 10 03:42:14.500881 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.500757 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-console-config\") pod \"585faa66-ef27-4fa8-8d23-ee49240ff450\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " Sep 10 03:42:14.500881 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.500799 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-oauth-serving-cert\") pod \"585faa66-ef27-4fa8-8d23-ee49240ff450\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " Sep 10 03:42:14.500881 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.500824 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-service-ca\") pod \"585faa66-ef27-4fa8-8d23-ee49240ff450\" (UID: \"585faa66-ef27-4fa8-8d23-ee49240ff450\") " Sep 10 03:42:14.501174 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.501146 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "585faa66-ef27-4fa8-8d23-ee49240ff450" (UID: "585faa66-ef27-4fa8-8d23-ee49240ff450"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:42:14.501292 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.501181 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-console-config" (OuterVolumeSpecName: "console-config") pod "585faa66-ef27-4fa8-8d23-ee49240ff450" (UID: "585faa66-ef27-4fa8-8d23-ee49240ff450"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:42:14.501355 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.501297 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "585faa66-ef27-4fa8-8d23-ee49240ff450" (UID: "585faa66-ef27-4fa8-8d23-ee49240ff450"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:42:14.501410 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.501345 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-service-ca" (OuterVolumeSpecName: "service-ca") pod "585faa66-ef27-4fa8-8d23-ee49240ff450" (UID: "585faa66-ef27-4fa8-8d23-ee49240ff450"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:42:14.502947 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.502925 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "585faa66-ef27-4fa8-8d23-ee49240ff450" (UID: "585faa66-ef27-4fa8-8d23-ee49240ff450"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:42:14.503055 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.502941 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585faa66-ef27-4fa8-8d23-ee49240ff450-kube-api-access-lrght" (OuterVolumeSpecName: "kube-api-access-lrght") pod "585faa66-ef27-4fa8-8d23-ee49240ff450" (UID: "585faa66-ef27-4fa8-8d23-ee49240ff450"). InnerVolumeSpecName "kube-api-access-lrght". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:42:14.503180 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.503161 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "585faa66-ef27-4fa8-8d23-ee49240ff450" (UID: "585faa66-ef27-4fa8-8d23-ee49240ff450"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:42:14.601463 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.601430 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-console-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:42:14.601463 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.601456 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-oauth-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:42:14.601463 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.601467 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-service-ca\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:42:14.601463 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.601475 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrght\" (UniqueName: \"kubernetes.io/projected/585faa66-ef27-4fa8-8d23-ee49240ff450-kube-api-access-lrght\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:42:14.601730 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.601483 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-oauth-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:42:14.601730 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.601494 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/585faa66-ef27-4fa8-8d23-ee49240ff450-trusted-ca-bundle\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:42:14.601730 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:14.601520 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/585faa66-ef27-4fa8-8d23-ee49240ff450-console-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:42:15.178566 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:15.178532 2580 generic.go:356] "Generic (PLEG): container finished" podID="585faa66-ef27-4fa8-8d23-ee49240ff450" containerID="e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41" exitCode=0 Sep 10 03:42:15.179047 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:15.178573 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5fb495b4-pxthb" event={"ID":"585faa66-ef27-4fa8-8d23-ee49240ff450","Type":"ContainerDied","Data":"e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41"} Sep 10 03:42:15.179047 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:15.178579 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5fb495b4-pxthb" Sep 10 03:42:15.179047 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:15.178619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5fb495b4-pxthb" event={"ID":"585faa66-ef27-4fa8-8d23-ee49240ff450","Type":"ContainerDied","Data":"4c4c8341242f01c4f43ef92c75d8c4eece2ab58c41e77bced751afa92f2e5ff0"} Sep 10 03:42:15.179047 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:15.178641 2580 scope.go:117] "RemoveContainer" containerID="e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41" Sep 10 03:42:15.186960 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:15.186937 2580 scope.go:117] "RemoveContainer" containerID="e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41" Sep 10 03:42:15.187248 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:42:15.187229 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41\": container with ID starting with e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41 not found: ID does not exist" containerID="e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41" Sep 10 03:42:15.187305 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:15.187257 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41"} err="failed to get container status \"e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41\": rpc error: code = NotFound desc = could not find container \"e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41\": container with ID starting with e303791b5f2d469d8550c97813d125efcab9801894b0e1ee1c38759e8f860d41 not found: ID does not exist" Sep 10 03:42:15.198770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:15.198751 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5fb495b4-pxthb"] Sep 10 03:42:15.202251 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:15.202232 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f5fb495b4-pxthb"] Sep 10 03:42:16.371566 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:16.371536 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="585faa66-ef27-4fa8-8d23-ee49240ff450" path="/var/lib/kubelet/pods/585faa66-ef27-4fa8-8d23-ee49240ff450/volumes" Sep 10 03:42:36.389264 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:36.389239 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:42:36.404179 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:36.404157 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:42:37.280058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:37.280030 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 03:42:59.046193 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.046158 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc99f5dbc-n629z"] Sep 10 03:42:59.046760 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.046652 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="585faa66-ef27-4fa8-8d23-ee49240ff450" containerName="console" Sep 10 03:42:59.046760 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.046672 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="585faa66-ef27-4fa8-8d23-ee49240ff450" containerName="console" Sep 10 03:42:59.046874 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.046770 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="585faa66-ef27-4fa8-8d23-ee49240ff450" containerName="console" Sep 10 03:42:59.051155 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.051133 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.061518 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.061479 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc99f5dbc-n629z"] Sep 10 03:42:59.162387 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.162348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-trusted-ca-bundle\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.162387 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.162389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffzzd\" (UniqueName: \"kubernetes.io/projected/146752ee-becc-40b3-a3dc-3a9638c1cf9a-kube-api-access-ffzzd\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.162634 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.162414 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-oauth-config\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.162634 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.162521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-serving-cert\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.162634 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.162574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-service-ca\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.162634 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.162615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-oauth-serving-cert\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.162776 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.162636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-config\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.263403 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.263363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-serving-cert\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.263403 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.263411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-service-ca\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.263673 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.263433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-oauth-serving-cert\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.263673 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.263455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-config\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.263673 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.263541 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-trusted-ca-bundle\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.263673 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.263574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffzzd\" (UniqueName: \"kubernetes.io/projected/146752ee-becc-40b3-a3dc-3a9638c1cf9a-kube-api-access-ffzzd\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.263673 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.263599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-oauth-config\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.264312 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.264285 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-service-ca\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.264312 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.264307 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-oauth-serving-cert\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.264492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.264333 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-config\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.264492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.264446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-trusted-ca-bundle\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.266028 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.266006 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-oauth-config\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.266113 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.266033 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-serving-cert\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.272339 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.272317 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffzzd\" (UniqueName: \"kubernetes.io/projected/146752ee-becc-40b3-a3dc-3a9638c1cf9a-kube-api-access-ffzzd\") pod \"console-6cc99f5dbc-n629z\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.359997 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.359911 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:42:59.628991 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:42:59.628916 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc99f5dbc-n629z"] Sep 10 03:42:59.633459 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:42:59.633427 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146752ee_becc_40b3_a3dc_3a9638c1cf9a.slice/crio-6c2d9df27efa7797e57376ecacacc38d0862ddd89c090005e030ff9270858f8e WatchSource:0}: Error finding container 6c2d9df27efa7797e57376ecacacc38d0862ddd89c090005e030ff9270858f8e: Status 404 returned error can't find the container with id 6c2d9df27efa7797e57376ecacacc38d0862ddd89c090005e030ff9270858f8e Sep 10 03:43:00.352185 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:00.352147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc99f5dbc-n629z" event={"ID":"146752ee-becc-40b3-a3dc-3a9638c1cf9a","Type":"ContainerStarted","Data":"e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23"} Sep 10 03:43:00.352574 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:00.352203 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc99f5dbc-n629z" event={"ID":"146752ee-becc-40b3-a3dc-3a9638c1cf9a","Type":"ContainerStarted","Data":"6c2d9df27efa7797e57376ecacacc38d0862ddd89c090005e030ff9270858f8e"} Sep 10 03:43:00.371133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:00.371083 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cc99f5dbc-n629z" podStartSLOduration=1.371068759 podStartE2EDuration="1.371068759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:43:00.370162659 +0000 UTC m=+228.589673824" watchObservedRunningTime="2026-09-10 03:43:00.371068759 +0000 UTC m=+228.590579932" Sep 10 03:43:09.360615 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:09.360578 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:43:09.361178 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:09.360672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:43:09.365140 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:09.365120 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:43:09.388283 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:09.388259 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:43:09.432674 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:09.432641 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dcbfdd844-wqh2t"] Sep 10 03:43:34.452431 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.452388 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dcbfdd844-wqh2t" podUID="762467b3-8a1a-43b7-a0c2-c76897523d10" containerName="console" containerID="cri-o://df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b" gracePeriod=15 Sep 10 03:43:34.695047 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.695021 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:43:34.769157 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769022 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-trusted-ca-bundle\") pod \"762467b3-8a1a-43b7-a0c2-c76897523d10\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " Sep 10 03:43:34.769157 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769138 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-console-config\") pod \"762467b3-8a1a-43b7-a0c2-c76897523d10\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " Sep 10 03:43:34.769380 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769168 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpfhv\" (UniqueName: \"kubernetes.io/projected/762467b3-8a1a-43b7-a0c2-c76897523d10-kube-api-access-zpfhv\") pod \"762467b3-8a1a-43b7-a0c2-c76897523d10\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " Sep 10 03:43:34.769380 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769200 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-serving-cert\") pod \"762467b3-8a1a-43b7-a0c2-c76897523d10\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " Sep 10 03:43:34.769380 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769224 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-oauth-config\") pod \"762467b3-8a1a-43b7-a0c2-c76897523d10\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " Sep 10 03:43:34.769380 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769263 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-service-ca\") pod \"762467b3-8a1a-43b7-a0c2-c76897523d10\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " Sep 10 03:43:34.769380 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769284 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-oauth-serving-cert\") pod \"762467b3-8a1a-43b7-a0c2-c76897523d10\" (UID: \"762467b3-8a1a-43b7-a0c2-c76897523d10\") " Sep 10 03:43:34.769668 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769488 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "762467b3-8a1a-43b7-a0c2-c76897523d10" (UID: "762467b3-8a1a-43b7-a0c2-c76897523d10"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:43:34.769729 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769621 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-console-config" (OuterVolumeSpecName: "console-config") pod "762467b3-8a1a-43b7-a0c2-c76897523d10" (UID: "762467b3-8a1a-43b7-a0c2-c76897523d10"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:43:34.769766 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769710 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-service-ca" (OuterVolumeSpecName: "service-ca") pod "762467b3-8a1a-43b7-a0c2-c76897523d10" (UID: "762467b3-8a1a-43b7-a0c2-c76897523d10"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:43:34.769819 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.769792 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "762467b3-8a1a-43b7-a0c2-c76897523d10" (UID: "762467b3-8a1a-43b7-a0c2-c76897523d10"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:43:34.771474 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.771441 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "762467b3-8a1a-43b7-a0c2-c76897523d10" (UID: "762467b3-8a1a-43b7-a0c2-c76897523d10"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:43:34.771616 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.771489 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/762467b3-8a1a-43b7-a0c2-c76897523d10-kube-api-access-zpfhv" (OuterVolumeSpecName: "kube-api-access-zpfhv") pod "762467b3-8a1a-43b7-a0c2-c76897523d10" (UID: "762467b3-8a1a-43b7-a0c2-c76897523d10"). InnerVolumeSpecName "kube-api-access-zpfhv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:43:34.771616 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.771516 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "762467b3-8a1a-43b7-a0c2-c76897523d10" (UID: "762467b3-8a1a-43b7-a0c2-c76897523d10"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:43:34.870910 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.870874 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpfhv\" (UniqueName: \"kubernetes.io/projected/762467b3-8a1a-43b7-a0c2-c76897523d10-kube-api-access-zpfhv\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:43:34.870910 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.870902 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:43:34.870910 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.870912 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762467b3-8a1a-43b7-a0c2-c76897523d10-console-oauth-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:43:34.870910 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.870921 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-service-ca\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:43:34.871171 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.870930 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-oauth-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:43:34.871171 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.870939 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-trusted-ca-bundle\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:43:34.871171 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:34.870947 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762467b3-8a1a-43b7-a0c2-c76897523d10-console-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:43:35.483353 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:35.483317 2580 generic.go:356] "Generic (PLEG): container finished" podID="762467b3-8a1a-43b7-a0c2-c76897523d10" containerID="df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b" exitCode=0 Sep 10 03:43:35.483788 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:35.483366 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcbfdd844-wqh2t" Sep 10 03:43:35.483788 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:35.483403 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcbfdd844-wqh2t" event={"ID":"762467b3-8a1a-43b7-a0c2-c76897523d10","Type":"ContainerDied","Data":"df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b"} Sep 10 03:43:35.483788 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:35.483453 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcbfdd844-wqh2t" event={"ID":"762467b3-8a1a-43b7-a0c2-c76897523d10","Type":"ContainerDied","Data":"5fe8103834db870d4873b36e8aee4892bde61cdd00fe67c0e43d94dcbdc0e953"} Sep 10 03:43:35.483788 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:35.483475 2580 scope.go:117] "RemoveContainer" containerID="df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b" Sep 10 03:43:35.491878 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:35.491861 2580 scope.go:117] "RemoveContainer" containerID="df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b" Sep 10 03:43:35.492169 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:43:35.492149 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b\": container with ID starting with df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b not found: ID does not exist" containerID="df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b" Sep 10 03:43:35.492210 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:35.492177 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b"} err="failed to get container status \"df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b\": rpc error: code = NotFound desc = could not find container \"df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b\": container with ID starting with df3088f1b21f1880305845d09892e4320b7445b209b9255d69fc6decc03c335b not found: ID does not exist" Sep 10 03:43:35.503378 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:35.503358 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dcbfdd844-wqh2t"] Sep 10 03:43:35.507350 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:35.507326 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dcbfdd844-wqh2t"] Sep 10 03:43:36.371836 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:43:36.371799 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="762467b3-8a1a-43b7-a0c2-c76897523d10" path="/var/lib/kubelet/pods/762467b3-8a1a-43b7-a0c2-c76897523d10/volumes" Sep 10 03:44:12.167668 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:12.167632 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:44:12.173572 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:12.173546 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:44:12.174838 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:12.174820 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 03:44:22.759241 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.759199 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r48dx"] Sep 10 03:44:22.763346 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.759615 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="762467b3-8a1a-43b7-a0c2-c76897523d10" containerName="console" Sep 10 03:44:22.763346 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.759631 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="762467b3-8a1a-43b7-a0c2-c76897523d10" containerName="console" Sep 10 03:44:22.763346 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.759697 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="762467b3-8a1a-43b7-a0c2-c76897523d10" containerName="console" Sep 10 03:44:22.764228 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.764212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" Sep 10 03:44:22.767038 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.767017 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 03:44:22.768021 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.768000 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5bcdb\"" Sep 10 03:44:22.768389 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.768368 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 03:44:22.772715 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.772696 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r48dx"] Sep 10 03:44:22.876908 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.876876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grj8r\" (UniqueName: \"kubernetes.io/projected/409f19c9-e583-46af-bb38-8a9ba0a3e2bf-kube-api-access-grj8r\") pod \"cert-manager-cainjector-559cdd8c87-r48dx\" (UID: \"409f19c9-e583-46af-bb38-8a9ba0a3e2bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" Sep 10 03:44:22.877086 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.876925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/409f19c9-e583-46af-bb38-8a9ba0a3e2bf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r48dx\" (UID: \"409f19c9-e583-46af-bb38-8a9ba0a3e2bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" Sep 10 03:44:22.977699 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.977667 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grj8r\" (UniqueName: \"kubernetes.io/projected/409f19c9-e583-46af-bb38-8a9ba0a3e2bf-kube-api-access-grj8r\") pod \"cert-manager-cainjector-559cdd8c87-r48dx\" (UID: \"409f19c9-e583-46af-bb38-8a9ba0a3e2bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" Sep 10 03:44:22.977798 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.977712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/409f19c9-e583-46af-bb38-8a9ba0a3e2bf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r48dx\" (UID: \"409f19c9-e583-46af-bb38-8a9ba0a3e2bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" Sep 10 03:44:22.986717 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.986691 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/409f19c9-e583-46af-bb38-8a9ba0a3e2bf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r48dx\" (UID: \"409f19c9-e583-46af-bb38-8a9ba0a3e2bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" Sep 10 03:44:22.986819 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:22.986751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grj8r\" (UniqueName: \"kubernetes.io/projected/409f19c9-e583-46af-bb38-8a9ba0a3e2bf-kube-api-access-grj8r\") pod \"cert-manager-cainjector-559cdd8c87-r48dx\" (UID: \"409f19c9-e583-46af-bb38-8a9ba0a3e2bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" Sep 10 03:44:23.083906 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:23.083848 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" Sep 10 03:44:23.350120 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:23.350093 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r48dx"] Sep 10 03:44:23.352338 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:44:23.352311 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod409f19c9_e583_46af_bb38_8a9ba0a3e2bf.slice/crio-41eb58c65d3e85ee751eff2aa3ba53cca8db82aa48aa2458174c63d52f8ab33f WatchSource:0}: Error finding container 41eb58c65d3e85ee751eff2aa3ba53cca8db82aa48aa2458174c63d52f8ab33f: Status 404 returned error can't find the container with id 41eb58c65d3e85ee751eff2aa3ba53cca8db82aa48aa2458174c63d52f8ab33f Sep 10 03:44:23.354287 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:23.354273 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:44:23.664737 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:23.664657 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" event={"ID":"409f19c9-e583-46af-bb38-8a9ba0a3e2bf","Type":"ContainerStarted","Data":"41eb58c65d3e85ee751eff2aa3ba53cca8db82aa48aa2458174c63d52f8ab33f"} Sep 10 03:44:26.679308 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:26.679272 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" event={"ID":"409f19c9-e583-46af-bb38-8a9ba0a3e2bf","Type":"ContainerStarted","Data":"a1c67678f6de63e7976eb4cac0ee91f8c53ba1eaf15e27415228f290cd144162"} Sep 10 03:44:26.695394 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:26.695342 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r48dx" podStartSLOduration=1.758992396 podStartE2EDuration="4.695321573s" totalImagesPullingTime="2.936329177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:44:26.695162615 +0000 UTC m=+314.914673789" watchObservedRunningTime="2026-09-10 03:44:26.695321573 +0000 UTC m=+314.914832746" Sep 10 03:44:33.033179 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.033140 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8"] Sep 10 03:44:33.036653 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.036631 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" Sep 10 03:44:33.039339 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.039317 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 03:44:33.039429 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.039324 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 03:44:33.040455 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.040436 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8w5ms\"" Sep 10 03:44:33.046998 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.046980 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8"] Sep 10 03:44:33.168245 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.168214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e49cd395-70db-4fe0-b01a-5e97a0c90922-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9dsv8\" (UID: \"e49cd395-70db-4fe0-b01a-5e97a0c90922\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" Sep 10 03:44:33.168416 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.168262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkzkr\" (UniqueName: \"kubernetes.io/projected/e49cd395-70db-4fe0-b01a-5e97a0c90922-kube-api-access-hkzkr\") pod \"openshift-lws-operator-fd8ccff4c-9dsv8\" (UID: \"e49cd395-70db-4fe0-b01a-5e97a0c90922\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" Sep 10 03:44:33.269020 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.268980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e49cd395-70db-4fe0-b01a-5e97a0c90922-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9dsv8\" (UID: \"e49cd395-70db-4fe0-b01a-5e97a0c90922\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" Sep 10 03:44:33.269186 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.269040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkzkr\" (UniqueName: \"kubernetes.io/projected/e49cd395-70db-4fe0-b01a-5e97a0c90922-kube-api-access-hkzkr\") pod \"openshift-lws-operator-fd8ccff4c-9dsv8\" (UID: \"e49cd395-70db-4fe0-b01a-5e97a0c90922\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" Sep 10 03:44:33.269521 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.269474 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e49cd395-70db-4fe0-b01a-5e97a0c90922-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9dsv8\" (UID: \"e49cd395-70db-4fe0-b01a-5e97a0c90922\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" Sep 10 03:44:33.282736 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.282707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkzkr\" (UniqueName: \"kubernetes.io/projected/e49cd395-70db-4fe0-b01a-5e97a0c90922-kube-api-access-hkzkr\") pod \"openshift-lws-operator-fd8ccff4c-9dsv8\" (UID: \"e49cd395-70db-4fe0-b01a-5e97a0c90922\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" Sep 10 03:44:33.345487 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.345404 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" Sep 10 03:44:33.614449 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.614419 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8"] Sep 10 03:44:33.616996 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:44:33.616971 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode49cd395_70db_4fe0_b01a_5e97a0c90922.slice/crio-d922fc5d91a67b0461c7eaafcf557f937bb10a7810bb966e5b0fae81baab005c WatchSource:0}: Error finding container d922fc5d91a67b0461c7eaafcf557f937bb10a7810bb966e5b0fae81baab005c: Status 404 returned error can't find the container with id d922fc5d91a67b0461c7eaafcf557f937bb10a7810bb966e5b0fae81baab005c Sep 10 03:44:33.706821 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:33.706787 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" event={"ID":"e49cd395-70db-4fe0-b01a-5e97a0c90922","Type":"ContainerStarted","Data":"d922fc5d91a67b0461c7eaafcf557f937bb10a7810bb966e5b0fae81baab005c"} Sep 10 03:44:36.725276 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:36.725238 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" event={"ID":"e49cd395-70db-4fe0-b01a-5e97a0c90922","Type":"ContainerStarted","Data":"5147dd58dcdb415b7d93977242e4599a98b30ec948c823fa3c2d1085f6ddae71"} Sep 10 03:44:36.741093 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:36.741040 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9dsv8" podStartSLOduration=1.509753816 podStartE2EDuration="3.74102495s" totalImagesPullingTime="2.231271134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:44:36.739703665 +0000 UTC m=+324.959214840" watchObservedRunningTime="2026-09-10 03:44:36.74102495 +0000 UTC m=+324.960536116" Sep 10 03:44:56.396188 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.396155 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l"] Sep 10 03:44:56.399851 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.399822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.402435 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.402415 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 03:44:56.403187 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.403163 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 03:44:56.403294 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.403243 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-klh6s\"" Sep 10 03:44:56.403294 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.403269 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 03:44:56.403421 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.403299 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 03:44:56.421462 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.421436 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l"] Sep 10 03:44:56.462040 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.462011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-tmp\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.462204 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.462081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-webhook-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.462204 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.462112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.462204 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.462137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-manifests\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.462204 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.462165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkh9f\" (UniqueName: \"kubernetes.io/projected/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-kube-api-access-lkh9f\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.563215 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.563178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-webhook-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.563215 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.563218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.563426 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.563245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-manifests\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.563426 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.563267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkh9f\" (UniqueName: \"kubernetes.io/projected/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-kube-api-access-lkh9f\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.563426 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.563301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-tmp\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.563717 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.563682 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-manifests\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.565686 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.565653 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-tmp\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.565836 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.565820 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-webhook-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.565898 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.565853 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.571099 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.571076 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkh9f\" (UniqueName: \"kubernetes.io/projected/24a2d9ae-6758-418b-a97a-18ce5b6c3aae-kube-api-access-lkh9f\") pod \"opendatahub-operator-controller-manager-b77bb99d9-bmn4l\" (UID: \"24a2d9ae-6758-418b-a97a-18ce5b6c3aae\") " pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.711516 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.711457 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:44:56.987008 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:56.986983 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l"] Sep 10 03:44:56.989458 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:44:56.989434 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a2d9ae_6758_418b_a97a_18ce5b6c3aae.slice/crio-6c19a351c8c4a8cd21f52a536a40d661b9a99f60c986450676e52c00029bf9aa WatchSource:0}: Error finding container 6c19a351c8c4a8cd21f52a536a40d661b9a99f60c986450676e52c00029bf9aa: Status 404 returned error can't find the container with id 6c19a351c8c4a8cd21f52a536a40d661b9a99f60c986450676e52c00029bf9aa Sep 10 03:44:57.807574 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:44:57.807478 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" event={"ID":"24a2d9ae-6758-418b-a97a-18ce5b6c3aae","Type":"ContainerStarted","Data":"6c19a351c8c4a8cd21f52a536a40d661b9a99f60c986450676e52c00029bf9aa"} Sep 10 03:45:00.822265 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:00.822224 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" event={"ID":"24a2d9ae-6758-418b-a97a-18ce5b6c3aae","Type":"ContainerStarted","Data":"fcf1d82137d8036ab003aabaf409acef5b7acc895c818e629f7f7772ec166376"} Sep 10 03:45:01.828005 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:01.827966 2580 generic.go:356] "Generic (PLEG): container finished" podID="24a2d9ae-6758-418b-a97a-18ce5b6c3aae" containerID="fcf1d82137d8036ab003aabaf409acef5b7acc895c818e629f7f7772ec166376" exitCode=0 Sep 10 03:45:01.828400 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:01.828021 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" event={"ID":"24a2d9ae-6758-418b-a97a-18ce5b6c3aae","Type":"ContainerDied","Data":"fcf1d82137d8036ab003aabaf409acef5b7acc895c818e629f7f7772ec166376"} Sep 10 03:45:02.833988 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:02.833955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" event={"ID":"24a2d9ae-6758-418b-a97a-18ce5b6c3aae","Type":"ContainerStarted","Data":"ee3c2ef2d709febcbcaafdddb8f4d579eb911da73e2e6f80a1cddce011462d8d"} Sep 10 03:45:02.834413 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:02.834028 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:45:02.858410 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:02.858357 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" podStartSLOduration=2.471692794 podStartE2EDuration="6.858315236s" totalImagesPullingTime="3.350330377s" totalInitContainerRuntime="1.036292065s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:44:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:02.857175326 +0000 UTC m=+351.076686499" watchObservedRunningTime="2026-09-10 03:45:02.858315236 +0000 UTC m=+351.077826409" Sep 10 03:45:13.840487 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:13.840454 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b77bb99d9-bmn4l" Sep 10 03:45:13.908181 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:13.908151 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85b5977697-kjwnh"] Sep 10 03:45:13.911482 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:13.911461 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:13.924087 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:13.924060 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b5977697-kjwnh"] Sep 10 03:45:14.017784 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.017745 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9abdf2d-339f-4292-ae5a-d798002ecaec-console-serving-cert\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.017965 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.017793 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-oauth-serving-cert\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.017965 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.017866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-console-config\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.017965 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.017914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-service-ca\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.017965 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.017939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-trusted-ca-bundle\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.018118 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.018032 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvc6n\" (UniqueName: \"kubernetes.io/projected/b9abdf2d-339f-4292-ae5a-d798002ecaec-kube-api-access-fvc6n\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.018118 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.018050 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9abdf2d-339f-4292-ae5a-d798002ecaec-console-oauth-config\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.119382 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.119284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvc6n\" (UniqueName: \"kubernetes.io/projected/b9abdf2d-339f-4292-ae5a-d798002ecaec-kube-api-access-fvc6n\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.119382 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.119331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9abdf2d-339f-4292-ae5a-d798002ecaec-console-oauth-config\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.119382 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.119356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9abdf2d-339f-4292-ae5a-d798002ecaec-console-serving-cert\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.119382 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.119379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-oauth-serving-cert\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.119733 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.119415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-console-config\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.119733 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.119433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-service-ca\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.119733 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.119450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-trusted-ca-bundle\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.120282 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.120257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-service-ca\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.120402 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.120282 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-console-config\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.120402 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.120345 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-oauth-serving-cert\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.120619 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.120600 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9abdf2d-339f-4292-ae5a-d798002ecaec-trusted-ca-bundle\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.122344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.122315 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9abdf2d-339f-4292-ae5a-d798002ecaec-console-serving-cert\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.122344 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.122336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9abdf2d-339f-4292-ae5a-d798002ecaec-console-oauth-config\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.127598 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.127582 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvc6n\" (UniqueName: \"kubernetes.io/projected/b9abdf2d-339f-4292-ae5a-d798002ecaec-kube-api-access-fvc6n\") pod \"console-85b5977697-kjwnh\" (UID: \"b9abdf2d-339f-4292-ae5a-d798002ecaec\") " pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.220695 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.220650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:14.489107 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.489082 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b5977697-kjwnh"] Sep 10 03:45:14.490874 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:45:14.490845 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9abdf2d_339f_4292_ae5a_d798002ecaec.slice/crio-3d768dd320cf48b0dddf700a6f67870950b702ad647b22bb46d3da48cc119558 WatchSource:0}: Error finding container 3d768dd320cf48b0dddf700a6f67870950b702ad647b22bb46d3da48cc119558: Status 404 returned error can't find the container with id 3d768dd320cf48b0dddf700a6f67870950b702ad647b22bb46d3da48cc119558 Sep 10 03:45:14.885572 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.885458 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b5977697-kjwnh" event={"ID":"b9abdf2d-339f-4292-ae5a-d798002ecaec","Type":"ContainerStarted","Data":"bee92b8a8e2612d3147da4d7dfeffe1d53dd5334d519d1f1c337d7bb4e8aeacf"} Sep 10 03:45:14.885572 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.885548 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b5977697-kjwnh" event={"ID":"b9abdf2d-339f-4292-ae5a-d798002ecaec","Type":"ContainerStarted","Data":"3d768dd320cf48b0dddf700a6f67870950b702ad647b22bb46d3da48cc119558"} Sep 10 03:45:14.906834 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:14.906784 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85b5977697-kjwnh" podStartSLOduration=1.906767804 podStartE2EDuration="1.906767804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:14.906231316 +0000 UTC m=+363.125742514" watchObservedRunningTime="2026-09-10 03:45:14.906767804 +0000 UTC m=+363.126278990" Sep 10 03:45:23.815882 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.815852 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p"] Sep 10 03:45:23.819483 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.819463 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:23.822181 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.822159 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 03:45:23.822304 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.822228 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 03:45:23.822304 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.822238 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rzhkz\"" Sep 10 03:45:23.822304 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.822290 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 03:45:23.833627 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.833607 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p"] Sep 10 03:45:23.910193 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.910150 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6d5581-7318-45ae-a68d-189ab68cf431-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:23.910193 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.910192 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:23.910393 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.910209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ffmt\" (UniqueName: \"kubernetes.io/projected/8a6d5581-7318-45ae-a68d-189ab68cf431-kube-api-access-6ffmt\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:23.910393 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.910295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:23.910393 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.910354 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:23.910393 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.910373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:23.910553 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.910425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:23.910553 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.910490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:23.910620 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:23.910552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011370 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011370 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6d5581-7318-45ae-a68d-189ab68cf431-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011612 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011612 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ffmt\" (UniqueName: \"kubernetes.io/projected/8a6d5581-7318-45ae-a68d-189ab68cf431-kube-api-access-6ffmt\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011612 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011612 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011812 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011812 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011812 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.011954 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011827 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.012566 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.012528 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.012701 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.011879 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.012866 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.012842 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a6d5581-7318-45ae-a68d-189ab68cf431-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.012941 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.012852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.018319 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.015135 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.018559 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.018541 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.020850 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.020830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a6d5581-7318-45ae-a68d-189ab68cf431-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.021042 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.021024 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ffmt\" (UniqueName: \"kubernetes.io/projected/8a6d5581-7318-45ae-a68d-189ab68cf431-kube-api-access-6ffmt\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p\" (UID: \"8a6d5581-7318-45ae-a68d-189ab68cf431\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.130138 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.130063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:24.221034 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.220999 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:24.221170 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.221089 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:24.225625 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.225601 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:24.408306 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.408283 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p"] Sep 10 03:45:24.410303 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:45:24.410267 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6d5581_7318_45ae_a68d_189ab68cf431.slice/crio-8b4a54cb14ee4d7b939f25cb2e5fb5d0167507118710d51f11eaabe44a82bcb8 WatchSource:0}: Error finding container 8b4a54cb14ee4d7b939f25cb2e5fb5d0167507118710d51f11eaabe44a82bcb8: Status 404 returned error can't find the container with id 8b4a54cb14ee4d7b939f25cb2e5fb5d0167507118710d51f11eaabe44a82bcb8 Sep 10 03:45:24.929356 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.929318 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" event={"ID":"8a6d5581-7318-45ae-a68d-189ab68cf431","Type":"ContainerStarted","Data":"8b4a54cb14ee4d7b939f25cb2e5fb5d0167507118710d51f11eaabe44a82bcb8"} Sep 10 03:45:24.933263 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.933242 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85b5977697-kjwnh" Sep 10 03:45:24.979110 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:24.979082 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc99f5dbc-n629z"] Sep 10 03:45:26.750332 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:26.750293 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-szgwg"] Sep 10 03:45:26.757547 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:26.757510 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:26.760091 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:26.760068 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cxkfr\"" Sep 10 03:45:26.760225 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:26.760124 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 10 03:45:26.764450 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:26.764426 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-szgwg"] Sep 10 03:45:26.940160 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:26.940127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79c39d32-f6e8-4d7b-a707-6f21c074c0a0-cert\") pod \"odh-model-controller-7998c67dc4-szgwg\" (UID: \"79c39d32-f6e8-4d7b-a707-6f21c074c0a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:26.940336 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:26.940247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pnsk\" (UniqueName: \"kubernetes.io/projected/79c39d32-f6e8-4d7b-a707-6f21c074c0a0-kube-api-access-9pnsk\") pod \"odh-model-controller-7998c67dc4-szgwg\" (UID: \"79c39d32-f6e8-4d7b-a707-6f21c074c0a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:27.041326 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.041236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pnsk\" (UniqueName: \"kubernetes.io/projected/79c39d32-f6e8-4d7b-a707-6f21c074c0a0-kube-api-access-9pnsk\") pod \"odh-model-controller-7998c67dc4-szgwg\" (UID: \"79c39d32-f6e8-4d7b-a707-6f21c074c0a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:27.041494 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.041344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79c39d32-f6e8-4d7b-a707-6f21c074c0a0-cert\") pod \"odh-model-controller-7998c67dc4-szgwg\" (UID: \"79c39d32-f6e8-4d7b-a707-6f21c074c0a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:27.044048 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.044018 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79c39d32-f6e8-4d7b-a707-6f21c074c0a0-cert\") pod \"odh-model-controller-7998c67dc4-szgwg\" (UID: \"79c39d32-f6e8-4d7b-a707-6f21c074c0a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:27.050574 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.050547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pnsk\" (UniqueName: \"kubernetes.io/projected/79c39d32-f6e8-4d7b-a707-6f21c074c0a0-kube-api-access-9pnsk\") pod \"odh-model-controller-7998c67dc4-szgwg\" (UID: \"79c39d32-f6e8-4d7b-a707-6f21c074c0a0\") " pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:27.071279 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.071256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:27.173385 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.173351 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 03:45:27.173464 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.173422 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 03:45:27.173464 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.173451 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 03:45:27.371419 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.371394 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-szgwg"] Sep 10 03:45:27.374660 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:45:27.374631 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c39d32_f6e8_4d7b_a707_6f21c074c0a0.slice/crio-edf59e133a54ae89843e5fc3e40c5a800256d62b750bf74e24ef7e3fdfc673d5 WatchSource:0}: Error finding container edf59e133a54ae89843e5fc3e40c5a800256d62b750bf74e24ef7e3fdfc673d5: Status 404 returned error can't find the container with id edf59e133a54ae89843e5fc3e40c5a800256d62b750bf74e24ef7e3fdfc673d5 Sep 10 03:45:27.393208 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.393184 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-thm78"] Sep 10 03:45:27.396759 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.396740 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:27.399387 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.399362 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hx6vk\"" Sep 10 03:45:27.399529 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.399409 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 10 03:45:27.406252 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.406229 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-thm78"] Sep 10 03:45:27.444657 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.444619 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6196ac96-7fe6-4e9b-9fbc-ef51b20d989f-tls-certs\") pod \"model-serving-api-54d89bd5fc-thm78\" (UID: \"6196ac96-7fe6-4e9b-9fbc-ef51b20d989f\") " pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:27.444657 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.444651 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phzr6\" (UniqueName: \"kubernetes.io/projected/6196ac96-7fe6-4e9b-9fbc-ef51b20d989f-kube-api-access-phzr6\") pod \"model-serving-api-54d89bd5fc-thm78\" (UID: \"6196ac96-7fe6-4e9b-9fbc-ef51b20d989f\") " pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:27.545894 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.545859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6196ac96-7fe6-4e9b-9fbc-ef51b20d989f-tls-certs\") pod \"model-serving-api-54d89bd5fc-thm78\" (UID: \"6196ac96-7fe6-4e9b-9fbc-ef51b20d989f\") " pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:27.545894 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.545894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phzr6\" (UniqueName: \"kubernetes.io/projected/6196ac96-7fe6-4e9b-9fbc-ef51b20d989f-kube-api-access-phzr6\") pod \"model-serving-api-54d89bd5fc-thm78\" (UID: \"6196ac96-7fe6-4e9b-9fbc-ef51b20d989f\") " pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:27.546086 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:45:27.546019 2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 10 03:45:27.546086 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:45:27.546083 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6196ac96-7fe6-4e9b-9fbc-ef51b20d989f-tls-certs podName:6196ac96-7fe6-4e9b-9fbc-ef51b20d989f nodeName:}" failed. No retries permitted until 2026-09-10 03:45:28.046065664 +0000 UTC m=+376.265576836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6196ac96-7fe6-4e9b-9fbc-ef51b20d989f-tls-certs") pod "model-serving-api-54d89bd5fc-thm78" (UID: "6196ac96-7fe6-4e9b-9fbc-ef51b20d989f") : secret "model-serving-api-tls" not found Sep 10 03:45:27.554707 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.554685 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phzr6\" (UniqueName: \"kubernetes.io/projected/6196ac96-7fe6-4e9b-9fbc-ef51b20d989f-kube-api-access-phzr6\") pod \"model-serving-api-54d89bd5fc-thm78\" (UID: \"6196ac96-7fe6-4e9b-9fbc-ef51b20d989f\") " pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:27.946933 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.946900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" event={"ID":"8a6d5581-7318-45ae-a68d-189ab68cf431","Type":"ContainerStarted","Data":"34b347ab41d777ee78448c68c3f883bd8932eed42c56d8f7747def16ed4c2c6d"} Sep 10 03:45:27.948104 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.948084 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" event={"ID":"79c39d32-f6e8-4d7b-a707-6f21c074c0a0","Type":"ContainerStarted","Data":"edf59e133a54ae89843e5fc3e40c5a800256d62b750bf74e24ef7e3fdfc673d5"} Sep 10 03:45:27.968022 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:27.967966 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" podStartSLOduration=2.207116429 podStartE2EDuration="4.967941063s" totalImagesPullingTime="2.760824634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:27.965279945 +0000 UTC m=+376.184791118" watchObservedRunningTime="2026-09-10 03:45:27.967941063 +0000 UTC m=+376.187452246" Sep 10 03:45:28.050428 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:28.050397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6196ac96-7fe6-4e9b-9fbc-ef51b20d989f-tls-certs\") pod \"model-serving-api-54d89bd5fc-thm78\" (UID: \"6196ac96-7fe6-4e9b-9fbc-ef51b20d989f\") " pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:28.052794 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:28.052771 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6196ac96-7fe6-4e9b-9fbc-ef51b20d989f-tls-certs\") pod \"model-serving-api-54d89bd5fc-thm78\" (UID: \"6196ac96-7fe6-4e9b-9fbc-ef51b20d989f\") " pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:28.130819 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:28.130791 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:28.134938 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:28.134916 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:28.308661 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:28.308580 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:28.578810 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:28.578783 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-thm78"] Sep 10 03:45:28.580299 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:45:28.580271 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6196ac96_7fe6_4e9b_9fbc_ef51b20d989f.slice/crio-510453d4bb30374e8058eaa535a5ab57ce7ef90882d1db938c0a4bf8d819ba63 WatchSource:0}: Error finding container 510453d4bb30374e8058eaa535a5ab57ce7ef90882d1db938c0a4bf8d819ba63: Status 404 returned error can't find the container with id 510453d4bb30374e8058eaa535a5ab57ce7ef90882d1db938c0a4bf8d819ba63 Sep 10 03:45:28.953773 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:28.953737 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-thm78" event={"ID":"6196ac96-7fe6-4e9b-9fbc-ef51b20d989f","Type":"ContainerStarted","Data":"510453d4bb30374e8058eaa535a5ab57ce7ef90882d1db938c0a4bf8d819ba63"} Sep 10 03:45:28.954152 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:28.953896 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:28.954945 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:28.954927 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p" Sep 10 03:45:32.975133 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:32.975097 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" event={"ID":"79c39d32-f6e8-4d7b-a707-6f21c074c0a0","Type":"ContainerStarted","Data":"69d96104e30b109acc4a879fd3dc71f17ee33cf6ee9d3ac0e3c3b90bcae6cd11"} Sep 10 03:45:32.975626 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:32.975251 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:32.976613 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:32.976591 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-thm78" event={"ID":"6196ac96-7fe6-4e9b-9fbc-ef51b20d989f","Type":"ContainerStarted","Data":"c6c224eee0b1907ebe4ca4f98af440438ed2d746b40f29758d529246af54663e"} Sep 10 03:45:32.976708 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:32.976700 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:32.992314 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:32.992273 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" podStartSLOduration=2.475992802 podStartE2EDuration="6.99226019s" totalImagesPullingTime="4.516267388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:32.990640571 +0000 UTC m=+381.210151748" watchObservedRunningTime="2026-09-10 03:45:32.99226019 +0000 UTC m=+381.211771375" Sep 10 03:45:33.011273 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.011236 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-thm78" podStartSLOduration=2.649761376 podStartE2EDuration="6.011223213s" totalImagesPullingTime="3.361461837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:33.00989705 +0000 UTC m=+381.229408220" watchObservedRunningTime="2026-09-10 03:45:33.011223213 +0000 UTC m=+381.230734386" Sep 10 03:45:33.243118 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.243040 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w"] Sep 10 03:45:33.248768 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.248747 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.252820 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.252790 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 03:45:33.252820 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.252815 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mlw8x\"" Sep 10 03:45:33.253015 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.252896 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 03:45:33.253015 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.252908 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 03:45:33.258879 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.258855 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w"] Sep 10 03:45:33.303208 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.303180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.303334 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.303230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwhhb\" (UniqueName: \"kubernetes.io/projected/cd3cff68-ae13-400e-88ec-ab8336a8645d-kube-api-access-lwhhb\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.303334 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.303253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd3cff68-ae13-400e-88ec-ab8336a8645d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.303334 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.303321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd3cff68-ae13-400e-88ec-ab8336a8645d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.303439 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.303342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.303439 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.303369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.303439 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.303384 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.404544 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.404484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.404716 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.404568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.404716 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.404591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.404716 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.404620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.404716 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.404684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwhhb\" (UniqueName: \"kubernetes.io/projected/cd3cff68-ae13-400e-88ec-ab8336a8645d-kube-api-access-lwhhb\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.404716 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.404712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd3cff68-ae13-400e-88ec-ab8336a8645d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.404960 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.404782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd3cff68-ae13-400e-88ec-ab8336a8645d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.405320 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.405292 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.406968 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.406947 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd3cff68-ae13-400e-88ec-ab8336a8645d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.407208 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.407187 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.407273 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.407197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.407273 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.407217 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd3cff68-ae13-400e-88ec-ab8336a8645d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.412695 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.412673 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd3cff68-ae13-400e-88ec-ab8336a8645d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.413096 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.413079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwhhb\" (UniqueName: \"kubernetes.io/projected/cd3cff68-ae13-400e-88ec-ab8336a8645d-kube-api-access-lwhhb\") pod \"istiod-openshift-gateway-5677ccb49b-cmv8w\" (UID: \"cd3cff68-ae13-400e-88ec-ab8336a8645d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.558688 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.558613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:33.832392 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.832360 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w"] Sep 10 03:45:33.837676 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:45:33.837651 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3cff68_ae13_400e_88ec_ab8336a8645d.slice/crio-3522cf756f6598a0b350cf5ea75a0876c2ac9328377880e0974658c88270b12a WatchSource:0}: Error finding container 3522cf756f6598a0b350cf5ea75a0876c2ac9328377880e0974658c88270b12a: Status 404 returned error can't find the container with id 3522cf756f6598a0b350cf5ea75a0876c2ac9328377880e0974658c88270b12a Sep 10 03:45:33.982199 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:33.982164 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" event={"ID":"cd3cff68-ae13-400e-88ec-ab8336a8645d","Type":"ContainerStarted","Data":"3522cf756f6598a0b350cf5ea75a0876c2ac9328377880e0974658c88270b12a"} Sep 10 03:45:35.949804 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:35.949767 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd"] Sep 10 03:45:35.953398 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:35.953375 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:35.956666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:35.956626 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 03:45:35.956666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:35.956641 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 03:45:35.956953 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:35.956931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 03:45:35.957068 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:35.956980 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l7fsn\"" Sep 10 03:45:35.966001 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:35.965975 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd"] Sep 10 03:45:36.033086 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.033047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-cert\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.033281 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.033115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6db6v\" (UniqueName: \"kubernetes.io/projected/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-kube-api-access-6db6v\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.033281 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.033158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-metrics-cert\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.033281 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.033225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-manager-config\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.134819 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.134771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-manager-config\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.135005 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.134901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-cert\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.135005 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.134943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6db6v\" (UniqueName: \"kubernetes.io/projected/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-kube-api-access-6db6v\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.135005 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.134976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-metrics-cert\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.135635 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.135573 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-manager-config\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.137994 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.137974 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-cert\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.138145 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.138122 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-metrics-cert\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.148441 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.148410 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6db6v\" (UniqueName: \"kubernetes.io/projected/95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc-kube-api-access-6db6v\") pod \"lws-controller-manager-599dbf8cc5-pdnqd\" (UID: \"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc\") " pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.265797 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.265711 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:36.392069 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.392034 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 03:45:36.392186 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.392115 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 03:45:36.595156 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:36.595079 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd"] Sep 10 03:45:36.601365 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:45:36.601327 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b5e4e1_5b41_4e7b_bae0_9801db7ed7cc.slice/crio-75d4376cfd2d9bcdf78e75ffd84213241814907251dc024e2241204c9e8bb867 WatchSource:0}: Error finding container 75d4376cfd2d9bcdf78e75ffd84213241814907251dc024e2241204c9e8bb867: Status 404 returned error can't find the container with id 75d4376cfd2d9bcdf78e75ffd84213241814907251dc024e2241204c9e8bb867 Sep 10 03:45:37.001046 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:37.000999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" event={"ID":"cd3cff68-ae13-400e-88ec-ab8336a8645d","Type":"ContainerStarted","Data":"6beba4f95abeb6995bd84aefe5031163858ee1adfd2c8e0fe66d52d6e7889988"} Sep 10 03:45:37.001534 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:37.001155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:37.002588 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:37.002558 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" event={"ID":"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc","Type":"ContainerStarted","Data":"75d4376cfd2d9bcdf78e75ffd84213241814907251dc024e2241204c9e8bb867"} Sep 10 03:45:37.003144 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:37.003118 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-cmv8w container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 03:45:37.003217 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:37.003167 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" podUID="cd3cff68-ae13-400e-88ec-ab8336a8645d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 03:45:37.027736 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:37.027686 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" podStartSLOduration=1.476032473 podStartE2EDuration="4.027671603s" totalImagesPullingTime="2.55163913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:37.026219399 +0000 UTC m=+385.245730597" watchObservedRunningTime="2026-09-10 03:45:37.027671603 +0000 UTC m=+385.247182776" Sep 10 03:45:38.015217 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:38.010983 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cmv8w" Sep 10 03:45:39.015477 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:39.015440 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" event={"ID":"95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc","Type":"ContainerStarted","Data":"cde4841f00eaf58b14ff0834946c8c019d65acd1b3a47f95a49934acdb2fca8e"} Sep 10 03:45:39.036515 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:39.036446 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" podStartSLOduration=2.417786072 podStartE2EDuration="4.036430853s" totalImagesPullingTime="1.618644781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:45:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:45:39.035974145 +0000 UTC m=+387.255485332" watchObservedRunningTime="2026-09-10 03:45:39.036430853 +0000 UTC m=+387.255942025" Sep 10 03:45:40.019694 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:40.019655 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:43.984285 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:43.984258 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-szgwg" Sep 10 03:45:43.986515 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:43.986481 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-thm78" Sep 10 03:45:49.998442 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:49.998395 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cc99f5dbc-n629z" podUID="146752ee-becc-40b3-a3dc-3a9638c1cf9a" containerName="console" containerID="cri-o://e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23" gracePeriod=15 Sep 10 03:45:50.244815 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.244793 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:45:50.364039 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.363954 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-trusted-ca-bundle\") pod \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " Sep 10 03:45:50.364039 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.363992 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-config\") pod \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " Sep 10 03:45:50.364263 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.364072 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-serving-cert\") pod \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " Sep 10 03:45:50.364263 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.364092 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-oauth-config\") pod \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " Sep 10 03:45:50.364263 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.364122 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffzzd\" (UniqueName: \"kubernetes.io/projected/146752ee-becc-40b3-a3dc-3a9638c1cf9a-kube-api-access-ffzzd\") pod \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " Sep 10 03:45:50.364263 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.364143 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-service-ca\") pod \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " Sep 10 03:45:50.364263 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.364174 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-oauth-serving-cert\") pod \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\" (UID: \"146752ee-becc-40b3-a3dc-3a9638c1cf9a\") " Sep 10 03:45:50.364611 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.364571 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "146752ee-becc-40b3-a3dc-3a9638c1cf9a" (UID: "146752ee-becc-40b3-a3dc-3a9638c1cf9a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:45:50.364739 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.364616 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-config" (OuterVolumeSpecName: "console-config") pod "146752ee-becc-40b3-a3dc-3a9638c1cf9a" (UID: "146752ee-becc-40b3-a3dc-3a9638c1cf9a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:45:50.364739 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.364697 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-service-ca" (OuterVolumeSpecName: "service-ca") pod "146752ee-becc-40b3-a3dc-3a9638c1cf9a" (UID: "146752ee-becc-40b3-a3dc-3a9638c1cf9a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:45:50.364739 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.364704 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "146752ee-becc-40b3-a3dc-3a9638c1cf9a" (UID: "146752ee-becc-40b3-a3dc-3a9638c1cf9a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 03:45:50.366349 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.366313 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "146752ee-becc-40b3-a3dc-3a9638c1cf9a" (UID: "146752ee-becc-40b3-a3dc-3a9638c1cf9a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:45:50.366811 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.366792 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "146752ee-becc-40b3-a3dc-3a9638c1cf9a" (UID: "146752ee-becc-40b3-a3dc-3a9638c1cf9a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:45:50.366811 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.366787 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/146752ee-becc-40b3-a3dc-3a9638c1cf9a-kube-api-access-ffzzd" (OuterVolumeSpecName: "kube-api-access-ffzzd") pod "146752ee-becc-40b3-a3dc-3a9638c1cf9a" (UID: "146752ee-becc-40b3-a3dc-3a9638c1cf9a"). InnerVolumeSpecName "kube-api-access-ffzzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:45:50.465829 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.465789 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:45:50.465829 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.465822 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-oauth-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:45:50.465829 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.465835 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffzzd\" (UniqueName: \"kubernetes.io/projected/146752ee-becc-40b3-a3dc-3a9638c1cf9a-kube-api-access-ffzzd\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:45:50.466076 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.465846 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-service-ca\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:45:50.466076 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.465855 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-oauth-serving-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:45:50.466076 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.465865 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-trusted-ca-bundle\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:45:50.466076 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:50.465875 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/146752ee-becc-40b3-a3dc-3a9638c1cf9a-console-config\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:45:51.025880 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.025845 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-599dbf8cc5-pdnqd" Sep 10 03:45:51.069906 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.069868 2580 generic.go:356] "Generic (PLEG): container finished" podID="146752ee-becc-40b3-a3dc-3a9638c1cf9a" containerID="e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23" exitCode=0 Sep 10 03:45:51.069906 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.069909 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc99f5dbc-n629z" Sep 10 03:45:51.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.069946 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc99f5dbc-n629z" event={"ID":"146752ee-becc-40b3-a3dc-3a9638c1cf9a","Type":"ContainerDied","Data":"e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23"} Sep 10 03:45:51.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.070001 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc99f5dbc-n629z" event={"ID":"146752ee-becc-40b3-a3dc-3a9638c1cf9a","Type":"ContainerDied","Data":"6c2d9df27efa7797e57376ecacacc38d0862ddd89c090005e030ff9270858f8e"} Sep 10 03:45:51.070137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.070022 2580 scope.go:117] "RemoveContainer" containerID="e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23" Sep 10 03:45:51.079994 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.079975 2580 scope.go:117] "RemoveContainer" containerID="e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23" Sep 10 03:45:51.080288 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:45:51.080254 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23\": container with ID starting with e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23 not found: ID does not exist" containerID="e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23" Sep 10 03:45:51.080388 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.080289 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23"} err="failed to get container status \"e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23\": rpc error: code = NotFound desc = could not find container \"e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23\": container with ID starting with e80812d005dc773de4774979485c806aa27c38a80229140d75b952cfd03a7f23 not found: ID does not exist" Sep 10 03:45:51.089022 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.089001 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc99f5dbc-n629z"] Sep 10 03:45:51.094079 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:51.094049 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc99f5dbc-n629z"] Sep 10 03:45:52.372459 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:45:52.372416 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="146752ee-becc-40b3-a3dc-3a9638c1cf9a" path="/var/lib/kubelet/pods/146752ee-becc-40b3-a3dc-3a9638c1cf9a/volumes" Sep 10 03:48:23.311941 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.311910 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bc5fd979c-kstkf"] Sep 10 03:48:23.312396 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.312307 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146752ee-becc-40b3-a3dc-3a9638c1cf9a" containerName="console" Sep 10 03:48:23.312396 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.312326 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="146752ee-becc-40b3-a3dc-3a9638c1cf9a" containerName="console" Sep 10 03:48:23.312470 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.312403 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="146752ee-becc-40b3-a3dc-3a9638c1cf9a" containerName="console" Sep 10 03:48:23.315677 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.315652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:23.318167 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.318141 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 10 03:48:23.318509 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.318476 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 10 03:48:23.319419 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.319400 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7d564\"" Sep 10 03:48:23.319809 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.319793 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 10 03:48:23.334223 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.334200 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bc5fd979c-kstkf"] Sep 10 03:48:23.414864 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.414827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-metrics-certs\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:23.415026 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.414874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fclgg\" (UniqueName: \"kubernetes.io/projected/c901c153-50be-48af-ad61-8b64842148a4-kube-api-access-fclgg\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:23.415026 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.414906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-webhook-cert\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:23.490107 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.490070 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5dc65bd9db-tdhvc"] Sep 10 03:48:23.493457 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.493435 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.504841 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.504813 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dc65bd9db-tdhvc"] Sep 10 03:48:23.516281 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.516250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-metrics-certs\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:23.516439 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.516320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fclgg\" (UniqueName: \"kubernetes.io/projected/c901c153-50be-48af-ad61-8b64842148a4-kube-api-access-fclgg\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:23.516439 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.516380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-webhook-cert\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:23.516687 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:48:23.516662 2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 10 03:48:23.516904 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:48:23.516881 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-webhook-cert podName:c901c153-50be-48af-ad61-8b64842148a4 nodeName:}" failed. No retries permitted until 2026-09-10 03:48:24.016859135 +0000 UTC m=+552.236370305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-webhook-cert") pod "maas-controller-7bc5fd979c-kstkf" (UID: "c901c153-50be-48af-ad61-8b64842148a4") : secret "maas-controller-webhook-cert" not found Sep 10 03:48:23.518917 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.518898 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-metrics-certs\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:23.524524 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.524482 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fclgg\" (UniqueName: \"kubernetes.io/projected/c901c153-50be-48af-ad61-8b64842148a4-kube-api-access-fclgg\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:23.618012 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.617906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wqgp\" (UniqueName: \"kubernetes.io/projected/8fa47c30-e592-4fbf-ba1a-467e6c70ca77-kube-api-access-7wqgp\") pod \"maas-controller-5dc65bd9db-tdhvc\" (UID: \"8fa47c30-e592-4fbf-ba1a-467e6c70ca77\") " pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.618167 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.618025 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa47c30-e592-4fbf-ba1a-467e6c70ca77-metrics-certs\") pod \"maas-controller-5dc65bd9db-tdhvc\" (UID: \"8fa47c30-e592-4fbf-ba1a-467e6c70ca77\") " pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.618167 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.618084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fa47c30-e592-4fbf-ba1a-467e6c70ca77-webhook-cert\") pod \"maas-controller-5dc65bd9db-tdhvc\" (UID: \"8fa47c30-e592-4fbf-ba1a-467e6c70ca77\") " pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.719588 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.719551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fa47c30-e592-4fbf-ba1a-467e6c70ca77-webhook-cert\") pod \"maas-controller-5dc65bd9db-tdhvc\" (UID: \"8fa47c30-e592-4fbf-ba1a-467e6c70ca77\") " pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.719770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.719658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wqgp\" (UniqueName: \"kubernetes.io/projected/8fa47c30-e592-4fbf-ba1a-467e6c70ca77-kube-api-access-7wqgp\") pod \"maas-controller-5dc65bd9db-tdhvc\" (UID: \"8fa47c30-e592-4fbf-ba1a-467e6c70ca77\") " pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.719770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.719733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa47c30-e592-4fbf-ba1a-467e6c70ca77-metrics-certs\") pod \"maas-controller-5dc65bd9db-tdhvc\" (UID: \"8fa47c30-e592-4fbf-ba1a-467e6c70ca77\") " pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.722247 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.722218 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fa47c30-e592-4fbf-ba1a-467e6c70ca77-webhook-cert\") pod \"maas-controller-5dc65bd9db-tdhvc\" (UID: \"8fa47c30-e592-4fbf-ba1a-467e6c70ca77\") " pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.722360 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.722218 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa47c30-e592-4fbf-ba1a-467e6c70ca77-metrics-certs\") pod \"maas-controller-5dc65bd9db-tdhvc\" (UID: \"8fa47c30-e592-4fbf-ba1a-467e6c70ca77\") " pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.728045 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.728026 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wqgp\" (UniqueName: \"kubernetes.io/projected/8fa47c30-e592-4fbf-ba1a-467e6c70ca77-kube-api-access-7wqgp\") pod \"maas-controller-5dc65bd9db-tdhvc\" (UID: \"8fa47c30-e592-4fbf-ba1a-467e6c70ca77\") " pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:23.803861 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:23.803822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:24.023207 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:24.023171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-webhook-cert\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:24.025534 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:24.025490 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-webhook-cert\") pod \"maas-controller-7bc5fd979c-kstkf\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:24.074206 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:24.074180 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dc65bd9db-tdhvc"] Sep 10 03:48:24.076300 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:48:24.076274 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa47c30_e592_4fbf_ba1a_467e6c70ca77.slice/crio-a84ab21a7dc50a2819b3941a063d74ede8174f0f3641edf991eff5dab191225d WatchSource:0}: Error finding container a84ab21a7dc50a2819b3941a063d74ede8174f0f3641edf991eff5dab191225d: Status 404 returned error can't find the container with id a84ab21a7dc50a2819b3941a063d74ede8174f0f3641edf991eff5dab191225d Sep 10 03:48:24.232974 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:24.232943 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:24.506961 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:24.506934 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bc5fd979c-kstkf"] Sep 10 03:48:24.508670 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:48:24.508639 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc901c153_50be_48af_ad61_8b64842148a4.slice/crio-0a0c65abd652418044d91b0bc175e3654b3961c998ffa49eba3f1591784bc825 WatchSource:0}: Error finding container 0a0c65abd652418044d91b0bc175e3654b3961c998ffa49eba3f1591784bc825: Status 404 returned error can't find the container with id 0a0c65abd652418044d91b0bc175e3654b3961c998ffa49eba3f1591784bc825 Sep 10 03:48:24.758782 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:24.758747 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" event={"ID":"8fa47c30-e592-4fbf-ba1a-467e6c70ca77","Type":"ContainerStarted","Data":"a84ab21a7dc50a2819b3941a063d74ede8174f0f3641edf991eff5dab191225d"} Sep 10 03:48:24.760280 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:24.760251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" event={"ID":"c901c153-50be-48af-ad61-8b64842148a4","Type":"ContainerStarted","Data":"0a0c65abd652418044d91b0bc175e3654b3961c998ffa49eba3f1591784bc825"} Sep 10 03:48:27.775971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:27.775925 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" event={"ID":"8fa47c30-e592-4fbf-ba1a-467e6c70ca77","Type":"ContainerStarted","Data":"8695f6908e7a0be3aba386545426f3baa2e99e15dd4ee000b29b5d893e570ddd"} Sep 10 03:48:27.776441 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:27.776141 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:27.777601 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:27.777576 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" event={"ID":"c901c153-50be-48af-ad61-8b64842148a4","Type":"ContainerStarted","Data":"b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583"} Sep 10 03:48:27.777718 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:27.777632 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:27.794675 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:27.794621 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" podStartSLOduration=2.049890045 podStartE2EDuration="4.794604213s" totalImagesPullingTime="2.744714168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:27.793214377 +0000 UTC m=+556.012725553" watchObservedRunningTime="2026-09-10 03:48:27.794604213 +0000 UTC m=+556.014115386" Sep 10 03:48:27.811255 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:27.811200 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" podStartSLOduration=2.492271201 podStartE2EDuration="4.811183084s" totalImagesPullingTime="2.318911883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:48:27.810444759 +0000 UTC m=+556.029955925" watchObservedRunningTime="2026-09-10 03:48:27.811183084 +0000 UTC m=+556.030694258" Sep 10 03:48:38.785767 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:38.785733 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5dc65bd9db-tdhvc" Sep 10 03:48:38.786225 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:38.785803 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:38.855254 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:38.855211 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bc5fd979c-kstkf"] Sep 10 03:48:38.855461 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:38.855413 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" podUID="c901c153-50be-48af-ad61-8b64842148a4" containerName="manager" containerID="cri-o://b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583" gracePeriod=30 Sep 10 03:48:39.100100 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.100075 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:39.159045 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.158998 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-webhook-cert\") pod \"c901c153-50be-48af-ad61-8b64842148a4\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " Sep 10 03:48:39.159045 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.159060 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fclgg\" (UniqueName: \"kubernetes.io/projected/c901c153-50be-48af-ad61-8b64842148a4-kube-api-access-fclgg\") pod \"c901c153-50be-48af-ad61-8b64842148a4\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " Sep 10 03:48:39.159253 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.159096 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-metrics-certs\") pod \"c901c153-50be-48af-ad61-8b64842148a4\" (UID: \"c901c153-50be-48af-ad61-8b64842148a4\") " Sep 10 03:48:39.161310 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.161274 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c901c153-50be-48af-ad61-8b64842148a4" (UID: "c901c153-50be-48af-ad61-8b64842148a4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:48:39.161434 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.161340 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c901c153-50be-48af-ad61-8b64842148a4-kube-api-access-fclgg" (OuterVolumeSpecName: "kube-api-access-fclgg") pod "c901c153-50be-48af-ad61-8b64842148a4" (UID: "c901c153-50be-48af-ad61-8b64842148a4"). InnerVolumeSpecName "kube-api-access-fclgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 03:48:39.161434 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.161342 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c901c153-50be-48af-ad61-8b64842148a4" (UID: "c901c153-50be-48af-ad61-8b64842148a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 03:48:39.260151 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.260115 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fclgg\" (UniqueName: \"kubernetes.io/projected/c901c153-50be-48af-ad61-8b64842148a4-kube-api-access-fclgg\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:48:39.260151 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.260144 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-metrics-certs\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:48:39.260151 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.260155 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c901c153-50be-48af-ad61-8b64842148a4-webhook-cert\") on node \"ip-10-0-132-138.ec2.internal\" DevicePath \"\"" Sep 10 03:48:39.836377 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.836339 2580 generic.go:356] "Generic (PLEG): container finished" podID="c901c153-50be-48af-ad61-8b64842148a4" containerID="b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583" exitCode=0 Sep 10 03:48:39.836836 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.836384 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" Sep 10 03:48:39.836836 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.836421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" event={"ID":"c901c153-50be-48af-ad61-8b64842148a4","Type":"ContainerDied","Data":"b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583"} Sep 10 03:48:39.836836 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.836472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc5fd979c-kstkf" event={"ID":"c901c153-50be-48af-ad61-8b64842148a4","Type":"ContainerDied","Data":"0a0c65abd652418044d91b0bc175e3654b3961c998ffa49eba3f1591784bc825"} Sep 10 03:48:39.836836 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.836493 2580 scope.go:117] "RemoveContainer" containerID="b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583" Sep 10 03:48:39.845363 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.845345 2580 scope.go:117] "RemoveContainer" containerID="b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583" Sep 10 03:48:39.845670 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:48:39.845653 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583\": container with ID starting with b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583 not found: ID does not exist" containerID="b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583" Sep 10 03:48:39.845723 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.845679 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583"} err="failed to get container status \"b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583\": rpc error: code = NotFound desc = could not find container \"b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583\": container with ID starting with b405dea19b6501471f5c806029f069f536d8fea941f2176f4fe56278fac04583 not found: ID does not exist" Sep 10 03:48:39.857233 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.857199 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bc5fd979c-kstkf"] Sep 10 03:48:39.859558 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:39.859535 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bc5fd979c-kstkf"] Sep 10 03:48:40.372908 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:48:40.372874 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c901c153-50be-48af-ad61-8b64842148a4" path="/var/lib/kubelet/pods/c901c153-50be-48af-ad61-8b64842148a4/volumes" Sep 10 03:49:00.361467 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.361429 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht"] Sep 10 03:49:00.361935 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.361817 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c901c153-50be-48af-ad61-8b64842148a4" containerName="manager" Sep 10 03:49:00.361935 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.361833 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c901c153-50be-48af-ad61-8b64842148a4" containerName="manager" Sep 10 03:49:00.361935 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.361911 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c901c153-50be-48af-ad61-8b64842148a4" containerName="manager" Sep 10 03:49:00.369536 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.369492 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.373888 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.373134 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 10 03:49:00.373888 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.373165 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fvknp\"" Sep 10 03:49:00.373888 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.373223 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 03:49:00.373888 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.373232 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 03:49:00.373888 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.373593 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 10 03:49:00.377148 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.377124 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht"] Sep 10 03:49:00.442188 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.442146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-openshift-service-ca\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.442188 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.442187 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcvks\" (UniqueName: \"kubernetes.io/projected/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-kube-api-access-jcvks\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.442453 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.442271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-metrics-certs\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.442453 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.442323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-maas-api-tls\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.543166 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.543108 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-openshift-service-ca\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.543490 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.543470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcvks\" (UniqueName: \"kubernetes.io/projected/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-kube-api-access-jcvks\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.543939 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.543621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-metrics-certs\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.543939 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.543683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-maas-api-tls\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.543939 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:49:00.543767 2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found Sep 10 03:49:00.543939 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:49:00.543878 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-metrics-certs podName:ba84df1d-c341-4b85-ab21-ab4bdb41d7a9 nodeName:}" failed. No retries permitted until 2026-09-10 03:49:01.043854896 +0000 UTC m=+589.263366061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-metrics-certs") pod "maas-api-66d4755d8f-d9vht" (UID: "ba84df1d-c341-4b85-ab21-ab4bdb41d7a9") : secret "maas-api-metrics-tls" not found Sep 10 03:49:00.544235 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.544033 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-openshift-service-ca\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.546834 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.546786 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-maas-api-tls\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:00.552700 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:00.552680 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcvks\" (UniqueName: \"kubernetes.io/projected/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-kube-api-access-jcvks\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:01.048299 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:01.048269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-metrics-certs\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:01.050847 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:01.050813 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba84df1d-c341-4b85-ab21-ab4bdb41d7a9-metrics-certs\") pod \"maas-api-66d4755d8f-d9vht\" (UID: \"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9\") " pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:01.282270 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:01.282233 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:01.554588 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:01.554537 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht"] Sep 10 03:49:01.557523 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:49:01.557472 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba84df1d_c341_4b85_ab21_ab4bdb41d7a9.slice/crio-d0ddb61a73b19d56cf45ea11ff591ffe932ef9e7a57143fe875b006c4a08b762 WatchSource:0}: Error finding container d0ddb61a73b19d56cf45ea11ff591ffe932ef9e7a57143fe875b006c4a08b762: Status 404 returned error can't find the container with id d0ddb61a73b19d56cf45ea11ff591ffe932ef9e7a57143fe875b006c4a08b762 Sep 10 03:49:01.944348 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:01.944310 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" event={"ID":"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9","Type":"ContainerStarted","Data":"d0ddb61a73b19d56cf45ea11ff591ffe932ef9e7a57143fe875b006c4a08b762"} Sep 10 03:49:03.956873 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:03.956840 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" event={"ID":"ba84df1d-c341-4b85-ab21-ab4bdb41d7a9","Type":"ContainerStarted","Data":"ca3f044e2561f65f9c6ca39f847ceb8d7de020e7eb653176b5397dd08cb47005"} Sep 10 03:49:03.957292 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:03.956927 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:03.975307 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:03.975253 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" podStartSLOduration=2.429330557 podStartE2EDuration="3.975236584s" totalImagesPullingTime="1.545906027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:49:03.973446292 +0000 UTC m=+592.192957466" watchObservedRunningTime="2026-09-10 03:49:03.975236584 +0000 UTC m=+592.194747801" Sep 10 03:49:09.969367 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:09.969337 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-66d4755d8f-d9vht" Sep 10 03:49:12.204088 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:12.204057 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:49:12.204519 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:12.204201 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:49:30.951695 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:30.951657 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt"] Sep 10 03:49:30.955562 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:30.955541 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:30.958421 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:30.958397 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 03:49:30.958421 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:30.958414 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-45l5t\"" Sep 10 03:49:30.958592 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:30.958405 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 03:49:30.959253 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:30.959239 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 10 03:49:30.964402 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:30.964377 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt"] Sep 10 03:49:31.014728 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.014689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.014884 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.014740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6kvt\" (UniqueName: \"kubernetes.io/projected/16f5004a-0b64-4640-91f6-af62046fcce8-kube-api-access-j6kvt\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.014884 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.014778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.014884 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.014802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16f5004a-0b64-4640-91f6-af62046fcce8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.014884 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.014847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.014884 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.014881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.115336 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.115299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6kvt\" (UniqueName: \"kubernetes.io/projected/16f5004a-0b64-4640-91f6-af62046fcce8-kube-api-access-j6kvt\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.115537 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.115345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.115537 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.115529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16f5004a-0b64-4640-91f6-af62046fcce8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.115666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.115562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.115666 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.115607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.115770 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.115733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.115959 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.115933 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.116077 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.116011 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.116077 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.116046 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.118332 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.118307 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16f5004a-0b64-4640-91f6-af62046fcce8-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.118867 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.118836 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16f5004a-0b64-4640-91f6-af62046fcce8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.123656 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.123637 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6kvt\" (UniqueName: \"kubernetes.io/projected/16f5004a-0b64-4640-91f6-af62046fcce8-kube-api-access-j6kvt\") pod \"e2e-distinct-2-simulated-kserve-859856b874-rd4dt\" (UID: \"16f5004a-0b64-4640-91f6-af62046fcce8\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.268729 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.268643 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:31.541024 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.540901 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt"] Sep 10 03:49:31.543351 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:49:31.543316 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f5004a_0b64_4640_91f6_af62046fcce8.slice/crio-c51a1d0743a5a030f31008c9a5563c26f743224d6222626f4681b6ac71cd670d WatchSource:0}: Error finding container c51a1d0743a5a030f31008c9a5563c26f743224d6222626f4681b6ac71cd670d: Status 404 returned error can't find the container with id c51a1d0743a5a030f31008c9a5563c26f743224d6222626f4681b6ac71cd670d Sep 10 03:49:31.544745 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:31.544728 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 03:49:32.091262 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:32.091226 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" event={"ID":"16f5004a-0b64-4640-91f6-af62046fcce8","Type":"ContainerStarted","Data":"c51a1d0743a5a030f31008c9a5563c26f743224d6222626f4681b6ac71cd670d"} Sep 10 03:49:33.098212 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:33.098180 2580 generic.go:356] "Generic (PLEG): container finished" podID="16f5004a-0b64-4640-91f6-af62046fcce8" containerID="745d76543d4ff0c268d34fe972b5629fc5b51e5c8878b8ded8075313a3415503" exitCode=0 Sep 10 03:49:33.098641 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:33.098251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" event={"ID":"16f5004a-0b64-4640-91f6-af62046fcce8","Type":"ContainerDied","Data":"745d76543d4ff0c268d34fe972b5629fc5b51e5c8878b8ded8075313a3415503"} Sep 10 03:49:33.098641 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:33.098486 2580 scope.go:117] "RemoveContainer" containerID="745d76543d4ff0c268d34fe972b5629fc5b51e5c8878b8ded8075313a3415503" Sep 10 03:49:34.104982 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:34.104945 2580 generic.go:356] "Generic (PLEG): container finished" podID="16f5004a-0b64-4640-91f6-af62046fcce8" containerID="bb384e8c16d1991edd8f619a14aa256c9132e39f441fb549928d2cb53773d2dd" exitCode=0 Sep 10 03:49:34.105456 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:34.105033 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" event={"ID":"16f5004a-0b64-4640-91f6-af62046fcce8","Type":"ContainerDied","Data":"bb384e8c16d1991edd8f619a14aa256c9132e39f441fb549928d2cb53773d2dd"} Sep 10 03:49:34.105456 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:34.105117 2580 scope.go:117] "RemoveContainer" containerID="745d76543d4ff0c268d34fe972b5629fc5b51e5c8878b8ded8075313a3415503" Sep 10 03:49:34.105456 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:34.105370 2580 scope.go:117] "RemoveContainer" containerID="bb384e8c16d1991edd8f619a14aa256c9132e39f441fb549928d2cb53773d2dd" Sep 10 03:49:34.105597 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:49:34.105579 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:49:35.112042 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:35.111974 2580 scope.go:117] "RemoveContainer" containerID="bb384e8c16d1991edd8f619a14aa256c9132e39f441fb549928d2cb53773d2dd" Sep 10 03:49:35.112409 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:49:35.112161 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:49:41.268733 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:41.268703 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:41.269094 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:41.268757 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:41.269094 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:41.268774 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:41.269094 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:41.268790 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:49:41.269197 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:41.269145 2580 scope.go:117] "RemoveContainer" containerID="bb384e8c16d1991edd8f619a14aa256c9132e39f441fb549928d2cb53773d2dd" Sep 10 03:49:41.269340 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:49:41.269320 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:49:42.941274 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:42.941237 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8"] Sep 10 03:49:42.945619 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:42.945588 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:42.948227 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:42.948204 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 10 03:49:42.957909 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:42.957876 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8"] Sep 10 03:49:43.028738 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.028686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdgf7\" (UniqueName: \"kubernetes.io/projected/aef08804-3c98-488b-ab27-6c6773bccfa0-kube-api-access-cdgf7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.028918 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.028764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.028918 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.028781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.028918 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.028802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.028918 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.028859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.029057 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.028944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aef08804-3c98-488b-ab27-6c6773bccfa0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.130218 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.130187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.130410 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.130254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aef08804-3c98-488b-ab27-6c6773bccfa0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.130410 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.130274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgf7\" (UniqueName: \"kubernetes.io/projected/aef08804-3c98-488b-ab27-6c6773bccfa0-kube-api-access-cdgf7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.130410 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.130333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.130410 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.130351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.130410 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.130371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.130683 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.130655 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.130789 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.130768 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.130849 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.130799 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.132483 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.132462 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aef08804-3c98-488b-ab27-6c6773bccfa0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.132807 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.132788 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aef08804-3c98-488b-ab27-6c6773bccfa0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.137725 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.137703 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdgf7\" (UniqueName: \"kubernetes.io/projected/aef08804-3c98-488b-ab27-6c6773bccfa0-kube-api-access-cdgf7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8\" (UID: \"aef08804-3c98-488b-ab27-6c6773bccfa0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.255908 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.255821 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:43.526308 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:43.526242 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8"] Sep 10 03:49:43.528635 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:49:43.528604 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef08804_3c98_488b_ab27_6c6773bccfa0.slice/crio-a678ac12a538539290358dd5281e444d048c2a6a9b16e0c4a3e6084f81162289 WatchSource:0}: Error finding container a678ac12a538539290358dd5281e444d048c2a6a9b16e0c4a3e6084f81162289: Status 404 returned error can't find the container with id a678ac12a538539290358dd5281e444d048c2a6a9b16e0c4a3e6084f81162289 Sep 10 03:49:44.154228 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:44.154197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" event={"ID":"aef08804-3c98-488b-ab27-6c6773bccfa0","Type":"ContainerStarted","Data":"60a4cb6f371605af390f868d0b7318f42699d2182fb7cef2f518c7e718f3a49c"} Sep 10 03:49:44.154582 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:44.154244 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" event={"ID":"aef08804-3c98-488b-ab27-6c6773bccfa0","Type":"ContainerStarted","Data":"a678ac12a538539290358dd5281e444d048c2a6a9b16e0c4a3e6084f81162289"} Sep 10 03:49:44.174721 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:44.174672 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" podStartSLOduration=1.995268593 podStartE2EDuration="2.174658598s" totalImagesPullingTime="179.390005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:49:44.173044868 +0000 UTC m=+632.392556042" watchObservedRunningTime="2026-09-10 03:49:44.174658598 +0000 UTC m=+632.394169772" Sep 10 03:49:53.255933 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:53.255895 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:53.256328 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:53.255951 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:53.268152 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:53.268125 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:54.215195 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:54.215161 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8" Sep 10 03:49:55.366871 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:55.366841 2580 scope.go:117] "RemoveContainer" containerID="bb384e8c16d1991edd8f619a14aa256c9132e39f441fb549928d2cb53773d2dd" Sep 10 03:49:56.216669 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:56.216637 2580 generic.go:356] "Generic (PLEG): container finished" podID="16f5004a-0b64-4640-91f6-af62046fcce8" containerID="0121c55f3f94dd535fb8a1ef18d2de0b37044b8cf1df874aec7600dbee4d8a7f" exitCode=0 Sep 10 03:49:56.216835 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:56.216718 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" event={"ID":"16f5004a-0b64-4640-91f6-af62046fcce8","Type":"ContainerDied","Data":"0121c55f3f94dd535fb8a1ef18d2de0b37044b8cf1df874aec7600dbee4d8a7f"} Sep 10 03:49:56.216835 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:56.216808 2580 scope.go:117] "RemoveContainer" containerID="bb384e8c16d1991edd8f619a14aa256c9132e39f441fb549928d2cb53773d2dd" Sep 10 03:49:56.217174 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:49:56.217157 2580 scope.go:117] "RemoveContainer" containerID="0121c55f3f94dd535fb8a1ef18d2de0b37044b8cf1df874aec7600dbee4d8a7f" Sep 10 03:49:56.217414 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:49:56.217395 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:50:01.269094 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:01.269058 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:50:01.269537 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:01.269122 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:50:01.269537 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:01.269145 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:50:01.269537 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:01.269165 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:50:01.269647 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:01.269557 2580 scope.go:117] "RemoveContainer" containerID="0121c55f3f94dd535fb8a1ef18d2de0b37044b8cf1df874aec7600dbee4d8a7f" Sep 10 03:50:01.269809 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:50:01.269787 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:50:03.551151 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.551110 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg"] Sep 10 03:50:03.558147 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.558124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.560850 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.560730 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 03:50:03.565292 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.565259 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg"] Sep 10 03:50:03.629801 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.629761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d0ed85-ff2b-4f8a-b71d-15105be45342-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.629801 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.629807 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.630029 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.629828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v89fn\" (UniqueName: \"kubernetes.io/projected/b4d0ed85-ff2b-4f8a-b71d-15105be45342-kube-api-access-v89fn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.630029 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.629920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.630029 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.629953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.630029 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.630015 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.731058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.731020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.731261 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.731104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d0ed85-ff2b-4f8a-b71d-15105be45342-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.731261 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.731136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.731261 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.731159 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v89fn\" (UniqueName: \"kubernetes.io/projected/b4d0ed85-ff2b-4f8a-b71d-15105be45342-kube-api-access-v89fn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.731261 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.731225 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.731261 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.731249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.731564 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.731491 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.731664 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.731604 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.731664 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.731647 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.733290 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.733268 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4d0ed85-ff2b-4f8a-b71d-15105be45342-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.733648 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.733627 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4d0ed85-ff2b-4f8a-b71d-15105be45342-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.739044 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.739007 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v89fn\" (UniqueName: \"kubernetes.io/projected/b4d0ed85-ff2b-4f8a-b71d-15105be45342-kube-api-access-v89fn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg\" (UID: \"b4d0ed85-ff2b-4f8a-b71d-15105be45342\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:03.870896 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:03.870806 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:04.145093 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:04.145070 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg"] Sep 10 03:50:04.146885 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:50:04.146858 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d0ed85_ff2b_4f8a_b71d_15105be45342.slice/crio-4e90efbd2e5b464d9b61c1e1f069b2a2506572f7dae13cf27d73005884f81386 WatchSource:0}: Error finding container 4e90efbd2e5b464d9b61c1e1f069b2a2506572f7dae13cf27d73005884f81386: Status 404 returned error can't find the container with id 4e90efbd2e5b464d9b61c1e1f069b2a2506572f7dae13cf27d73005884f81386 Sep 10 03:50:04.259254 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:04.259222 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" event={"ID":"b4d0ed85-ff2b-4f8a-b71d-15105be45342","Type":"ContainerStarted","Data":"4e90efbd2e5b464d9b61c1e1f069b2a2506572f7dae13cf27d73005884f81386"} Sep 10 03:50:05.265348 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:05.265309 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" event={"ID":"b4d0ed85-ff2b-4f8a-b71d-15105be45342","Type":"ContainerStarted","Data":"084fb15abdb08ac3504a1ec601fc0f8def852d096aaa16db7374950fe246964d"} Sep 10 03:50:05.283741 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:05.283690 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" podStartSLOduration=2.107069982 podStartE2EDuration="2.283676052s" totalImagesPullingTime="176.60607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:50:05.282228245 +0000 UTC m=+653.501739418" watchObservedRunningTime="2026-09-10 03:50:05.283676052 +0000 UTC m=+653.503187224" Sep 10 03:50:13.871600 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:13.871565 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:13.871983 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:13.871642 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:13.884190 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:13.884163 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:14.316803 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:14.316774 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg" Sep 10 03:50:15.367206 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:15.367176 2580 scope.go:117] "RemoveContainer" containerID="0121c55f3f94dd535fb8a1ef18d2de0b37044b8cf1df874aec7600dbee4d8a7f" Sep 10 03:50:15.367602 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:50:15.367363 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:50:28.367207 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:28.367176 2580 scope.go:117] "RemoveContainer" containerID="0121c55f3f94dd535fb8a1ef18d2de0b37044b8cf1df874aec7600dbee4d8a7f" Sep 10 03:50:29.377393 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:29.377354 2580 generic.go:356] "Generic (PLEG): container finished" podID="16f5004a-0b64-4640-91f6-af62046fcce8" containerID="ad695aaaae751aeaef81b19599cadc7c9287d5fbd8a58ed95509626e8988480a" exitCode=0 Sep 10 03:50:29.377848 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:29.377414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" event={"ID":"16f5004a-0b64-4640-91f6-af62046fcce8","Type":"ContainerDied","Data":"ad695aaaae751aeaef81b19599cadc7c9287d5fbd8a58ed95509626e8988480a"} Sep 10 03:50:29.377848 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:29.377474 2580 scope.go:117] "RemoveContainer" containerID="0121c55f3f94dd535fb8a1ef18d2de0b37044b8cf1df874aec7600dbee4d8a7f" Sep 10 03:50:29.377848 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:29.377797 2580 scope.go:117] "RemoveContainer" containerID="ad695aaaae751aeaef81b19599cadc7c9287d5fbd8a58ed95509626e8988480a" Sep 10 03:50:29.378037 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:50:29.377981 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:50:31.269572 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:31.269529 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:50:31.269971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:31.269602 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:50:31.269971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:31.269618 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:50:31.269971 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:31.269632 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:50:31.270072 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:31.270008 2580 scope.go:117] "RemoveContainer" containerID="ad695aaaae751aeaef81b19599cadc7c9287d5fbd8a58ed95509626e8988480a" Sep 10 03:50:31.270210 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:50:31.270192 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:50:45.367275 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:45.367246 2580 scope.go:117] "RemoveContainer" containerID="ad695aaaae751aeaef81b19599cadc7c9287d5fbd8a58ed95509626e8988480a" Sep 10 03:50:45.367737 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:50:45.367435 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:50:56.367236 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:50:56.367205 2580 scope.go:117] "RemoveContainer" containerID="ad695aaaae751aeaef81b19599cadc7c9287d5fbd8a58ed95509626e8988480a" Sep 10 03:50:56.367713 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:50:56.367387 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:51:09.367558 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:09.367491 2580 scope.go:117] "RemoveContainer" containerID="ad695aaaae751aeaef81b19599cadc7c9287d5fbd8a58ed95509626e8988480a" Sep 10 03:51:10.571094 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:10.571060 2580 generic.go:356] "Generic (PLEG): container finished" podID="16f5004a-0b64-4640-91f6-af62046fcce8" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" exitCode=0 Sep 10 03:51:10.571577 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:10.571135 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" event={"ID":"16f5004a-0b64-4640-91f6-af62046fcce8","Type":"ContainerDied","Data":"85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2"} Sep 10 03:51:10.571577 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:10.571194 2580 scope.go:117] "RemoveContainer" containerID="ad695aaaae751aeaef81b19599cadc7c9287d5fbd8a58ed95509626e8988480a" Sep 10 03:51:10.571715 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:10.571600 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:51:10.571841 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:51:10.571821 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:51:11.268938 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:11.268907 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:51:11.269116 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:11.268958 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:51:11.269116 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:11.268978 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:51:11.269116 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:11.268991 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:51:11.577855 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:11.577781 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:51:11.578209 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:51:11.577949 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:51:23.367241 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:23.367208 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:51:23.367755 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:51:23.367383 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:51:35.367643 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:35.367616 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:51:35.368200 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:51:35.367833 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:51:47.366725 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:51:47.366691 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:51:47.367242 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:51:47.366944 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:52:01.367772 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:01.367734 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:52:01.368184 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:52:01.367967 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:52:14.367401 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:14.367369 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:52:14.367782 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:52:14.367613 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:52:29.366955 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:29.366921 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:52:29.367419 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:52:29.367098 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:52:43.366946 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:43.366876 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:52:44.020872 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:44.020840 2580 generic.go:356] "Generic (PLEG): container finished" podID="16f5004a-0b64-4640-91f6-af62046fcce8" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" exitCode=0 Sep 10 03:52:44.021058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:44.020913 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" event={"ID":"16f5004a-0b64-4640-91f6-af62046fcce8","Type":"ContainerDied","Data":"151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12"} Sep 10 03:52:44.021058 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:44.021003 2580 scope.go:117] "RemoveContainer" containerID="85ed8a5147cdf262b4c07d8d533f41c272ae20093f1c55dadc32cb5e48cf33b2" Sep 10 03:52:44.021377 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:44.021343 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:52:44.021590 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:52:44.021570 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:52:51.269388 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:51.269354 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:52:51.269798 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:51.269410 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:52:51.269798 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:51.269424 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:52:51.269798 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:51.269436 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" Sep 10 03:52:51.269798 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:52:51.269784 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:52:51.269956 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:52:51.269937 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:53:06.366747 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:53:06.366717 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:53:06.367232 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:53:06.366911 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:53:20.366943 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:53:20.366911 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:53:20.367326 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:53:20.367105 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:53:35.367492 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:53:35.367465 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:53:35.367875 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:53:35.367678 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:53:50.367127 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:53:50.367096 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:53:50.367647 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:53:50.367276 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:54:05.367154 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:05.367070 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:54:05.367577 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:54:05.367229 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:54:12.233857 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:12.233828 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:54:12.234362 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:12.234278 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:54:16.366937 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:16.366907 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:54:16.367395 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:54:16.367087 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:54:22.260725 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:22.260697 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5dc65bd9db-tdhvc_8fa47c30-e592-4fbf-ba1a-467e6c70ca77/manager/0.log" Sep 10 03:54:22.387679 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:22.387652 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-thm78_6196ac96-7fe6-4e9b-9fbc-ef51b20d989f/server/0.log" Sep 10 03:54:22.530852 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:22.530779 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-szgwg_79c39d32-f6e8-4d7b-a707-6f21c074c0a0/manager/0.log" Sep 10 03:54:22.657847 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:22.657818 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b77bb99d9-bmn4l_24a2d9ae-6758-418b-a97a-18ce5b6c3aae/copy-manifests/0.log" Sep 10 03:54:22.667787 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:22.667760 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b77bb99d9-bmn4l_24a2d9ae-6758-418b-a97a-18ce5b6c3aae/manager/0.log" Sep 10 03:54:23.332214 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:23.332188 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-66d4755d8f-d9vht_ba84df1d-c341-4b85-ab21-ab4bdb41d7a9/maas-api/0.log" Sep 10 03:54:25.557718 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:25.557688 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p_8a6d5581-7318-45ae-a68d-189ab68cf431/istio-proxy/0.log" Sep 10 03:54:25.695334 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:25.695302 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cmv8w_cd3cff68-ae13-400e-88ec-ab8336a8645d/discovery/0.log" Sep 10 03:54:26.882957 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:26.882927 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-rd4dt_16f5004a-0b64-4640-91f6-af62046fcce8/main/5.log" Sep 10 03:54:27.129295 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:27.129266 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-98bg8_aef08804-3c98-488b-ab27-6c6773bccfa0/main/0.log" Sep 10 03:54:27.383067 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:27.383038 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsmxqg_b4d0ed85-ff2b-4f8a-b71d-15105be45342/main/0.log" Sep 10 03:54:31.367079 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:31.367050 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:54:31.369474 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:54:31.367236 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:54:37.237125 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:37.237097 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ghxlx_68bcd05d-92df-4758-a94a-30f988f2f0ed/global-pull-secret-syncer/0.log" Sep 10 03:54:37.394756 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:37.394731 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zzpgg_4e0160b7-d9ed-466d-b049-cc3faa3b3b2d/konnectivity-agent/0.log" Sep 10 03:54:37.468873 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:37.468844 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-138.ec2.internal_8633308fe0afc9393e482bd331cb1311/haproxy/0.log" Sep 10 03:54:43.609014 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:43.608986 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-b9lfn_f38bea70-9e6e-4979-aa25-ca04d3518f75/kube-state-metrics/0.log" Sep 10 03:54:43.630198 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:43.630172 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-b9lfn_f38bea70-9e6e-4979-aa25-ca04d3518f75/kube-rbac-proxy-main/0.log" Sep 10 03:54:43.655658 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:43.655637 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-b9lfn_f38bea70-9e6e-4979-aa25-ca04d3518f75/kube-rbac-proxy-self/0.log" Sep 10 03:54:43.687747 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:43.687726 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-649c97f8f9-v6k5b_ae9ca4de-22e6-4fe0-88af-74b1280114bc/metrics-server/0.log" Sep 10 03:54:43.713417 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:43.713339 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-wztwg_883e49d9-190d-496f-aa11-f5e1dddba025/monitoring-plugin/0.log" Sep 10 03:54:43.748437 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:43.748414 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4f5kp_b2d3c496-697d-4216-9fc1-9a2b621aad37/node-exporter/0.log" Sep 10 03:54:43.769779 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:43.769759 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4f5kp_b2d3c496-697d-4216-9fc1-9a2b621aad37/kube-rbac-proxy/0.log" Sep 10 03:54:43.791087 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:43.791070 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4f5kp_b2d3c496-697d-4216-9fc1-9a2b621aad37/init-textfile/0.log" Sep 10 03:54:43.982851 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:43.982781 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-h6cth_bce28c71-dfa0-48fe-a1c7-aec6945ac989/kube-rbac-proxy-main/0.log" Sep 10 03:54:44.006252 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.006226 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-h6cth_bce28c71-dfa0-48fe-a1c7-aec6945ac989/kube-rbac-proxy-self/0.log" Sep 10 03:54:44.032019 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.031999 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-h6cth_bce28c71-dfa0-48fe-a1c7-aec6945ac989/openshift-state-metrics/0.log" Sep 10 03:54:44.079236 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.079217 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_347df3e6-52d4-4747-82e4-981b383d8a13/prometheus/0.log" Sep 10 03:54:44.101352 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.101332 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_347df3e6-52d4-4747-82e4-981b383d8a13/config-reloader/0.log" Sep 10 03:54:44.123018 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.122998 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_347df3e6-52d4-4747-82e4-981b383d8a13/thanos-sidecar/0.log" Sep 10 03:54:44.145677 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.145656 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_347df3e6-52d4-4747-82e4-981b383d8a13/kube-rbac-proxy-web/0.log" Sep 10 03:54:44.169480 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.169459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_347df3e6-52d4-4747-82e4-981b383d8a13/kube-rbac-proxy/0.log" Sep 10 03:54:44.192874 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.192854 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_347df3e6-52d4-4747-82e4-981b383d8a13/kube-rbac-proxy-thanos/0.log" Sep 10 03:54:44.216992 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.216974 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_347df3e6-52d4-4747-82e4-981b383d8a13/init-config-reloader/0.log" Sep 10 03:54:44.248159 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.248090 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-vcj4h_e62dbf17-1121-4d11-b99d-f16b3a95742d/prometheus-operator/0.log" Sep 10 03:54:44.276787 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.276765 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-vcj4h_e62dbf17-1121-4d11-b99d-f16b3a95742d/kube-rbac-proxy/0.log" Sep 10 03:54:44.478942 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.478917 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68964d946b-9p6xg_ab3b7483-7e14-417a-ae4b-22656e6a2ffa/thanos-query/0.log" Sep 10 03:54:44.504981 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.504910 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68964d946b-9p6xg_ab3b7483-7e14-417a-ae4b-22656e6a2ffa/kube-rbac-proxy-web/0.log" Sep 10 03:54:44.527046 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.527026 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68964d946b-9p6xg_ab3b7483-7e14-417a-ae4b-22656e6a2ffa/kube-rbac-proxy/0.log" Sep 10 03:54:44.552959 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.552940 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68964d946b-9p6xg_ab3b7483-7e14-417a-ae4b-22656e6a2ffa/prom-label-proxy/0.log" Sep 10 03:54:44.579517 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.579478 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68964d946b-9p6xg_ab3b7483-7e14-417a-ae4b-22656e6a2ffa/kube-rbac-proxy-rules/0.log" Sep 10 03:54:44.606799 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:44.606778 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68964d946b-9p6xg_ab3b7483-7e14-417a-ae4b-22656e6a2ffa/kube-rbac-proxy-metrics/0.log" Sep 10 03:54:45.367313 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:45.367283 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:54:45.367652 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:54:45.367448 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:54:47.397152 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.397121 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85b5977697-kjwnh_b9abdf2d-339f-4292-ae5a-d798002ecaec/console/0.log" Sep 10 03:54:47.735852 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.735818 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj"] Sep 10 03:54:47.739587 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.739565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.741981 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.741960 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gvppc\"/\"kube-root-ca.crt\"" Sep 10 03:54:47.742160 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.742139 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gvppc\"/\"openshift-service-ca.crt\"" Sep 10 03:54:47.743096 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.743078 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gvppc\"/\"default-dockercfg-hwbmm\"" Sep 10 03:54:47.749360 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.749335 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj"] Sep 10 03:54:47.849458 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.849422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-lib-modules\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.849648 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.849531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-proc\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.849648 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.849589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-podres\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.849648 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.849612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sjqb\" (UniqueName: \"kubernetes.io/projected/9b471224-9900-46e4-ae88-c2f1179a30bb-kube-api-access-2sjqb\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.849648 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.849637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-sys\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.950799 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.950769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-proc\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.950945 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.950818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-podres\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.950945 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.950838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sjqb\" (UniqueName: \"kubernetes.io/projected/9b471224-9900-46e4-ae88-c2f1179a30bb-kube-api-access-2sjqb\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.950945 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.950863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-sys\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.950945 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.950895 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-proc\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.950945 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.950904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-lib-modules\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.951148 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.950950 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-sys\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.951148 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.950954 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-podres\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.951148 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.951049 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b471224-9900-46e4-ae88-c2f1179a30bb-lib-modules\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:47.959434 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:47.959415 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sjqb\" (UniqueName: \"kubernetes.io/projected/9b471224-9900-46e4-ae88-c2f1179a30bb-kube-api-access-2sjqb\") pod \"perf-node-gather-daemonset-xjxjj\" (UID: \"9b471224-9900-46e4-ae88-c2f1179a30bb\") " pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:48.050689 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:48.050599 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:48.329663 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:48.329641 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj"] Sep 10 03:54:48.332080 ip-10-0-132-138 kubenswrapper[2580]: W0910 03:54:48.332055 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9b471224_9900_46e4_ae88_c2f1179a30bb.slice/crio-377246925c8870460f6537ddc77524ae1d9eca306b8f85a1ffc32fb536867397 WatchSource:0}: Error finding container 377246925c8870460f6537ddc77524ae1d9eca306b8f85a1ffc32fb536867397: Status 404 returned error can't find the container with id 377246925c8870460f6537ddc77524ae1d9eca306b8f85a1ffc32fb536867397 Sep 10 03:54:48.608383 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:48.608298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" event={"ID":"9b471224-9900-46e4-ae88-c2f1179a30bb","Type":"ContainerStarted","Data":"d1da819d991539c26057b299f6ee47e2e9532bc584e77b7cd11ea7c5d8494565"} Sep 10 03:54:48.608383 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:48.608355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" event={"ID":"9b471224-9900-46e4-ae88-c2f1179a30bb","Type":"ContainerStarted","Data":"377246925c8870460f6537ddc77524ae1d9eca306b8f85a1ffc32fb536867397"} Sep 10 03:54:48.608841 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:48.608393 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:48.626192 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:48.626148 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" podStartSLOduration=1.6261361490000001 podStartE2EDuration="1.626136149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 03:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 03:54:48.624261065 +0000 UTC m=+936.843772240" watchObservedRunningTime="2026-09-10 03:54:48.626136149 +0000 UTC m=+936.845647322" Sep 10 03:54:49.290513 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:49.290477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5x2qg_c697cf34-832b-43ef-9df9-28fbc080a2ae/dns/0.log" Sep 10 03:54:49.313339 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:49.313319 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5x2qg_c697cf34-832b-43ef-9df9-28fbc080a2ae/kube-rbac-proxy/0.log" Sep 10 03:54:49.441362 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:49.441339 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gv6n7_d01ae2bc-55d5-4211-a419-b58cb760f7f2/dns-node-resolver/0.log" Sep 10 03:54:49.981510 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:49.981477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8482s_350afe90-c4e6-4027-b653-bd23f6cc4e2b/node-ca/0.log" Sep 10 03:54:50.992913 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:50.992885 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p_8a6d5581-7318-45ae-a68d-189ab68cf431/istio-proxy/0.log" Sep 10 03:54:51.039863 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:51.039837 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cmv8w_cd3cff68-ae13-400e-88ec-ab8336a8645d/discovery/0.log" Sep 10 03:54:51.917773 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:51.917748 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vmt6r_a2981f7e-ec7d-49ac-a492-324e19bab605/serve-healthcheck-canary/0.log" Sep 10 03:54:52.393383 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:52.393359 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fxgkh_43359135-c5e7-4c06-b70b-dc2ae58a540c/kube-rbac-proxy/0.log" Sep 10 03:54:52.418521 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:52.418475 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fxgkh_43359135-c5e7-4c06-b70b-dc2ae58a540c/exporter/0.log" Sep 10 03:54:52.442023 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:52.441995 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fxgkh_43359135-c5e7-4c06-b70b-dc2ae58a540c/extractor/0.log" Sep 10 03:54:54.622702 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:54.622671 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gvppc/perf-node-gather-daemonset-xjxjj" Sep 10 03:54:54.770357 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:54.770331 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5dc65bd9db-tdhvc_8fa47c30-e592-4fbf-ba1a-467e6c70ca77/manager/0.log" Sep 10 03:54:54.790754 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:54.790736 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-thm78_6196ac96-7fe6-4e9b-9fbc-ef51b20d989f/server/0.log" Sep 10 03:54:54.838137 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:54.838106 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-szgwg_79c39d32-f6e8-4d7b-a707-6f21c074c0a0/manager/0.log" Sep 10 03:54:54.862221 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:54.862196 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b77bb99d9-bmn4l_24a2d9ae-6758-418b-a97a-18ce5b6c3aae/manager/0.log" Sep 10 03:54:54.884178 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:54.884117 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b77bb99d9-bmn4l_24a2d9ae-6758-418b-a97a-18ce5b6c3aae/copy-manifests/0.log" Sep 10 03:54:56.201141 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:56.201107 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-599dbf8cc5-pdnqd_95b5e4e1-5b41-4e7b-bae0-9801db7ed7cc/manager/0.log" Sep 10 03:54:56.255010 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:56.254981 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9dsv8_e49cd395-70db-4fe0-b01a-5e97a0c90922/openshift-lws-operator/0.log" Sep 10 03:54:58.238125 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:58.238096 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p_8a6d5581-7318-45ae-a68d-189ab68cf431/istio-proxy/0.log" Sep 10 03:54:58.275528 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:58.275486 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cmv8w_cd3cff68-ae13-400e-88ec-ab8336a8645d/discovery/0.log" Sep 10 03:54:59.580922 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:59.580843 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6fg5p_8a6d5581-7318-45ae-a68d-189ab68cf431/istio-proxy/0.log" Sep 10 03:54:59.626624 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:54:59.626598 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cmv8w_cd3cff68-ae13-400e-88ec-ab8336a8645d/discovery/0.log" Sep 10 03:55:00.367166 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:00.367139 2580 scope.go:117] "RemoveContainer" containerID="151542eba73e9d2ad8b895bede0e06ba37fc323327b04a738b4f491e1a619d12" Sep 10 03:55:00.367352 ip-10-0-132-138 kubenswrapper[2580]: E0910 03:55:00.367332 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-rd4dt_llm(16f5004a-0b64-4640-91f6-af62046fcce8)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-rd4dt" podUID="16f5004a-0b64-4640-91f6-af62046fcce8" Sep 10 03:55:03.492011 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.491980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vk84n_cdde3356-c271-4915-8c9b-0201d4f8aff7/kube-multus-additional-cni-plugins/0.log" Sep 10 03:55:03.513849 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.513821 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vk84n_cdde3356-c271-4915-8c9b-0201d4f8aff7/egress-router-binary-copy/0.log" Sep 10 03:55:03.536215 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.536188 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vk84n_cdde3356-c271-4915-8c9b-0201d4f8aff7/cni-plugins/0.log" Sep 10 03:55:03.557166 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.557136 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vk84n_cdde3356-c271-4915-8c9b-0201d4f8aff7/bond-cni-plugin/0.log" Sep 10 03:55:03.579423 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.579395 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vk84n_cdde3356-c271-4915-8c9b-0201d4f8aff7/routeoverride-cni/0.log" Sep 10 03:55:03.600817 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.600795 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vk84n_cdde3356-c271-4915-8c9b-0201d4f8aff7/whereabouts-cni-bincopy/0.log" Sep 10 03:55:03.622444 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.622411 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vk84n_cdde3356-c271-4915-8c9b-0201d4f8aff7/whereabouts-cni/0.log" Sep 10 03:55:03.681243 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.681209 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xj75f_5e910964-6cb9-4b92-b001-ccc756e54db5/kube-multus/0.log" Sep 10 03:55:03.790799 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.790771 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r7f5r_213caff4-1d8b-4359-8ac8-b74d609e0e00/network-metrics-daemon/0.log" Sep 10 03:55:03.811167 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:03.811140 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r7f5r_213caff4-1d8b-4359-8ac8-b74d609e0e00/kube-rbac-proxy/0.log" Sep 10 03:55:04.844468 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:04.844438 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-controller/0.log" Sep 10 03:55:04.863859 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:04.863832 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/1.log" Sep 10 03:55:04.863993 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:04.863934 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovn-acl-logging/0.log" Sep 10 03:55:04.881281 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:04.881261 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/kube-rbac-proxy-node/0.log" Sep 10 03:55:04.905758 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:04.905738 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 03:55:04.931347 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:04.931324 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/northd/0.log" Sep 10 03:55:04.952466 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:04.952445 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/nbdb/0.log" Sep 10 03:55:04.979194 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:04.979173 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/sbdb/0.log" Sep 10 03:55:05.018601 ip-10-0-132-138 kubenswrapper[2580]: I0910 03:55:05.018568 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ngz62_dc889041-66d1-47a7-a13e-01b24e3fa360/ovnkube-controller/0.log"