Sep 09 02:25:58.154662 ip-10-0-137-93 systemd[1]: Starting Kubernetes Kubelet... Sep 09 02:25:58.555970 ip-10-0-137-93 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 02:25:58.555970 ip-10-0-137-93 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 02:25:58.555970 ip-10-0-137-93 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 02:25:58.555970 ip-10-0-137-93 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 02:25:58.555970 ip-10-0-137-93 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 02:25:58.556658 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.556035 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 02:25:58.561044 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561026 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:58.561044 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561042 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:58.561044 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561046 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561050 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561053 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561056 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561059 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561062 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561064 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561067 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561071 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561087 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561090 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561093 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561096 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561104 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561108 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561112 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561114 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561117 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561120 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:58.561144 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561122 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561125 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561127 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561130 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561133 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561135 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561138 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561141 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561143 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561146 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561149 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561152 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561154 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561157 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561160 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561163 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561165 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561168 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561170 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561173 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:58.561609 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561178 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561181 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561184 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561187 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561191 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561193 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561196 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561199 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561201 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561204 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561206 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561209 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561211 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561215 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561217 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561220 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561223 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561226 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561229 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561231 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:58.562124 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561234 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561237 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561239 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561242 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561245 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561249 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561252 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561255 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561258 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561261 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561263 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561266 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561268 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561271 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561275 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561279 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561281 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561284 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561286 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:58.562625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561290 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561292 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561295 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561297 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561300 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561302 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561306 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561310 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561312 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561315 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561317 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561320 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561323 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561325 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561328 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561331 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561333 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561336 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.561353 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562072 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:58.563080 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562079 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562082 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562085 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562088 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562090 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562093 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562096 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562099 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562102 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562105 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562108 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562111 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562113 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562116 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562120 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562124 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562128 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562131 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562135 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:58.563572 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562139 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562142 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562145 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562148 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562150 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562154 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562158 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562160 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562163 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562166 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562169 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562172 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562174 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562177 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562180 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562182 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562185 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562187 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562190 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562193 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:58.564038 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562195 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562198 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562201 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562204 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562206 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562209 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562211 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562214 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562216 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562219 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562221 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562224 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562227 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562230 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562232 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562236 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562238 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562241 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562243 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562246 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:58.564733 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562248 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562251 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562253 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562256 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562258 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562261 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562264 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562266 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562269 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562271 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562274 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562276 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562279 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562281 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562286 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562289 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562292 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562295 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562297 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562300 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:58.565372 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562302 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562305 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562307 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562310 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562313 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562315 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562318 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562320 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562323 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562326 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562328 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562331 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562333 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562336 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562352 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562355 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562357 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562360 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562363 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562776 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:58.565893 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562781 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562784 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562787 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562790 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562794 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562797 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562801 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562804 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562807 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562810 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562813 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562815 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562818 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562820 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562823 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562826 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562829 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562831 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562834 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:58.566427 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562838 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562842 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562845 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562848 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562852 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562855 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562857 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562860 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562863 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562865 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562868 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562871 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562874 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562876 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562879 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562881 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562883 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562887 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562892 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562895 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:58.566890 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562898 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562901 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562903 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562906 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562908 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562911 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562913 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562916 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562918 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562921 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562923 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562926 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562928 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562931 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562934 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562936 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562938 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562941 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562944 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562946 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:58.567474 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562949 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562951 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562954 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562956 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562959 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562961 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562964 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562966 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562970 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562972 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562976 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562978 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562981 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562984 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562986 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562989 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562992 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562996 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.562999 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:58.567997 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563002 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563005 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563007 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563010 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563013 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563015 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563018 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563020 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563023 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563026 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563028 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563030 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563033 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563035 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563038 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563040 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563042 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563045 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563047 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.563049 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:58.568463 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563121 2569 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563166 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563173 2569 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563179 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563184 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563187 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563192 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563197 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563200 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563203 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563207 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563210 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563213 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563217 2569 flags.go:64] FLAG: --cgroup-root="" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563220 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563223 2569 flags.go:64] FLAG: --client-ca-file="" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563226 2569 flags.go:64] FLAG: --cloud-provider="external" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563229 2569 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563232 2569 flags.go:64] FLAG: --cluster-domain="" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563235 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563238 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563241 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563244 2569 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563248 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 02:25:58.568943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563251 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563255 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563258 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563261 2569 flags.go:64] FLAG: --contention-profiling="false" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563264 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563267 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563270 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563273 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563277 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563280 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563283 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563287 2569 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563290 2569 flags.go:64] FLAG: --enable-server="true" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563293 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563298 2569 flags.go:64] FLAG: --event-burst="100" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563301 2569 flags.go:64] FLAG: --event-qps="50" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563304 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563307 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563310 2569 flags.go:64] FLAG: --eviction-hard="" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563314 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563319 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563322 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563325 2569 flags.go:64] FLAG: --eviction-soft="" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563328 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563331 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 02:25:58.569582 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563334 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563348 2569 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563352 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563355 2569 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563357 2569 flags.go:64] FLAG: --feature-gates="" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563362 2569 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563365 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563368 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563372 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563375 2569 flags.go:64] FLAG: --healthz-port="10248" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563378 2569 flags.go:64] FLAG: --help="false" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563381 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-137-93.ec2.internal" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563384 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563387 2569 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563390 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563393 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563396 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563399 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563403 2569 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563406 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563409 2569 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563411 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563415 2569 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563417 2569 flags.go:64] FLAG: --kube-reserved="" Sep 09 02:25:58.570194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563779 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563783 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563786 2569 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563791 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563794 2569 flags.go:64] FLAG: --lock-file="" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563796 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563800 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563803 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563808 2569 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563811 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563814 2569 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563816 2569 flags.go:64] FLAG: --logging-format="text" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563819 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563823 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563825 2569 flags.go:64] FLAG: --manifest-url="" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563828 2569 flags.go:64] FLAG: --manifest-url-header="" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563833 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563836 2569 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563840 2569 flags.go:64] FLAG: --max-pods="110" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563843 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563846 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563849 2569 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563851 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563854 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563857 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 02:25:58.570811 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563860 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563868 2569 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563871 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563874 2569 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563877 2569 flags.go:64] FLAG: --pod-cidr="" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563880 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563885 2569 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563888 2569 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563891 2569 flags.go:64] FLAG: --pods-per-core="0" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563894 2569 flags.go:64] FLAG: --port="10250" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563897 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563901 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01c927f755d257a4e" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563904 2569 flags.go:64] FLAG: --qos-reserved="" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563907 2569 flags.go:64] FLAG: --read-only-port="10255" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563910 2569 flags.go:64] FLAG: --register-node="true" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563913 2569 flags.go:64] FLAG: --register-with-taints="" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563916 2569 flags.go:64] FLAG: --registry-burst="10" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563919 2569 flags.go:64] FLAG: --registry-qps="5" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563922 2569 flags.go:64] FLAG: --reserved-cpus="" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563925 2569 flags.go:64] FLAG: --reserved-memory="" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563928 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563931 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563934 2569 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563937 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563940 2569 flags.go:64] FLAG: --runonce="false" Sep 09 02:25:58.571531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563943 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563946 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563949 2569 flags.go:64] FLAG: --seccomp-default="false" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563952 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563955 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563958 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563961 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563964 2569 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563966 2569 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563969 2569 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563972 2569 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563975 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563978 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563981 2569 flags.go:64] FLAG: --system-cgroups="" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563984 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563989 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.563999 2569 flags.go:64] FLAG: --tls-cert-file="" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564002 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564007 2569 flags.go:64] FLAG: --tls-min-version="" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564010 2569 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564013 2569 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564016 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564019 2569 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564022 2569 flags.go:64] FLAG: --v="2" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564026 2569 flags.go:64] FLAG: --version="false" Sep 09 02:25:58.572182 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564030 2569 flags.go:64] FLAG: --vmodule="" Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564033 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.564036 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565588 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565605 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565609 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565614 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565619 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565623 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565626 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565629 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565633 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565636 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565638 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565641 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565644 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565647 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565649 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565652 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565654 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:58.572813 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565657 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565660 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565662 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565665 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565667 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565670 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565674 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565677 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565679 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565682 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565685 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565687 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565690 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565693 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565695 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565701 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565705 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565708 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565711 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565714 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:58.573350 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565716 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565719 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565722 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565724 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565727 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565730 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565732 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565735 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565738 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565741 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565744 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565746 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565749 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565751 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565754 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565756 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565759 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565763 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565765 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:58.573864 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565768 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565770 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565773 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565775 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565778 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565780 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565783 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565786 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565789 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565794 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565797 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565799 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565802 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565804 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565807 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565810 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565812 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565815 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565818 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565821 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:58.574319 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565823 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565826 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565829 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565831 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565834 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565836 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565839 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565844 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565847 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565850 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565853 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565855 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565858 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565861 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565863 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565866 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565868 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565872 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565876 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:58.574922 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565879 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565883 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565887 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.565890 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.566444 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.573523 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.573539 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.574463 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.574474 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574530 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574535 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574538 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574541 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574545 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:58.575394 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574548 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574551 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574554 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574557 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574562 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574566 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574569 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574572 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574575 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574578 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574581 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574583 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574587 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574589 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574592 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574595 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574597 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574600 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574602 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574605 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:58.575757 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574608 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574610 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574613 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574616 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574620 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574623 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574626 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574628 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574631 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574633 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574636 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574639 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574641 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574644 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574646 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574648 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574651 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574654 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574656 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574659 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574662 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:58.576240 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574664 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574667 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574671 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574674 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574677 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574679 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574682 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574684 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574687 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574690 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574692 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574695 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574698 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574701 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574704 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574707 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574711 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574714 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574717 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:58.576797 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574719 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574722 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574725 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574727 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574730 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574732 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574735 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574737 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574740 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574743 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574745 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574748 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574751 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574753 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574756 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574758 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574761 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574763 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574766 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574768 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:58.577265 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574771 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574773 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574776 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574778 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574780 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574783 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574787 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574791 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574794 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574797 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574800 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574802 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574805 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574808 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:58.577759 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.574812 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574921 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574925 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574929 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574933 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574936 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574939 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574942 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574945 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574948 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574951 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574954 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574956 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574959 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574962 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574964 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574967 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574969 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574972 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574974 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 02:25:58.578102 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574977 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574979 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574983 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574986 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574989 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574992 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574994 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.574998 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575000 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575004 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575006 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575009 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575011 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575014 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575017 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575019 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575022 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575024 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575027 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 02:25:58.578625 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575029 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575032 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575035 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575037 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575040 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575042 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575045 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575047 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575050 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575053 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575055 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575057 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575060 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575062 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575065 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575067 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575070 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575073 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575075 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575078 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 02:25:58.579075 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575081 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575084 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575087 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575091 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575094 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575097 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575099 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575102 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575104 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575107 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575109 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575112 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575114 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575117 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575120 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575122 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575125 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575127 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575130 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 02:25:58.579594 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575132 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575135 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575137 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575140 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575142 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575145 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575147 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575149 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575152 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575154 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575157 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575160 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575162 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575165 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575168 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575170 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575173 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575176 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575179 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575182 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 02:25:58.580056 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575184 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 02:25:58.580554 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:58.575186 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 02:25:58.580554 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.575191 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 02:25:58.580554 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.575308 2569 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 02:25:58.580554 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.578374 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 02:25:58.580554 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.579236 2569 server.go:1019] "Starting client certificate rotation" Sep 09 02:25:58.580554 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.579330 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 02:25:58.580554 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.580020 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 02:25:58.582030 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.582014 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 02:25:58.584973 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.584954 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 02:25:58.594084 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.594064 2569 log.go:25] "Validated CRI v1 runtime API" Sep 09 02:25:58.599399 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.599385 2569 log.go:25] "Validated CRI v1 image API" Sep 09 02:25:58.600240 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.600219 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 02:25:58.604300 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.604283 2569 fs.go:135] Filesystem UUIDs: map[1dbcbbe4-34f2-46f0-a944-ab6ab51cbe0e:/dev/nvme0n1p3 4ed729d4-8736-4fff-b585-7e5670f75229:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 09 02:25:58.604366 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.604300 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 02:25:58.609500 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.609478 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 02:25:58.610756 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.610643 2569 manager.go:216] Machine: {Timestamp:2026-09-09 02:25:58.609403611 +0000 UTC m=+0.332384001 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099511 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f3c39ca63cb0f2b24145b7c2a3c69 SystemUUID:ec2f3c39-ca63-cb0f-2b24-145b7c2a3c69 BootID:5e123752-eeed-4dbf-89c0-3e52e3629458 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1b:c9:4c:98:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1b:c9:4c:98:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:b3:a2:4a:ee:75 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 02:25:58.610756 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.610752 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 02:25:58.610920 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.610866 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 02:25:58.613268 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.613243 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 02:25:58.613419 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.613270 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 02:25:58.613949 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.613939 2569 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 02:25:58.613978 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.613951 2569 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 02:25:58.613978 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.613959 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 02:25:58.614801 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.614790 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 02:25:58.615643 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.615633 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 02:25:58.619360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.619332 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 09 02:25:58.619490 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.619481 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 02:25:58.619522 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.619512 2569 kubelet.go:486] "Attempting to sync node with API server" Sep 09 02:25:58.619549 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.619523 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 02:25:58.619549 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.619540 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 02:25:58.619614 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.619550 2569 kubelet.go:398] "Adding apiserver pod source" Sep 09 02:25:58.619614 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.619559 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 02:25:58.619922 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.619908 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 02:25:58.619998 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.619927 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 02:25:58.622433 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.622412 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 02:25:58.624492 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.624475 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 02:25:58.624586 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.624514 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 02:25:58.625523 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625510 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 02:25:58.625590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625529 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 02:25:58.625590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625538 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 02:25:58.625590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625546 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 02:25:58.625590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625559 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 02:25:58.625590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625567 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 02:25:58.625590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625586 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 02:25:58.625807 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625594 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 02:25:58.625807 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625605 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 02:25:58.625807 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625613 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 02:25:58.625807 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625625 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 02:25:58.625807 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.625634 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 02:25:58.626461 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.626448 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 02:25:58.626529 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.626467 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 02:25:58.628644 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.628614 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 02:25:58.628734 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.628623 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 02:25:58.630451 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.630437 2569 server.go:1268] "Started kubelet" Sep 09 02:25:58.630515 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.630489 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 02:25:58.630638 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.630594 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 02:25:58.630703 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.630690 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 02:25:58.631232 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.631196 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-93.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 02:25:58.631755 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.631714 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 02:25:58.631755 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.631715 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m2p6b" Sep 09 02:25:58.632113 ip-10-0-137-93 systemd[1]: Started Kubernetes Kubelet. Sep 09 02:25:58.632374 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.632150 2569 server.go:310] "Adding debug handlers to kubelet server" Sep 09 02:25:58.635953 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.635936 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 02:25:58.637108 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.637082 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 02:25:58.637683 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.637670 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 02:25:58.638596 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.637952 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:58.638596 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.638142 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m2p6b" Sep 09 02:25:58.639220 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.639198 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 02:25:58.639387 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.639221 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 02:25:58.639387 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.639336 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 02:25:58.639936 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.639919 2569 factory.go:153] Registering CRI-O factory Sep 09 02:25:58.639936 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.639937 2569 factory.go:223] Registration of the crio container factory successfully Sep 09 02:25:58.640048 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.639992 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 02:25:58.640048 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.640000 2569 factory.go:55] Registering systemd factory Sep 09 02:25:58.640048 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.640008 2569 factory.go:223] Registration of the systemd container factory successfully Sep 09 02:25:58.640048 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.640023 2569 factory.go:103] Registering Raw factory Sep 09 02:25:58.640048 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.640036 2569 manager.go:1196] Started watching for new ooms in manager Sep 09 02:25:58.640309 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.640111 2569 reconstruct.go:97] "Volume reconstruction finished" Sep 09 02:25:58.640309 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.640121 2569 reconciler.go:29] "Reconciler: start to sync state" Sep 09 02:25:58.640451 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.640433 2569 manager.go:349] Starting recovery of all containers Sep 09 02:25:58.644358 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.639833 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18d385f3ad7ce253 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-09-09 02:25:58.630408787 +0000 UTC m=+0.353389177,LastTimestamp:2026-09-09 02:25:58.630408787 +0000 UTC m=+0.353389177,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}" Sep 09 02:25:58.645479 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.645451 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 02:25:58.645576 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.645550 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 02:25:58.654574 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.654557 2569 manager.go:354] Recovery completed Sep 09 02:25:58.658675 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.658660 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:58.661128 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.661009 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:58.661180 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.661148 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:58.661180 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.661163 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:58.663079 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.663061 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 02:25:58.663079 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.663075 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 02:25:58.663227 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.663090 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 09 02:25:58.663227 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.663068 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:58.663895 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.663876 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:58.663972 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.663912 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:58.663972 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.663928 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:58.664324 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.664311 2569 policy_none.go:49] "None policy: Start" Sep 09 02:25:58.664407 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.664331 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 02:25:58.664407 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.664361 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 02:25:58.665408 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.665394 2569 policy_none.go:47] "Start" Sep 09 02:25:58.700996 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.700981 2569 manager.go:337] "Starting Device Plugin manager" Sep 09 02:25:58.705739 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.701028 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 02:25:58.705739 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.701042 2569 server.go:87] "Starting device plugin registration server" Sep 09 02:25:58.705739 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.701415 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 02:25:58.705739 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.701428 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 02:25:58.705739 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.701543 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 02:25:58.705739 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.701637 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 02:25:58.705739 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.701648 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 02:25:58.705739 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.703538 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 02:25:58.705739 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.703600 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:58.767576 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.767529 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 02:25:58.768730 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.768713 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 02:25:58.768842 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.768783 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 02:25:58.768842 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.768829 2569 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 02:25:58.768987 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.768939 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 02:25:58.770888 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.770871 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:58.802519 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.802485 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:58.803467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.803452 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:58.803546 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.803484 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:58.803546 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.803495 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:58.803546 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.803519 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-93.ec2.internal" Sep 09 02:25:58.808640 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.808557 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-93.ec2.internal" Sep 09 02:25:58.808640 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.808583 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-93.ec2.internal\": node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:58.823680 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.823653 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:58.869191 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.869157 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"] Sep 09 02:25:58.869363 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.869232 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:58.870648 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.870631 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:58.870717 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.870665 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:58.870717 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.870680 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:58.872100 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.872087 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:58.872240 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.872227 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" Sep 09 02:25:58.872287 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.872254 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:58.873667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.873647 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:58.873769 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.873654 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:58.873769 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.873677 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:58.873769 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.873687 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:58.873769 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.873696 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:58.873769 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.873709 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:58.874874 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.874859 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" Sep 09 02:25:58.874934 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.874901 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 02:25:58.875603 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.875589 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory" Sep 09 02:25:58.875683 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.875613 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 02:25:58.875683 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.875625 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID" Sep 09 02:25:58.888858 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.888840 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-93.ec2.internal\" not found" node="ip-10-0-137-93.ec2.internal" Sep 09 02:25:58.892117 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.892102 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-93.ec2.internal\" not found" node="ip-10-0-137-93.ec2.internal" Sep 09 02:25:58.924334 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:58.924310 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:58.942167 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.942138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c72adec8fe3fae1db9d665be451ec425-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"c72adec8fe3fae1db9d665be451ec425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" Sep 09 02:25:58.942265 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.942169 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72adec8fe3fae1db9d665be451ec425-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"c72adec8fe3fae1db9d665be451ec425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" Sep 09 02:25:58.942265 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:58.942189 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/576b87c7ce5e7cfdcb6002e50599d6cf-config\") pod \"kube-apiserver-proxy-ip-10-0-137-93.ec2.internal\" (UID: \"576b87c7ce5e7cfdcb6002e50599d6cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.025139 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.025111 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:59.042555 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.042526 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c72adec8fe3fae1db9d665be451ec425-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"c72adec8fe3fae1db9d665be451ec425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.042622 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.042571 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72adec8fe3fae1db9d665be451ec425-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"c72adec8fe3fae1db9d665be451ec425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.042622 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.042612 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/576b87c7ce5e7cfdcb6002e50599d6cf-config\") pod \"kube-apiserver-proxy-ip-10-0-137-93.ec2.internal\" (UID: \"576b87c7ce5e7cfdcb6002e50599d6cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.042699 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.042614 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c72adec8fe3fae1db9d665be451ec425-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"c72adec8fe3fae1db9d665be451ec425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.042699 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.042653 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72adec8fe3fae1db9d665be451ec425-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"c72adec8fe3fae1db9d665be451ec425\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.042699 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.042675 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/576b87c7ce5e7cfdcb6002e50599d6cf-config\") pod \"kube-apiserver-proxy-ip-10-0-137-93.ec2.internal\" (UID: \"576b87c7ce5e7cfdcb6002e50599d6cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.126052 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.125976 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:59.191541 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.191499 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.194997 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.194972 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.226159 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.226127 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:59.326727 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.326682 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:59.428485 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.428397 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found" Sep 09 02:25:59.524649 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.524616 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:59.539277 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.539243 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.552305 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.552283 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 02:25:59.554188 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.554172 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" Sep 09 02:25:59.566148 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.566130 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 02:25:59.577625 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.577592 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:59.578832 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.578817 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 02:25:59.578948 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.578930 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 02:25:59.579018 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.578991 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 02:25:59.621356 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.621313 2569 apiserver.go:52] "Watching apiserver" Sep 09 02:25:59.637543 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.637514 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 02:25:59.641676 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.641653 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 02:25:59.642605 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.642584 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-bvxwv","kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal","openshift-dns/node-resolver-kc97x","openshift-image-registry/node-ca-mcbbx","openshift-multus/multus-6qvsx","openshift-multus/multus-additional-cni-plugins-nmccn","openshift-multus/network-metrics-daemon-2x72t","openshift-network-diagnostics/network-check-target-hfwfs","openshift-network-operator/iptables-alerter-fsldb","kube-system/global-pull-secret-syncer-kbfm9","kube-system/konnectivity-agent-xfhtn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl","openshift-cluster-node-tuning-operator/tuned-8kswd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"] Sep 09 02:25:59.644090 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.644072 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:25:59.644184 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.644161 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:25:59.644674 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.644648 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 02:20:59 +0000 UTC" deadline="2028-06-10 10:35:43.820377136 +0000 UTC" Sep 09 02:25:59.644735 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.644674 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15368h9m44.175706395s" Sep 09 02:25:59.645274 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.645259 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.646478 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.646459 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.647472 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.647449 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4n4xn\"" Sep 09 02:25:59.647584 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.647506 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 02:25:59.647584 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.647539 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 02:25:59.648051 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.648035 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.648583 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.648550 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 02:25:59.648694 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.648666 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n4m9s\"" Sep 09 02:25:59.648762 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.648713 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 02:25:59.649127 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.649109 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 02:25:59.649333 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.649318 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.649874 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.649852 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 02:25:59.649959 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.649945 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 02:25:59.649959 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.649952 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-752n6\"" Sep 09 02:25:59.650091 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.650077 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 02:25:59.650570 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.650556 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.651196 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.651180 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 02:25:59.651332 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.651317 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 02:25:59.651563 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.651543 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pqtjm\"" Sep 09 02:25:59.652063 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.652044 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 02:25:59.652147 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.652062 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 02:25:59.652188 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.652175 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.652503 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.652485 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 02:25:59.653004 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.652982 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 02:25:59.653492 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.653472 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2t5sf\"" Sep 09 02:25:59.654114 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.654089 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.654228 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.654202 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 02:25:59.655299 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.655267 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 02:25:59.655299 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.655297 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gcgzc\"" Sep 09 02:25:59.655485 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.655327 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 02:25:59.656761 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.656287 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 02:25:59.656761 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.656530 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 02:25:59.657636 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.657398 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 02:25:59.657636 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.657444 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 02:25:59.657636 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.657506 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 02:25:59.657636 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.657447 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 02:25:59.657636 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.657556 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:25:59.657636 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.657603 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cz8cv\"" Sep 09 02:25:59.657895 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.657642 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:25:59.658831 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.658810 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:25:59.658915 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.658866 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:25:59.660791 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.660764 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:25:59.662127 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.662104 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.662752 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.662735 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 02:25:59.662875 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.662837 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gmlff\"" Sep 09 02:25:59.662947 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.662919 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 02:25:59.663985 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.663970 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 02:25:59.664274 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.664258 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 02:25:59.664400 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.664384 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 02:25:59.664482 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.664460 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-drsnw\"" Sep 09 02:25:59.677621 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.677599 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqxx7" Sep 09 02:25:59.685579 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.685517 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqxx7" Sep 09 02:25:59.705808 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.705785 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:25:59.740728 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.740695 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 02:25:59.745922 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.745895 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-kubernetes\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.745922 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.745924 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43d88f6a-ba0e-4603-9b80-a6617febcd3b-tmp\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.746132 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.745945 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-daemon-config\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.746132 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.745966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wtj\" (UniqueName: \"kubernetes.io/projected/2786b854-1597-4011-953d-901c9a9f3ac0-kube-api-access-v4wtj\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.746132 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.745994 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbpjd\" (UniqueName: \"kubernetes.io/projected/c2eeff9d-2af5-4698-b31e-a2da5332bf94-kube-api-access-hbpjd\") pod \"iptables-alerter-fsldb\" (UID: \"c2eeff9d-2af5-4698-b31e-a2da5332bf94\") " pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.746132 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746050 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.746132 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746087 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2eeff9d-2af5-4698-b31e-a2da5332bf94-host-slash\") pod \"iptables-alerter-fsldb\" (UID: \"c2eeff9d-2af5-4698-b31e-a2da5332bf94\") " pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.746132 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746132 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-run-netns\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746153 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746178 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9424a69c-24c6-46e6-9912-93ec9e2f66dc-ovnkube-config\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-sysctl-conf\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746243 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mm86\" (UniqueName: \"kubernetes.io/projected/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-kube-api-access-4mm86\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746283 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2786b854-1597-4011-953d-901c9a9f3ac0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746315 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2786b854-1597-4011-953d-901c9a9f3ac0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746337 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2786b854-1597-4011-953d-901c9a9f3ac0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746360 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-cni-netd\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746397 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746414 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-socket-dir-parent\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.746422 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-hostroot\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746450 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2eeff9d-2af5-4698-b31e-a2da5332bf94-iptables-alerter-script\") pod \"iptables-alerter-fsldb\" (UID: \"c2eeff9d-2af5-4698-b31e-a2da5332bf94\") " pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746484 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-cnibin\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746506 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-var-lib-kubelet\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746541 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e63eaf31-cde7-4a3a-8860-052cfee574c8-agent-certs\") pod \"konnectivity-agent-xfhtn\" (UID: \"e63eaf31-cde7-4a3a-8860-052cfee574c8\") " pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746569 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-socket-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746589 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-sys-fs\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746603 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-run-ovn\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746643 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2786b854-1597-4011-953d-901c9a9f3ac0-system-cni-dir\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746663 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-var-lib-openvswitch\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-cni-bin\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746699 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-host\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746717 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-var-lib-cni-multus\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746735 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-run-multus-certs\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746775 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2786b854-1597-4011-953d-901c9a9f3ac0-cni-binary-copy\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-systemd-units\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.746849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746828 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9424a69c-24c6-46e6-9912-93ec9e2f66dc-ovnkube-script-lib\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.747537 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746842 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-sysconfig\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.747537 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.746857 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-lib-modules\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.747537 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.747317 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-cni-dir\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.747862 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.747827 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e63eaf31-cde7-4a3a-8860-052cfee574c8-konnectivity-ca\") pod \"konnectivity-agent-xfhtn\" (UID: \"e63eaf31-cde7-4a3a-8860-052cfee574c8\") " pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:25:59.747916 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.747890 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvqbx\" (UniqueName: \"kubernetes.io/projected/5a3cd069-358f-444f-96eb-84db2024650a-kube-api-access-jvqbx\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.747968 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.747926 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nssm8\" (UniqueName: \"kubernetes.io/projected/448e25db-e22b-482b-9fa8-b81898d97a32-kube-api-access-nssm8\") pod \"node-resolver-kc97x\" (UID: \"448e25db-e22b-482b-9fa8-b81898d97a32\") " pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.748019 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.747988 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-run\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.748073 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748016 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrwd\" (UniqueName: \"kubernetes.io/projected/8fad9731-782f-46cb-a223-117f6b98abba-kube-api-access-bjrwd\") pod \"node-ca-mcbbx\" (UID: \"8fad9731-782f-46cb-a223-117f6b98abba\") " pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.748073 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-kubelet\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.748165 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748080 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c76f9c4-ed70-493b-b740-8d39b521b632-dbus\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:25:59.748165 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748116 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-systemd\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.748165 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748151 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-run-netns\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.748304 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748177 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-conf-dir\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.748304 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-device-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.748304 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748237 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-run-openvswitch\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.748304 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748267 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fad9731-782f-46cb-a223-117f6b98abba-serviceca\") pod \"node-ca-mcbbx\" (UID: \"8fad9731-782f-46cb-a223-117f6b98abba\") " pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.748511 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748412 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2786b854-1597-4011-953d-901c9a9f3ac0-cnibin\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.748561 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748511 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-etc-openvswitch\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.748613 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-var-lib-cni-bin\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.748666 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748619 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-etc-kubernetes\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.748720 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748665 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.748720 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748709 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-slash\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.748818 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748738 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-run-systemd\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.748818 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748767 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-cni-binary-copy\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.748818 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748809 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fad9731-782f-46cb-a223-117f6b98abba-host\") pod \"node-ca-mcbbx\" (UID: \"8fad9731-782f-46cb-a223-117f6b98abba\") " pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.748968 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748837 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-node-log\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.748968 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748867 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:25:59.748968 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748894 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-modprobe-d\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.748968 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748951 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-sys\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.749156 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.748981 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-var-lib-kubelet\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.749156 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749043 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-tuned\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.749156 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749072 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/448e25db-e22b-482b-9fa8-b81898d97a32-tmp-dir\") pod \"node-resolver-kc97x\" (UID: \"448e25db-e22b-482b-9fa8-b81898d97a32\") " pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.749353 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749250 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-log-socket\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.749353 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749282 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.749353 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749315 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9424a69c-24c6-46e6-9912-93ec9e2f66dc-ovn-node-metrics-cert\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.749529 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749390 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvpfg\" (UniqueName: \"kubernetes.io/projected/9424a69c-24c6-46e6-9912-93ec9e2f66dc-kube-api-access-hvpfg\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.749529 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749439 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqd9r\" (UniqueName: \"kubernetes.io/projected/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-kube-api-access-jqd9r\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:25:59.749627 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749542 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-run-k8s-cni-cncf-io\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.749627 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749584 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/448e25db-e22b-482b-9fa8-b81898d97a32-hosts-file\") pod \"node-resolver-kc97x\" (UID: \"448e25db-e22b-482b-9fa8-b81898d97a32\") " pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.749627 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749613 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9424a69c-24c6-46e6-9912-93ec9e2f66dc-env-overrides\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.749769 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749671 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c76f9c4-ed70-493b-b740-8d39b521b632-kubelet-config\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:25:59.749769 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749718 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-sysctl-d\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.749865 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749776 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-system-cni-dir\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.749865 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749827 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:25:59.749966 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749884 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnxnp\" (UniqueName: \"kubernetes.io/projected/43d88f6a-ba0e-4603-9b80-a6617febcd3b-kube-api-access-hnxnp\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.749966 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.749915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-registration-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.846979 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:59.846924 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576b87c7ce5e7cfdcb6002e50599d6cf.slice/crio-d2bb7020a4688acf54cafb216ac5f1c136825a29fb315a118284bdfb78d2477a WatchSource:0}: Error finding container d2bb7020a4688acf54cafb216ac5f1c136825a29fb315a118284bdfb78d2477a: Status 404 returned error can't find the container with id d2bb7020a4688acf54cafb216ac5f1c136825a29fb315a118284bdfb78d2477a Sep 09 02:25:59.847679 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:59.847650 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72adec8fe3fae1db9d665be451ec425.slice/crio-0344e606bda26eb57bb8c54c0c4626debbabd16fbde4fd8c3eb6807cceb4ff7d WatchSource:0}: Error finding container 0344e606bda26eb57bb8c54c0c4626debbabd16fbde4fd8c3eb6807cceb4ff7d: Status 404 returned error can't find the container with id 0344e606bda26eb57bb8c54c0c4626debbabd16fbde4fd8c3eb6807cceb4ff7d Sep 09 02:25:59.850985 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.850959 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fad9731-782f-46cb-a223-117f6b98abba-host\") pod \"node-ca-mcbbx\" (UID: \"8fad9731-782f-46cb-a223-117f6b98abba\") " pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.851064 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.850993 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-node-log\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.851064 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851021 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:25:59.851064 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851058 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-modprobe-d\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851197 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851072 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fad9731-782f-46cb-a223-117f6b98abba-host\") pod \"node-ca-mcbbx\" (UID: \"8fad9731-782f-46cb-a223-117f6b98abba\") " pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.851197 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851119 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-node-log\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.851197 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851173 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-modprobe-d\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851197 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.851184 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:59.851197 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-sys\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851218 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-var-lib-kubelet\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851245 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-tuned\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851219 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-sys\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851259 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-var-lib-kubelet\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.851268 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret podName:9c76f9c4-ed70-493b-b740-8d39b521b632 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:00.351245533 +0000 UTC m=+2.074225936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret") pod "global-pull-secret-syncer-kbfm9" (UID: "9c76f9c4-ed70-493b-b740-8d39b521b632") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/448e25db-e22b-482b-9fa8-b81898d97a32-tmp-dir\") pod \"node-resolver-kc97x\" (UID: \"448e25db-e22b-482b-9fa8-b81898d97a32\") " pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851327 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-log-socket\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851350 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851393 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-log-socket\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851412 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9424a69c-24c6-46e6-9912-93ec9e2f66dc-ovn-node-metrics-cert\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.851467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851453 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvpfg\" (UniqueName: \"kubernetes.io/projected/9424a69c-24c6-46e6-9912-93ec9e2f66dc-kube-api-access-hvpfg\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851473 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851590 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqd9r\" (UniqueName: \"kubernetes.io/projected/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-kube-api-access-jqd9r\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851623 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-run-k8s-cni-cncf-io\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851648 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/448e25db-e22b-482b-9fa8-b81898d97a32-hosts-file\") pod \"node-resolver-kc97x\" (UID: \"448e25db-e22b-482b-9fa8-b81898d97a32\") " pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851677 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9424a69c-24c6-46e6-9912-93ec9e2f66dc-env-overrides\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851704 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/448e25db-e22b-482b-9fa8-b81898d97a32-tmp-dir\") pod \"node-resolver-kc97x\" (UID: \"448e25db-e22b-482b-9fa8-b81898d97a32\") " pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851722 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c76f9c4-ed70-493b-b740-8d39b521b632-kubelet-config\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851754 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-sysctl-d\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851778 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-system-cni-dir\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851805 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851810 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c76f9c4-ed70-493b-b740-8d39b521b632-kubelet-config\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851822 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/448e25db-e22b-482b-9fa8-b81898d97a32-hosts-file\") pod \"node-resolver-kc97x\" (UID: \"448e25db-e22b-482b-9fa8-b81898d97a32\") " pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851832 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnxnp\" (UniqueName: \"kubernetes.io/projected/43d88f6a-ba0e-4603-9b80-a6617febcd3b-kube-api-access-hnxnp\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851857 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-registration-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851882 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-kubernetes\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851905 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-sysctl-d\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.851999 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851914 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43d88f6a-ba0e-4603-9b80-a6617febcd3b-tmp\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851918 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-system-cni-dir\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851721 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-run-k8s-cni-cncf-io\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851939 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-daemon-config\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.851995 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-kubernetes\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852030 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wtj\" (UniqueName: \"kubernetes.io/projected/2786b854-1597-4011-953d-901c9a9f3ac0-kube-api-access-v4wtj\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852033 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852063 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbpjd\" (UniqueName: \"kubernetes.io/projected/c2eeff9d-2af5-4698-b31e-a2da5332bf94-kube-api-access-hbpjd\") pod \"iptables-alerter-fsldb\" (UID: \"c2eeff9d-2af5-4698-b31e-a2da5332bf94\") " pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852085 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-registration-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852190 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9424a69c-24c6-46e6-9912-93ec9e2f66dc-env-overrides\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852582 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852621 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2eeff9d-2af5-4698-b31e-a2da5332bf94-host-slash\") pod \"iptables-alerter-fsldb\" (UID: \"c2eeff9d-2af5-4698-b31e-a2da5332bf94\") " pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852670 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-run-netns\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852699 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852720 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9424a69c-24c6-46e6-9912-93ec9e2f66dc-ovnkube-config\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.852747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852727 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-daemon-config\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852777 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852803 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2eeff9d-2af5-4698-b31e-a2da5332bf94-host-slash\") pod \"iptables-alerter-fsldb\" (UID: \"c2eeff9d-2af5-4698-b31e-a2da5332bf94\") " pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852824 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852840 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-sysctl-conf\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852853 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-run-netns\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852938 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-sysctl-conf\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.852965 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mm86\" (UniqueName: \"kubernetes.io/projected/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-kube-api-access-4mm86\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853079 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2786b854-1597-4011-953d-901c9a9f3ac0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853299 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2786b854-1597-4011-953d-901c9a9f3ac0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853326 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9424a69c-24c6-46e6-9912-93ec9e2f66dc-ovnkube-config\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853329 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2786b854-1597-4011-953d-901c9a9f3ac0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853250 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2786b854-1597-4011-953d-901c9a9f3ac0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.853389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853389 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-cni-netd\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853459 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853490 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-socket-dir-parent\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853492 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-cni-netd\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853517 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-hostroot\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853542 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2eeff9d-2af5-4698-b31e-a2da5332bf94-iptables-alerter-script\") pod \"iptables-alerter-fsldb\" (UID: \"c2eeff9d-2af5-4698-b31e-a2da5332bf94\") " pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853566 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-cnibin\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.853573 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853590 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-var-lib-kubelet\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.853627 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs podName:b35c6a8a-f317-44f5-beab-f0c46fd31ee5 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:00.353606822 +0000 UTC m=+2.076587200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs") pod "network-metrics-daemon-2x72t" (UID: "b35c6a8a-f317-44f5-beab-f0c46fd31ee5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853647 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e63eaf31-cde7-4a3a-8860-052cfee574c8-agent-certs\") pod \"konnectivity-agent-xfhtn\" (UID: \"e63eaf31-cde7-4a3a-8860-052cfee574c8\") " pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853658 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-var-lib-kubelet\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853675 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-socket-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853701 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-sys-fs\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853721 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-socket-dir-parent\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853727 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-run-ovn\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853751 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2786b854-1597-4011-953d-901c9a9f3ac0-system-cni-dir\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.854329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853768 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-hostroot\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-var-lib-openvswitch\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853796 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-cni-bin\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853819 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-host\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853840 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-var-lib-cni-multus\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853849 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-cnibin\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853866 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-run-multus-certs\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853893 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2786b854-1597-4011-953d-901c9a9f3ac0-cni-binary-copy\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853907 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2786b854-1597-4011-953d-901c9a9f3ac0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853920 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-systemd-units\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9424a69c-24c6-46e6-9912-93ec9e2f66dc-ovnkube-script-lib\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853990 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-sysconfig\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853984 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-run-ovn\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854033 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-lib-modules\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854037 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-socket-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854062 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-cni-dir\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854070 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-sys-fs\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.855236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854087 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e63eaf31-cde7-4a3a-8860-052cfee574c8-konnectivity-ca\") pod \"konnectivity-agent-xfhtn\" (UID: \"e63eaf31-cde7-4a3a-8860-052cfee574c8\") " pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854090 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2786b854-1597-4011-953d-901c9a9f3ac0-system-cni-dir\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854115 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqbx\" (UniqueName: \"kubernetes.io/projected/5a3cd069-358f-444f-96eb-84db2024650a-kube-api-access-jvqbx\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854143 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nssm8\" (UniqueName: \"kubernetes.io/projected/448e25db-e22b-482b-9fa8-b81898d97a32-kube-api-access-nssm8\") pod \"node-resolver-kc97x\" (UID: \"448e25db-e22b-482b-9fa8-b81898d97a32\") " pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854145 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-systemd-units\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854182 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-run\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854210 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-cni-bin\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854215 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrwd\" (UniqueName: \"kubernetes.io/projected/8fad9731-782f-46cb-a223-117f6b98abba-kube-api-access-bjrwd\") pod \"node-ca-mcbbx\" (UID: \"8fad9731-782f-46cb-a223-117f6b98abba\") " pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854243 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-kubelet\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854265 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-run-multus-certs\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c76f9c4-ed70-493b-b740-8d39b521b632-dbus\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854290 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854309 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-systemd\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854328 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c76f9c4-ed70-493b-b740-8d39b521b632-dbus\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854359 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-run-netns\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854814 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2eeff9d-2af5-4698-b31e-a2da5332bf94-iptables-alerter-script\") pod \"iptables-alerter-fsldb\" (UID: \"c2eeff9d-2af5-4698-b31e-a2da5332bf94\") " pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854882 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-var-lib-cni-multus\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854917 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e63eaf31-cde7-4a3a-8860-052cfee574c8-konnectivity-ca\") pod \"konnectivity-agent-xfhtn\" (UID: \"e63eaf31-cde7-4a3a-8860-052cfee574c8\") " pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:25:59.856136 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854930 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2786b854-1597-4011-953d-901c9a9f3ac0-cni-binary-copy\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854943 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-cni-dir\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.853904 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-var-lib-openvswitch\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.854982 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-conf-dir\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855015 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-device-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855021 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-systemd\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855044 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-run-openvswitch\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855069 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-sysconfig\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855067 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-run-netns\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855072 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fad9731-782f-46cb-a223-117f6b98abba-serviceca\") pod \"node-ca-mcbbx\" (UID: \"8fad9731-782f-46cb-a223-117f6b98abba\") " pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855127 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2786b854-1597-4011-953d-901c9a9f3ac0-cnibin\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855162 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-etc-openvswitch\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855168 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-host\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855194 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-var-lib-cni-bin\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855238 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-etc-kubernetes\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855266 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855294 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-slash\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855320 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-run-systemd\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.857085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855347 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-cni-binary-copy\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855488 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9424a69c-24c6-46e6-9912-93ec9e2f66dc-ovnkube-script-lib\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855597 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-lib-modules\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855636 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fad9731-782f-46cb-a223-117f6b98abba-serviceca\") pod \"node-ca-mcbbx\" (UID: \"8fad9731-782f-46cb-a223-117f6b98abba\") " pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855645 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2786b854-1597-4011-953d-901c9a9f3ac0-cnibin\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855687 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/43d88f6a-ba0e-4603-9b80-a6617febcd3b-run\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855688 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-etc-openvswitch\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855724 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-kubelet\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855752 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-host-var-lib-cni-bin\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855912 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855921 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-cni-binary-copy\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855954 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-etc-kubernetes\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.855984 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-host-slash\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.856014 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a3cd069-358f-444f-96eb-84db2024650a-device-dir\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.856030 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-run-systemd\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.856060 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9424a69c-24c6-46e6-9912-93ec9e2f66dc-run-openvswitch\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.856119 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-multus-conf-dir\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.856254 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/43d88f6a-ba0e-4603-9b80-a6617febcd3b-etc-tuned\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.858115 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.856295 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43d88f6a-ba0e-4603-9b80-a6617febcd3b-tmp\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.858707 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.856860 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2786b854-1597-4011-953d-901c9a9f3ac0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.858707 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.856889 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e63eaf31-cde7-4a3a-8860-052cfee574c8-agent-certs\") pod \"konnectivity-agent-xfhtn\" (UID: \"e63eaf31-cde7-4a3a-8860-052cfee574c8\") " pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:25:59.858707 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.858190 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9424a69c-24c6-46e6-9912-93ec9e2f66dc-ovn-node-metrics-cert\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.859010 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.858991 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:25:59.859051 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.859016 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:25:59.859051 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.859032 2569 projected.go:196] Error preparing data for projected volume kube-api-access-zqfwm for pod openshift-network-diagnostics/network-check-target-hfwfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:59.859136 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:25:59.859109 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm podName:ace583ca-20c8-40bf-a3fa-aec1bf334eeb nodeName:}" failed. No retries permitted until 2026-09-09 02:26:00.359091156 +0000 UTC m=+2.082071534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zqfwm" (UniqueName: "kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm") pod "network-check-target-hfwfs" (UID: "ace583ca-20c8-40bf-a3fa-aec1bf334eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:25:59.862767 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.862740 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mm86\" (UniqueName: \"kubernetes.io/projected/0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28-kube-api-access-4mm86\") pod \"multus-6qvsx\" (UID: \"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28\") " pod="openshift-multus/multus-6qvsx" Sep 09 02:25:59.863255 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.863207 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnxnp\" (UniqueName: \"kubernetes.io/projected/43d88f6a-ba0e-4603-9b80-a6617febcd3b-kube-api-access-hnxnp\") pod \"tuned-8kswd\" (UID: \"43d88f6a-ba0e-4603-9b80-a6617febcd3b\") " pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.863408 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.863381 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbpjd\" (UniqueName: \"kubernetes.io/projected/c2eeff9d-2af5-4698-b31e-a2da5332bf94-kube-api-access-hbpjd\") pod \"iptables-alerter-fsldb\" (UID: \"c2eeff9d-2af5-4698-b31e-a2da5332bf94\") " pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:25:59.864068 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.864032 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nssm8\" (UniqueName: \"kubernetes.io/projected/448e25db-e22b-482b-9fa8-b81898d97a32-kube-api-access-nssm8\") pod \"node-resolver-kc97x\" (UID: \"448e25db-e22b-482b-9fa8-b81898d97a32\") " pod="openshift-dns/node-resolver-kc97x" Sep 09 02:25:59.864361 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.864335 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqd9r\" (UniqueName: \"kubernetes.io/projected/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-kube-api-access-jqd9r\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:25:59.864448 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.864381 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqbx\" (UniqueName: \"kubernetes.io/projected/5a3cd069-358f-444f-96eb-84db2024650a-kube-api-access-jvqbx\") pod \"aws-ebs-csi-driver-node-ngrdl\" (UID: \"5a3cd069-358f-444f-96eb-84db2024650a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:25:59.864510 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.864495 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wtj\" (UniqueName: \"kubernetes.io/projected/2786b854-1597-4011-953d-901c9a9f3ac0-kube-api-access-v4wtj\") pod \"multus-additional-cni-plugins-nmccn\" (UID: \"2786b854-1597-4011-953d-901c9a9f3ac0\") " pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:25:59.865022 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.865001 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvpfg\" (UniqueName: \"kubernetes.io/projected/9424a69c-24c6-46e6-9912-93ec9e2f66dc-kube-api-access-hvpfg\") pod \"ovnkube-node-bvxwv\" (UID: \"9424a69c-24c6-46e6-9912-93ec9e2f66dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:25:59.865106 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.865086 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrwd\" (UniqueName: \"kubernetes.io/projected/8fad9731-782f-46cb-a223-117f6b98abba-kube-api-access-bjrwd\") pod \"node-ca-mcbbx\" (UID: \"8fad9731-782f-46cb-a223-117f6b98abba\") " pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:25:59.978015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.977918 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kswd" Sep 09 02:25:59.988990 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:25:59.988960 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d88f6a_ba0e_4603_9b80_a6617febcd3b.slice/crio-68fbf2b358dc53cf80c1abd314b2ed011a2a2b46cbf1cac17a8f37cd2467d02a WatchSource:0}: Error finding container 68fbf2b358dc53cf80c1abd314b2ed011a2a2b46cbf1cac17a8f37cd2467d02a: Status 404 returned error can't find the container with id 68fbf2b358dc53cf80c1abd314b2ed011a2a2b46cbf1cac17a8f37cd2467d02a Sep 09 02:25:59.992390 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:25:59.992366 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kc97x" Sep 09 02:26:00.001231 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:00.001204 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448e25db_e22b_482b_9fa8_b81898d97a32.slice/crio-e91bcf43ab40e3ad54e2b67644110f721d6da76b4aa3175e02f06f5ac6bb7da7 WatchSource:0}: Error finding container e91bcf43ab40e3ad54e2b67644110f721d6da76b4aa3175e02f06f5ac6bb7da7: Status 404 returned error can't find the container with id e91bcf43ab40e3ad54e2b67644110f721d6da76b4aa3175e02f06f5ac6bb7da7 Sep 09 02:26:00.009940 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.009912 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mcbbx" Sep 09 02:26:00.018985 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:00.018956 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fad9731_782f_46cb_a223_117f6b98abba.slice/crio-63a0512c79aed581edaf90f32685ff84c92148647a93261c585496fa3b041146 WatchSource:0}: Error finding container 63a0512c79aed581edaf90f32685ff84c92148647a93261c585496fa3b041146: Status 404 returned error can't find the container with id 63a0512c79aed581edaf90f32685ff84c92148647a93261c585496fa3b041146 Sep 09 02:26:00.020718 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.020695 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qvsx" Sep 09 02:26:00.031391 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:00.031363 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e42ce9b_1ffa_4e30_9a17_dc9b16abcc28.slice/crio-3b79afc8e15b3f9b818d6964025dfca305827cd6d35dfd5a2a7b2b28dc147870 WatchSource:0}: Error finding container 3b79afc8e15b3f9b818d6964025dfca305827cd6d35dfd5a2a7b2b28dc147870: Status 404 returned error can't find the container with id 3b79afc8e15b3f9b818d6964025dfca305827cd6d35dfd5a2a7b2b28dc147870 Sep 09 02:26:00.038397 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.038376 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nmccn" Sep 09 02:26:00.047242 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:00.047207 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2786b854_1597_4011_953d_901c9a9f3ac0.slice/crio-666b16eee31571dcdf30c161a682d1d1a05e6f01a2d64f17362922b7d4569b67 WatchSource:0}: Error finding container 666b16eee31571dcdf30c161a682d1d1a05e6f01a2d64f17362922b7d4569b67: Status 404 returned error can't find the container with id 666b16eee31571dcdf30c161a682d1d1a05e6f01a2d64f17362922b7d4569b67 Sep 09 02:26:00.052987 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.052968 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fsldb" Sep 09 02:26:00.061562 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:00.061537 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2eeff9d_2af5_4698_b31e_a2da5332bf94.slice/crio-289461718efa40a758b57a9d90128f145ad0f8ca1eb682dce03b3fd630320b38 WatchSource:0}: Error finding container 289461718efa40a758b57a9d90128f145ad0f8ca1eb682dce03b3fd630320b38: Status 404 returned error can't find the container with id 289461718efa40a758b57a9d90128f145ad0f8ca1eb682dce03b3fd630320b38 Sep 09 02:26:00.068358 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.068334 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:26:00.079149 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:00.078975 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9424a69c_24c6_46e6_9912_93ec9e2f66dc.slice/crio-8254015a85ae8df20806d5f6398ab14024a05eb5246b7964cac79c38bef1c0c1 WatchSource:0}: Error finding container 8254015a85ae8df20806d5f6398ab14024a05eb5246b7964cac79c38bef1c0c1: Status 404 returned error can't find the container with id 8254015a85ae8df20806d5f6398ab14024a05eb5246b7964cac79c38bef1c0c1 Sep 09 02:26:00.084517 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.084499 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:26:00.090598 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.090576 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" Sep 09 02:26:00.094603 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:00.094575 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63eaf31_cde7_4a3a_8860_052cfee574c8.slice/crio-e3f8b69a1bc091509a3a119fc17be76f976de962569c2c7d196883f76590e09d WatchSource:0}: Error finding container e3f8b69a1bc091509a3a119fc17be76f976de962569c2c7d196883f76590e09d: Status 404 returned error can't find the container with id e3f8b69a1bc091509a3a119fc17be76f976de962569c2c7d196883f76590e09d Sep 09 02:26:00.099323 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:00.099296 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3cd069_358f_444f_96eb_84db2024650a.slice/crio-b682027252e5aac697b202195ad4b368007442ecb743e4167548a185c0e2b941 WatchSource:0}: Error finding container b682027252e5aac697b202195ad4b368007442ecb743e4167548a185c0e2b941: Status 404 returned error can't find the container with id b682027252e5aac697b202195ad4b368007442ecb743e4167548a185c0e2b941 Sep 09 02:26:00.360025 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.359986 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:00.360231 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.360040 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:00.360231 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.360070 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:00.360231 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:00.360164 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:00.360231 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:00.360189 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:00.360231 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:00.360235 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs podName:b35c6a8a-f317-44f5-beab-f0c46fd31ee5 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:01.360219072 +0000 UTC m=+3.083199450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs") pod "network-metrics-daemon-2x72t" (UID: "b35c6a8a-f317-44f5-beab-f0c46fd31ee5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:00.360569 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:00.360251 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret podName:9c76f9c4-ed70-493b-b740-8d39b521b632 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:01.360243567 +0000 UTC m=+3.083223945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret") pod "global-pull-secret-syncer-kbfm9" (UID: "9c76f9c4-ed70-493b-b740-8d39b521b632") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:00.360569 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:00.360334 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:26:00.360569 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:00.360349 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:26:00.360569 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:00.360362 2569 projected.go:196] Error preparing data for projected volume kube-api-access-zqfwm for pod openshift-network-diagnostics/network-check-target-hfwfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:00.360569 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:00.360417 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm podName:ace583ca-20c8-40bf-a3fa-aec1bf334eeb nodeName:}" failed. No retries permitted until 2026-09-09 02:26:01.36040491 +0000 UTC m=+3.083385310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqfwm" (UniqueName: "kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm") pod "network-check-target-hfwfs" (UID: "ace583ca-20c8-40bf-a3fa-aec1bf334eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:00.529553 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.529510 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:26:00.687706 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.687589 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 02:21:00 +0000 UTC" deadline="2028-06-07 11:33:30.065310426 +0000 UTC" Sep 09 02:26:00.687706 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.687656 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15297h7m29.377658534s" Sep 09 02:26:00.813533 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.813359 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xfhtn" event={"ID":"e63eaf31-cde7-4a3a-8860-052cfee574c8","Type":"ContainerStarted","Data":"e3f8b69a1bc091509a3a119fc17be76f976de962569c2c7d196883f76590e09d"} Sep 09 02:26:00.831817 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.831605 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fsldb" event={"ID":"c2eeff9d-2af5-4698-b31e-a2da5332bf94","Type":"ContainerStarted","Data":"289461718efa40a758b57a9d90128f145ad0f8ca1eb682dce03b3fd630320b38"} Sep 09 02:26:00.851541 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.851497 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mcbbx" event={"ID":"8fad9731-782f-46cb-a223-117f6b98abba","Type":"ContainerStarted","Data":"63a0512c79aed581edaf90f32685ff84c92148647a93261c585496fa3b041146"} Sep 09 02:26:00.864893 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.864852 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"c72adec8fe3fae1db9d665be451ec425","Type":"ContainerStarted","Data":"0344e606bda26eb57bb8c54c0c4626debbabd16fbde4fd8c3eb6807cceb4ff7d"} Sep 09 02:26:00.872843 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.872682 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerStarted","Data":"8254015a85ae8df20806d5f6398ab14024a05eb5246b7964cac79c38bef1c0c1"} Sep 09 02:26:00.879437 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.876979 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmccn" event={"ID":"2786b854-1597-4011-953d-901c9a9f3ac0","Type":"ContainerStarted","Data":"666b16eee31571dcdf30c161a682d1d1a05e6f01a2d64f17362922b7d4569b67"} Sep 09 02:26:00.896029 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.895985 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qvsx" event={"ID":"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28","Type":"ContainerStarted","Data":"3b79afc8e15b3f9b818d6964025dfca305827cd6d35dfd5a2a7b2b28dc147870"} Sep 09 02:26:00.902288 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.902242 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kc97x" event={"ID":"448e25db-e22b-482b-9fa8-b81898d97a32","Type":"ContainerStarted","Data":"e91bcf43ab40e3ad54e2b67644110f721d6da76b4aa3175e02f06f5ac6bb7da7"} Sep 09 02:26:00.927680 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.927639 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kswd" event={"ID":"43d88f6a-ba0e-4603-9b80-a6617febcd3b","Type":"ContainerStarted","Data":"68fbf2b358dc53cf80c1abd314b2ed011a2a2b46cbf1cac17a8f37cd2467d02a"} Sep 09 02:26:00.935652 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.933442 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" event={"ID":"576b87c7ce5e7cfdcb6002e50599d6cf","Type":"ContainerStarted","Data":"d2bb7020a4688acf54cafb216ac5f1c136825a29fb315a118284bdfb78d2477a"} Sep 09 02:26:00.935652 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:00.935492 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" event={"ID":"5a3cd069-358f-444f-96eb-84db2024650a","Type":"ContainerStarted","Data":"b682027252e5aac697b202195ad4b368007442ecb743e4167548a185c0e2b941"} Sep 09 02:26:01.368167 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:01.368121 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:01.368430 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:01.368201 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:01.368430 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:01.368241 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:01.368430 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.368387 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:26:01.368430 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.368411 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:26:01.368430 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.368425 2569 projected.go:196] Error preparing data for projected volume kube-api-access-zqfwm for pod openshift-network-diagnostics/network-check-target-hfwfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:01.368722 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.368490 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm podName:ace583ca-20c8-40bf-a3fa-aec1bf334eeb nodeName:}" failed. No retries permitted until 2026-09-09 02:26:03.368470436 +0000 UTC m=+5.091450818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqfwm" (UniqueName: "kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm") pod "network-check-target-hfwfs" (UID: "ace583ca-20c8-40bf-a3fa-aec1bf334eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:01.368722 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.368496 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:01.368722 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.368537 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs podName:b35c6a8a-f317-44f5-beab-f0c46fd31ee5 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:03.368525795 +0000 UTC m=+5.091506188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs") pod "network-metrics-daemon-2x72t" (UID: "b35c6a8a-f317-44f5-beab-f0c46fd31ee5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:01.368722 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.368593 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:01.368722 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.368626 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret podName:9c76f9c4-ed70-493b-b740-8d39b521b632 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:03.368614542 +0000 UTC m=+5.091594934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret") pod "global-pull-secret-syncer-kbfm9" (UID: "9c76f9c4-ed70-493b-b740-8d39b521b632") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:01.688880 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:01.688771 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 02:21:00 +0000 UTC" deadline="2028-06-03 10:24:10.495309846 +0000 UTC" Sep 09 02:26:01.688880 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:01.688817 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15199h58m8.80649863s" Sep 09 02:26:01.771184 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:01.769965 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:01.771184 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.770102 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:01.771184 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:01.770562 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:01.771184 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.770659 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:01.771184 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:01.770735 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:01.771184 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:01.770853 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:01.862718 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:01.862496 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 02:26:03.384249 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:03.384179 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:03.384249 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:03.384249 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:03.384800 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:03.384286 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:03.384800 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.384471 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:03.384800 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.384543 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs podName:b35c6a8a-f317-44f5-beab-f0c46fd31ee5 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:07.384521434 +0000 UTC m=+9.107501832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs") pod "network-metrics-daemon-2x72t" (UID: "b35c6a8a-f317-44f5-beab-f0c46fd31ee5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:03.387377 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.384988 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:03.387377 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.385043 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret podName:9c76f9c4-ed70-493b-b740-8d39b521b632 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:07.385027806 +0000 UTC m=+9.108008202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret") pod "global-pull-secret-syncer-kbfm9" (UID: "9c76f9c4-ed70-493b-b740-8d39b521b632") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:03.387377 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.385128 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:26:03.387377 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.385147 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:26:03.387377 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.385159 2569 projected.go:196] Error preparing data for projected volume kube-api-access-zqfwm for pod openshift-network-diagnostics/network-check-target-hfwfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:03.387377 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.385202 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm podName:ace583ca-20c8-40bf-a3fa-aec1bf334eeb nodeName:}" failed. No retries permitted until 2026-09-09 02:26:07.385189616 +0000 UTC m=+9.108170010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqfwm" (UniqueName: "kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm") pod "network-check-target-hfwfs" (UID: "ace583ca-20c8-40bf-a3fa-aec1bf334eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:03.770059 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:03.769120 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:03.770059 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.769262 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:03.770059 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:03.769744 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:03.770059 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.769848 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:03.770059 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:03.769914 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:03.770059 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:03.770010 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:05.769589 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:05.769554 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:05.770080 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:05.769710 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:05.770080 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:05.770034 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:05.770247 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:05.770148 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:05.770247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:05.770185 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:05.770362 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:05.770252 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:07.420559 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:07.420517 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:07.421053 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:07.420589 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:07.421053 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:07.420655 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:07.421053 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.420797 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:07.421053 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.420865 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret podName:9c76f9c4-ed70-493b-b740-8d39b521b632 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:15.420844908 +0000 UTC m=+17.143825313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret") pod "global-pull-secret-syncer-kbfm9" (UID: "9c76f9c4-ed70-493b-b740-8d39b521b632") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:07.421053 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.420977 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:26:07.421053 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.420992 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:26:07.421053 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.421005 2569 projected.go:196] Error preparing data for projected volume kube-api-access-zqfwm for pod openshift-network-diagnostics/network-check-target-hfwfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:07.421053 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.421045 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm podName:ace583ca-20c8-40bf-a3fa-aec1bf334eeb nodeName:}" failed. No retries permitted until 2026-09-09 02:26:15.421032981 +0000 UTC m=+17.144013365 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqfwm" (UniqueName: "kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm") pod "network-check-target-hfwfs" (UID: "ace583ca-20c8-40bf-a3fa-aec1bf334eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:07.421577 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.421111 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:07.421577 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.421146 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs podName:b35c6a8a-f317-44f5-beab-f0c46fd31ee5 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:15.421133983 +0000 UTC m=+17.144114375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs") pod "network-metrics-daemon-2x72t" (UID: "b35c6a8a-f317-44f5-beab-f0c46fd31ee5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:07.769681 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:07.769642 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:07.769868 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.769786 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:07.769868 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:07.769834 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:07.770000 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.769945 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:07.770057 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:07.770009 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:07.770112 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:07.770100 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:09.769751 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:09.769710 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:09.770244 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:09.769853 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:09.770244 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:09.769936 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:09.770244 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:09.770013 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:09.770244 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:09.770089 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:09.770244 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:09.770190 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:11.769501 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:11.769462 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:11.769501 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:11.769489 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:11.770070 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:11.769608 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:11.770070 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:11.769670 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:11.770070 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:11.769710 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:11.770070 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:11.769792 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:13.769628 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:13.769592 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:13.770069 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:13.769638 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:13.770069 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:13.769590 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:13.770069 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:13.769739 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:13.770069 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:13.769814 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:13.770069 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:13.769884 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:15.484247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:15.484205 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:15.484247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:15.484256 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:15.484772 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:15.484290 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:15.484772 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.484388 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:15.484772 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.484449 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret podName:9c76f9c4-ed70-493b-b740-8d39b521b632 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:31.484434024 +0000 UTC m=+33.207414404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret") pod "global-pull-secret-syncer-kbfm9" (UID: "9c76f9c4-ed70-493b-b740-8d39b521b632") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:15.484772 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.484452 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:26:15.484772 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.484477 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:26:15.484772 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.484388 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:15.484772 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.484491 2569 projected.go:196] Error preparing data for projected volume kube-api-access-zqfwm for pod openshift-network-diagnostics/network-check-target-hfwfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:15.484772 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.484552 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs podName:b35c6a8a-f317-44f5-beab-f0c46fd31ee5 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:31.484533712 +0000 UTC m=+33.207514110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs") pod "network-metrics-daemon-2x72t" (UID: "b35c6a8a-f317-44f5-beab-f0c46fd31ee5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:15.484772 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.484575 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm podName:ace583ca-20c8-40bf-a3fa-aec1bf334eeb nodeName:}" failed. No retries permitted until 2026-09-09 02:26:31.484564125 +0000 UTC m=+33.207544515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqfwm" (UniqueName: "kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm") pod "network-check-target-hfwfs" (UID: "ace583ca-20c8-40bf-a3fa-aec1bf334eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:15.769377 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:15.769325 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:15.769548 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:15.769325 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:15.769548 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.769472 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:15.769675 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.769543 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:15.769675 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:15.769325 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:15.769675 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:15.769615 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:17.769370 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:17.769322 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:17.769370 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:17.769322 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:17.769860 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:17.769323 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:17.769860 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:17.769461 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:17.769860 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:17.769573 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:17.769860 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:17.769680 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:19.769559 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:19.769532 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:19.770074 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:19.769567 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:19.770074 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:19.769568 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:19.770074 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:19.769646 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:19.770074 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:19.769736 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:19.770074 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:19.769832 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:19.989799 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:19.989770 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerStarted","Data":"1b92835dd96887c4527bf34c1fc5a888e7fad687dca42a29b49c3102a26aa2e6"} Sep 09 02:26:19.991481 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:19.991454 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kswd" event={"ID":"43d88f6a-ba0e-4603-9b80-a6617febcd3b","Type":"ContainerStarted","Data":"050101f629a0f887af79a970da0ecc2f1522bd202217dd30b047b4dad2fcbfea"} Sep 09 02:26:19.992865 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:19.992847 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" event={"ID":"576b87c7ce5e7cfdcb6002e50599d6cf","Type":"ContainerStarted","Data":"0d2dfe8cf286938c2a93758e07a7c020ebfc3ea403624784585376bb2530be35"} Sep 09 02:26:20.006896 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.006841 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8kswd" podStartSLOduration=1.264713778 podStartE2EDuration="21.006822058s" totalImagesPullingTime="19.74210828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:20.006119746 +0000 UTC m=+21.729100145" watchObservedRunningTime="2026-09-09 02:26:20.006822058 +0000 UTC m=+21.729802460" Sep 09 02:26:20.017812 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.017770 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" podStartSLOduration=20.017756451 podStartE2EDuration="20.017756451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:20.017323516 +0000 UTC m=+21.740303925" watchObservedRunningTime="2026-09-09 02:26:20.017756451 +0000 UTC m=+21.740736849" Sep 09 02:26:20.997784 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.997611 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/0.log" Sep 09 02:26:20.998560 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.998171 2569 generic.go:356] "Generic (PLEG): container finished" podID="9424a69c-24c6-46e6-9912-93ec9e2f66dc" containerID="9ba1620dd32ab74aba0c9fa8e03ff3ee9e3a4312a5c369b74a518488ebf61289" exitCode=1 Sep 09 02:26:20.998560 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.998248 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerStarted","Data":"5389e8d26d233f6608347c16a0fc9db1e815896fd42dec4e5c568f88cb7729b2"} Sep 09 02:26:20.998560 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.998319 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerStarted","Data":"2967b5117ea9efe9cad7bb52f7184f40b536c24cba87823e096436b1539f9cbe"} Sep 09 02:26:20.998560 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.998369 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerStarted","Data":"bb560423948d751070ab7d2458a8868b73ec92601592227f4c284124f29b48a4"} Sep 09 02:26:20.998560 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.998399 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerStarted","Data":"981322e6f8c840f4e95e0466dc48d98ba7696d2d50779773eff5ba1c3138710c"} Sep 09 02:26:20.998560 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.998434 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerDied","Data":"9ba1620dd32ab74aba0c9fa8e03ff3ee9e3a4312a5c369b74a518488ebf61289"} Sep 09 02:26:20.999694 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.999674 2569 generic.go:356] "Generic (PLEG): container finished" podID="2786b854-1597-4011-953d-901c9a9f3ac0" containerID="72cc513eaca59466730d71a4c780b948e890856d28478234dd1b9a89a526a3ed" exitCode=0 Sep 09 02:26:20.999804 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:20.999739 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmccn" event={"ID":"2786b854-1597-4011-953d-901c9a9f3ac0","Type":"ContainerDied","Data":"72cc513eaca59466730d71a4c780b948e890856d28478234dd1b9a89a526a3ed"} Sep 09 02:26:21.001570 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.001549 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qvsx" event={"ID":"0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28","Type":"ContainerStarted","Data":"485e96acd95bee11b493d3edeef26dee907c94b0dfbde7110e6268d00f3e97f8"} Sep 09 02:26:21.008831 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.008748 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kc97x" event={"ID":"448e25db-e22b-482b-9fa8-b81898d97a32","Type":"ContainerStarted","Data":"e44e1f003c38eebea3d687866ddbed47ee993ae93dc26716374585bb8113ddbb"} Sep 09 02:26:21.010481 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.010454 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" event={"ID":"5a3cd069-358f-444f-96eb-84db2024650a","Type":"ContainerStarted","Data":"de3ecd1990e91bb212366789fc901311d2700a1934c0a85f20614eb5d8b46489"} Sep 09 02:26:21.011498 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.011477 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xfhtn" event={"ID":"e63eaf31-cde7-4a3a-8860-052cfee574c8","Type":"ContainerStarted","Data":"df9f11445c59cb6bbb45d17b9977b3f83b60bd9646a6e365082b5d75c7fe9801"} Sep 09 02:26:21.025517 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.025474 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mcbbx" event={"ID":"8fad9731-782f-46cb-a223-117f6b98abba","Type":"ContainerStarted","Data":"0b372c32297b8e0ab57b43084b492515455a64948a3684121ae9000bb9e36857"} Sep 09 02:26:21.027301 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.027279 2569 generic.go:356] "Generic (PLEG): container finished" podID="c72adec8fe3fae1db9d665be451ec425" containerID="dc864de9a9060cb5c5c89d90d2ac49b4fb0a670a7cd0cba24ed8e19af0ae0ceb" exitCode=0 Sep 09 02:26:21.027417 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.027373 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"c72adec8fe3fae1db9d665be451ec425","Type":"ContainerDied","Data":"dc864de9a9060cb5c5c89d90d2ac49b4fb0a670a7cd0cba24ed8e19af0ae0ceb"} Sep 09 02:26:21.049526 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.049479 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kc97x" podStartSLOduration=2.3405806719999998 podStartE2EDuration="22.04946156s" totalImagesPullingTime="19.708880888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:21.032659566 +0000 UTC m=+22.755639966" watchObservedRunningTime="2026-09-09 02:26:21.04946156 +0000 UTC m=+22.772441959" Sep 09 02:26:21.061767 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.061717 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6qvsx" podStartSLOduration=1.872569455 podStartE2EDuration="22.061697503s" totalImagesPullingTime="20.189128048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:21.048757783 +0000 UTC m=+22.771738180" watchObservedRunningTime="2026-09-09 02:26:21.061697503 +0000 UTC m=+22.784677902" Sep 09 02:26:21.062178 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.062137 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xfhtn" podStartSLOduration=2.446410712 podStartE2EDuration="22.062125505s" totalImagesPullingTime="19.615714793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:21.061641985 +0000 UTC m=+22.784622384" watchObservedRunningTime="2026-09-09 02:26:21.062125505 +0000 UTC m=+22.785105922" Sep 09 02:26:21.078621 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.078575 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mcbbx" podStartSLOduration=2.389148272 podStartE2EDuration="22.07856094s" totalImagesPullingTime="19.689412668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:21.078291715 +0000 UTC m=+22.801272114" watchObservedRunningTime="2026-09-09 02:26:21.07856094 +0000 UTC m=+22.801541337" Sep 09 02:26:21.367385 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.367296 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:26:21.368196 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.368170 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:26:21.769557 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.769528 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:21.769691 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.769535 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:21.769691 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.769645 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:21.769691 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:21.769641 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:21.769800 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:21.769717 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:21.769834 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:21.769799 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:21.835311 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:21.835291 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 02:26:22.032260 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:22.032222 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" event={"ID":"5a3cd069-358f-444f-96eb-84db2024650a","Type":"ContainerStarted","Data":"8935025cc31d940c43a48f9e9fb0b0c55b3e031aa5f1abe9df94ef93d75b0781"} Sep 09 02:26:22.033977 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:22.033944 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fsldb" event={"ID":"c2eeff9d-2af5-4698-b31e-a2da5332bf94","Type":"ContainerStarted","Data":"c93e54673a4659a1cad4c727c1fc862ccb3ca12d1b52db8d6625b1d7caa60f41"} Sep 09 02:26:22.036359 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:22.036318 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"c72adec8fe3fae1db9d665be451ec425","Type":"ContainerStarted","Data":"021e9b696686f9aca210c034bfa41534a9f40e0b01ba4736c302eb333fb6c0de"} Sep 09 02:26:22.053306 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:22.053247 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fsldb" podStartSLOduration=3.40453778 podStartE2EDuration="23.053224846s" totalImagesPullingTime="19.648687066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:22.050164191 +0000 UTC m=+23.773144590" watchObservedRunningTime="2026-09-09 02:26:22.053224846 +0000 UTC m=+23.776205244" Sep 09 02:26:22.067056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:22.067005 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" podStartSLOduration=22.066986044 podStartE2EDuration="22.066986044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:22.066590193 +0000 UTC m=+23.789570601" watchObservedRunningTime="2026-09-09 02:26:22.066986044 +0000 UTC m=+23.789966442" Sep 09 02:26:22.716087 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:22.715955 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T02:26:21.835307568Z","UUID":"8d5aac84-139f-445b-8655-ca1bc3c910db","Handler":null,"Name":"","Endpoint":""} Sep 09 02:26:22.717856 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:22.717820 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 02:26:22.718019 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:22.717870 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 02:26:23.041356 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:23.041324 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/0.log" Sep 09 02:26:23.041810 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:23.041781 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerStarted","Data":"5f6a6b5d5df29f4dd1a5322cf34a197ec4efa4f8352fa8e548537aba72a96882"} Sep 09 02:26:23.042072 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:23.042054 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 02:26:23.769827 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:23.769795 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:23.769827 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:23.769824 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:23.770061 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:23.769795 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:23.770061 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:23.769908 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:23.770061 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:23.769973 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:23.770219 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:23.770104 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:24.048683 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:24.048596 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" event={"ID":"5a3cd069-358f-444f-96eb-84db2024650a","Type":"ContainerStarted","Data":"d9362e34605e9c23f8b4c8ebdfa375d900945a1e614c86fd87ef247f4cdb9998"} Sep 09 02:26:24.066497 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:24.066445 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ngrdl" podStartSLOduration=3.044975893 podStartE2EDuration="25.066427328s" totalImagesPullingTime="22.021451435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:24.065942942 +0000 UTC m=+25.788923354" watchObservedRunningTime="2026-09-09 02:26:24.066427328 +0000 UTC m=+25.789407726" Sep 09 02:26:25.769470 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:25.769438 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:25.769957 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:25.769438 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:25.769957 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:25.769545 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:25.769957 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:25.769438 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:25.769957 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:25.769740 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:25.769957 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:25.769630 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:27.058899 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.058690 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/0.log" Sep 09 02:26:27.059218 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.059195 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerStarted","Data":"9e004e5a09d0fd1ca9300239882d626e4c658118bfc2b672f8e04443e21bd386"} Sep 09 02:26:27.059515 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.059473 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:26:27.059673 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.059653 2569 scope.go:117] "RemoveContainer" containerID="9ba1620dd32ab74aba0c9fa8e03ff3ee9e3a4312a5c369b74a518488ebf61289" Sep 09 02:26:27.061199 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.061175 2569 generic.go:356] "Generic (PLEG): container finished" podID="2786b854-1597-4011-953d-901c9a9f3ac0" containerID="46e273e8c5cfb27dbd00b46dcb8c6b807427ea4b386ec9a6a3fd2b3168414f77" exitCode=0 Sep 09 02:26:27.061304 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.061218 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmccn" event={"ID":"2786b854-1597-4011-953d-901c9a9f3ac0","Type":"ContainerDied","Data":"46e273e8c5cfb27dbd00b46dcb8c6b807427ea4b386ec9a6a3fd2b3168414f77"} Sep 09 02:26:27.075849 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.075828 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:26:27.169864 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.169733 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:26:27.169864 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.169855 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 02:26:27.170584 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.170561 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xfhtn" Sep 09 02:26:27.769872 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.769839 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:27.770023 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.769854 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:27.770023 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:27.769948 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:27.770086 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:27.770026 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:27.770086 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:27.769856 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:27.770154 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:27.770102 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:28.066677 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:28.066604 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/0.log" Sep 09 02:26:28.067174 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:28.067025 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" event={"ID":"9424a69c-24c6-46e6-9912-93ec9e2f66dc","Type":"ContainerStarted","Data":"2b380fb8a4899fb52985e64f653b40c4d5d0919356f9c009858585b36d359eea"} Sep 09 02:26:28.067174 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:28.067109 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 02:26:28.067294 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:28.067277 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:26:28.081935 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:28.081907 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:26:28.093713 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:28.092491 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" podStartSLOduration=9.4392778 podStartE2EDuration="29.092469708s" totalImagesPullingTime="19.653191908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:28.090665613 +0000 UTC m=+29.813646021" watchObservedRunningTime="2026-09-09 02:26:28.092469708 +0000 UTC m=+29.815450108" Sep 09 02:26:29.071829 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:29.071799 2569 generic.go:356] "Generic (PLEG): container finished" podID="2786b854-1597-4011-953d-901c9a9f3ac0" containerID="9befa9d46604326109d45ef4c29631e10ca03aaa1f87a298a11161423ada6f80" exitCode=0 Sep 09 02:26:29.072298 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:29.071886 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmccn" event={"ID":"2786b854-1597-4011-953d-901c9a9f3ac0","Type":"ContainerDied","Data":"9befa9d46604326109d45ef4c29631e10ca03aaa1f87a298a11161423ada6f80"} Sep 09 02:26:29.072298 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:29.071928 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 02:26:29.769587 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:29.769545 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:29.769587 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:29.769587 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:29.769771 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:29.769648 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:29.769771 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:29.769666 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:29.769771 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:29.769729 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:29.769925 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:29.769892 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:30.013075 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:30.013029 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:26:31.078103 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:31.078073 2569 generic.go:356] "Generic (PLEG): container finished" podID="2786b854-1597-4011-953d-901c9a9f3ac0" containerID="8574c6c707973f13572e05e740edae83be873046aaa4e8b46e143a47c5e8c10a" exitCode=0 Sep 09 02:26:31.078521 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:31.078167 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmccn" event={"ID":"2786b854-1597-4011-953d-901c9a9f3ac0","Type":"ContainerDied","Data":"8574c6c707973f13572e05e740edae83be873046aaa4e8b46e143a47c5e8c10a"} Sep 09 02:26:31.095183 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:31.095145 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" podUID="9424a69c-24c6-46e6-9912-93ec9e2f66dc" containerName="ovnkube-controller" probeResult="failure" output="" Sep 09 02:26:31.500778 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:31.500748 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:31.500914 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:31.500804 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:31.500914 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:31.500830 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:31.500914 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.500892 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:31.501022 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.500932 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 02:26:31.501022 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.500946 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:31.501022 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.500948 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 02:26:31.501022 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.501001 2569 projected.go:196] Error preparing data for projected volume kube-api-access-zqfwm for pod openshift-network-diagnostics/network-check-target-hfwfs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:31.501022 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.500954 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs podName:b35c6a8a-f317-44f5-beab-f0c46fd31ee5 nodeName:}" failed. No retries permitted until 2026-09-09 02:27:03.500938166 +0000 UTC m=+65.223918559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs") pod "network-metrics-daemon-2x72t" (UID: "b35c6a8a-f317-44f5-beab-f0c46fd31ee5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 02:26:31.501164 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.501043 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret podName:9c76f9c4-ed70-493b-b740-8d39b521b632 nodeName:}" failed. No retries permitted until 2026-09-09 02:27:03.501028269 +0000 UTC m=+65.224008645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret") pod "global-pull-secret-syncer-kbfm9" (UID: "9c76f9c4-ed70-493b-b740-8d39b521b632") : object "kube-system"/"original-pull-secret" not registered Sep 09 02:26:31.501164 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.501056 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm podName:ace583ca-20c8-40bf-a3fa-aec1bf334eeb nodeName:}" failed. No retries permitted until 2026-09-09 02:27:03.501048749 +0000 UTC m=+65.224029130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqfwm" (UniqueName: "kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm") pod "network-check-target-hfwfs" (UID: "ace583ca-20c8-40bf-a3fa-aec1bf334eeb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 02:26:31.769066 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:31.768978 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:31.769066 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:31.768978 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:31.769282 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:31.768978 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:31.769282 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.769127 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:31.769657 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.769624 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:31.769794 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:31.769742 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:33.769410 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:33.769374 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:33.769410 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:33.769409 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:33.769904 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:33.769374 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:33.769904 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:33.769486 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:33.769904 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:33.769563 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:33.769904 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:33.769621 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:35.769248 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:35.769208 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:35.769828 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:35.769282 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:35.769828 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:35.769404 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:35.769828 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:35.769425 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:35.769828 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:35.769525 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:35.769828 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:35.769611 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:37.769585 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:37.769547 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:37.770006 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:37.769640 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:37.770006 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:37.769651 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:37.770006 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:37.769648 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:37.770006 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:37.769713 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:37.770006 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:37.769797 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:38.096759 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:38.096670 2569 generic.go:356] "Generic (PLEG): container finished" podID="2786b854-1597-4011-953d-901c9a9f3ac0" containerID="50eb226664a264bef5dd0b15b108213684d963cf1f292257ad8008ad482027a0" exitCode=0 Sep 09 02:26:38.096759 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:38.096729 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmccn" event={"ID":"2786b854-1597-4011-953d-901c9a9f3ac0","Type":"ContainerDied","Data":"50eb226664a264bef5dd0b15b108213684d963cf1f292257ad8008ad482027a0"} Sep 09 02:26:39.102376 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:39.102329 2569 generic.go:356] "Generic (PLEG): container finished" podID="2786b854-1597-4011-953d-901c9a9f3ac0" containerID="2b9e9bc23a132a971803860b344911bb566a0ff6b41e78f1a03c9362b38cdd26" exitCode=0 Sep 09 02:26:39.102770 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:39.102401 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmccn" event={"ID":"2786b854-1597-4011-953d-901c9a9f3ac0","Type":"ContainerDied","Data":"2b9e9bc23a132a971803860b344911bb566a0ff6b41e78f1a03c9362b38cdd26"} Sep 09 02:26:39.769820 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:39.769632 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:39.769969 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:39.769690 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:39.769969 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:39.769889 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:39.770081 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:39.769995 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:39.770081 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:39.769690 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:39.770081 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:39.770071 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:40.107925 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:40.107839 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmccn" event={"ID":"2786b854-1597-4011-953d-901c9a9f3ac0","Type":"ContainerStarted","Data":"3698d65cdfa0c505c2021ff62cd7386cf9c34784af4f442d69ae71bff0b59846"} Sep 09 02:26:40.127725 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:40.127682 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nmccn" podStartSLOduration=7.506921457 podStartE2EDuration="41.12766748s" totalImagesPullingTime="33.620746023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:40.126327373 +0000 UTC m=+41.849307771" watchObservedRunningTime="2026-09-09 02:26:40.12766748 +0000 UTC m=+41.850647877" Sep 09 02:26:41.770376 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:41.770307 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:41.770820 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:41.770469 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:41.770820 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:41.770471 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:41.770820 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:41.770578 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:41.770820 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:41.770635 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:41.770820 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:41.770728 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:42.471839 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:42.471803 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kbfm9"] Sep 09 02:26:42.472003 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:42.471926 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:42.472049 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:42.472008 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:42.476167 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:42.476142 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hfwfs"] Sep 09 02:26:42.476411 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:42.476392 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:42.476500 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:42.476469 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:42.477008 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:42.476982 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2x72t"] Sep 09 02:26:42.477110 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:42.477057 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:42.477173 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:42.477124 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:43.769022 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:43.768990 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:43.769433 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:43.769101 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:43.769433 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:43.769152 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:43.769433 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:43.769235 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:44.769809 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:44.769779 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:44.770165 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:44.769882 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:45.769718 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:45.769685 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:45.769886 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:45.769692 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:45.769886 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:45.769791 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kbfm9" podUID="9c76f9c4-ed70-493b-b740-8d39b521b632" Sep 09 02:26:45.769886 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:45.769876 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfwfs" podUID="ace583ca-20c8-40bf-a3fa-aec1bf334eeb" Sep 09 02:26:46.770158 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:46.770114 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:46.770697 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:46.770234 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x72t" podUID="b35c6a8a-f317-44f5-beab-f0c46fd31ee5" Sep 09 02:26:47.010906 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.010882 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeReady" Sep 09 02:26:47.011042 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.010995 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 02:26:47.052741 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.052715 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4795s"] Sep 09 02:26:47.077050 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.077027 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cmpsd"] Sep 09 02:26:47.077230 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.077160 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.079267 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.079244 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t86xl\"" Sep 09 02:26:47.079267 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.079262 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 02:26:47.079452 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.079262 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 02:26:47.089596 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.089441 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4795s"] Sep 09 02:26:47.089761 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.089619 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cmpsd"] Sep 09 02:26:47.089761 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.089562 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cmpsd" Sep 09 02:26:47.091603 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.091581 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 02:26:47.091762 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.091743 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 02:26:47.091819 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.091750 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g2z42\"" Sep 09 02:26:47.091819 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.091779 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 02:26:47.156600 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.156570 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7n792"] Sep 09 02:26:47.180506 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.180479 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7n792"] Sep 09 02:26:47.180645 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.180596 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.183063 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.183025 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 02:26:47.183063 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.183050 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 02:26:47.183309 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.183026 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 02:26:47.183309 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.183095 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 02:26:47.183309 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.183200 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8wjcz\"" Sep 09 02:26:47.211162 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.211134 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bff2849-12db-42e5-9c99-89d7669e3e24-tmp-dir\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.211162 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.211159 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtblb\" (UniqueName: \"kubernetes.io/projected/865b61c5-2aac-4242-8306-8349db3bbeda-kube-api-access-xtblb\") pod \"ingress-canary-cmpsd\" (UID: \"865b61c5-2aac-4242-8306-8349db3bbeda\") " pod="openshift-ingress-canary/ingress-canary-cmpsd" Sep 09 02:26:47.211368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.211178 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/865b61c5-2aac-4242-8306-8349db3bbeda-cert\") pod \"ingress-canary-cmpsd\" (UID: \"865b61c5-2aac-4242-8306-8349db3bbeda\") " pod="openshift-ingress-canary/ingress-canary-cmpsd" Sep 09 02:26:47.211368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.211199 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6bff2849-12db-42e5-9c99-89d7669e3e24-config-volume\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.211368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.211283 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcjs\" (UniqueName: \"kubernetes.io/projected/6bff2849-12db-42e5-9c99-89d7669e3e24-kube-api-access-pwcjs\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.211485 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.211363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bff2849-12db-42e5-9c99-89d7669e3e24-metrics-tls\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.312578 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312492 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-crio-socket\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.312578 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312535 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bff2849-12db-42e5-9c99-89d7669e3e24-tmp-dir\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.312578 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312556 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtblb\" (UniqueName: \"kubernetes.io/projected/865b61c5-2aac-4242-8306-8349db3bbeda-kube-api-access-xtblb\") pod \"ingress-canary-cmpsd\" (UID: \"865b61c5-2aac-4242-8306-8349db3bbeda\") " pod="openshift-ingress-canary/ingress-canary-cmpsd" Sep 09 02:26:47.312578 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312574 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2fj\" (UniqueName: \"kubernetes.io/projected/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-kube-api-access-gm2fj\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.312870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312590 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/865b61c5-2aac-4242-8306-8349db3bbeda-cert\") pod \"ingress-canary-cmpsd\" (UID: \"865b61c5-2aac-4242-8306-8349db3bbeda\") " pod="openshift-ingress-canary/ingress-canary-cmpsd" Sep 09 02:26:47.312870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312611 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6bff2849-12db-42e5-9c99-89d7669e3e24-config-volume\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.312870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcjs\" (UniqueName: \"kubernetes.io/projected/6bff2849-12db-42e5-9c99-89d7669e3e24-kube-api-access-pwcjs\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.312870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312655 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.312870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312683 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-data-volume\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.312870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312834 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bff2849-12db-42e5-9c99-89d7669e3e24-metrics-tls\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.313178 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.312870 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.313232 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.313197 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bff2849-12db-42e5-9c99-89d7669e3e24-tmp-dir\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.313420 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.313398 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6bff2849-12db-42e5-9c99-89d7669e3e24-config-volume\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.316450 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.316433 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bff2849-12db-42e5-9c99-89d7669e3e24-metrics-tls\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.316623 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.316609 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/865b61c5-2aac-4242-8306-8349db3bbeda-cert\") pod \"ingress-canary-cmpsd\" (UID: \"865b61c5-2aac-4242-8306-8349db3bbeda\") " pod="openshift-ingress-canary/ingress-canary-cmpsd" Sep 09 02:26:47.320576 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.320553 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcjs\" (UniqueName: \"kubernetes.io/projected/6bff2849-12db-42e5-9c99-89d7669e3e24-kube-api-access-pwcjs\") pod \"dns-default-4795s\" (UID: \"6bff2849-12db-42e5-9c99-89d7669e3e24\") " pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.320680 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.320599 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtblb\" (UniqueName: \"kubernetes.io/projected/865b61c5-2aac-4242-8306-8349db3bbeda-kube-api-access-xtblb\") pod \"ingress-canary-cmpsd\" (UID: \"865b61c5-2aac-4242-8306-8349db3bbeda\") " pod="openshift-ingress-canary/ingress-canary-cmpsd" Sep 09 02:26:47.386565 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.386528 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4795s" Sep 09 02:26:47.398178 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.398158 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cmpsd" Sep 09 02:26:47.413336 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.413305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.413484 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.413357 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-data-volume\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.413484 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.413382 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.413484 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.413432 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-crio-socket\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.413673 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.413602 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2fj\" (UniqueName: \"kubernetes.io/projected/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-kube-api-access-gm2fj\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.413673 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.413634 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-crio-socket\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.414230 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.414204 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-data-volume\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.414493 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.414473 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.416355 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.416321 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.421154 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.421125 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2fj\" (UniqueName: \"kubernetes.io/projected/638aa984-cf3f-4a3a-8d2d-96ead519d1f2-kube-api-access-gm2fj\") pod \"insights-runtime-extractor-7n792\" (UID: \"638aa984-cf3f-4a3a-8d2d-96ead519d1f2\") " pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.488998 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.488958 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7n792" Sep 09 02:26:47.668617 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.668540 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cmpsd"] Sep 09 02:26:47.671556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.671532 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4795s"] Sep 09 02:26:47.672770 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:47.672739 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865b61c5_2aac_4242_8306_8349db3bbeda.slice/crio-835450b51f5fab8f2068cd508c9b0fafe098681bc2d1dee46bafebba2ba88b50 WatchSource:0}: Error finding container 835450b51f5fab8f2068cd508c9b0fafe098681bc2d1dee46bafebba2ba88b50: Status 404 returned error can't find the container with id 835450b51f5fab8f2068cd508c9b0fafe098681bc2d1dee46bafebba2ba88b50 Sep 09 02:26:47.674756 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:47.674731 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bff2849_12db_42e5_9c99_89d7669e3e24.slice/crio-0e1b6155d744e8fc21fb19523f1186e0dc206f4996500749ee008d31ce7cf4c5 WatchSource:0}: Error finding container 0e1b6155d744e8fc21fb19523f1186e0dc206f4996500749ee008d31ce7cf4c5: Status 404 returned error can't find the container with id 0e1b6155d744e8fc21fb19523f1186e0dc206f4996500749ee008d31ce7cf4c5 Sep 09 02:26:47.758087 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.758056 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7n792"] Sep 09 02:26:47.761693 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:47.761666 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638aa984_cf3f_4a3a_8d2d_96ead519d1f2.slice/crio-d83de49d3c3a5f3975ed976d205d039b6ded61a1d516d2b52ee66d023f22d8d1 WatchSource:0}: Error finding container d83de49d3c3a5f3975ed976d205d039b6ded61a1d516d2b52ee66d023f22d8d1: Status 404 returned error can't find the container with id d83de49d3c3a5f3975ed976d205d039b6ded61a1d516d2b52ee66d023f22d8d1 Sep 09 02:26:47.769781 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.769762 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:26:47.769926 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.769903 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:26:47.771903 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.771881 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 02:26:47.772478 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.772005 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 02:26:47.772478 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.772076 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v2n6b\"" Sep 09 02:26:47.772478 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:47.772159 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 02:26:48.128132 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:48.128099 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7n792" event={"ID":"638aa984-cf3f-4a3a-8d2d-96ead519d1f2","Type":"ContainerStarted","Data":"73040f8e0c783e52e7a3c0ae76c9050369e794b0c7cecc17aeda9321193b82d2"} Sep 09 02:26:48.128333 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:48.128168 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7n792" event={"ID":"638aa984-cf3f-4a3a-8d2d-96ead519d1f2","Type":"ContainerStarted","Data":"d83de49d3c3a5f3975ed976d205d039b6ded61a1d516d2b52ee66d023f22d8d1"} Sep 09 02:26:48.129287 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:48.129257 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cmpsd" event={"ID":"865b61c5-2aac-4242-8306-8349db3bbeda","Type":"ContainerStarted","Data":"835450b51f5fab8f2068cd508c9b0fafe098681bc2d1dee46bafebba2ba88b50"} Sep 09 02:26:48.130541 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:48.130517 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4795s" event={"ID":"6bff2849-12db-42e5-9c99-89d7669e3e24","Type":"ContainerStarted","Data":"0e1b6155d744e8fc21fb19523f1186e0dc206f4996500749ee008d31ce7cf4c5"} Sep 09 02:26:48.770616 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:48.770586 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:26:48.773758 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:48.773645 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 02:26:48.773758 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:48.773645 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-swb8h\"" Sep 09 02:26:49.135628 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:49.135594 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7n792" event={"ID":"638aa984-cf3f-4a3a-8d2d-96ead519d1f2","Type":"ContainerStarted","Data":"91cab7dcd5a40f825c8f58886c138bc584f21eb4fe885e0aedfdcfcee4d276cb"} Sep 09 02:26:50.140497 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.140463 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4795s" event={"ID":"6bff2849-12db-42e5-9c99-89d7669e3e24","Type":"ContainerStarted","Data":"5e64819f515b5759b722bc36227c4c2c7e4e919192e4d077f15afc1b118b9e44"} Sep 09 02:26:50.140970 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.140525 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4795s" event={"ID":"6bff2849-12db-42e5-9c99-89d7669e3e24","Type":"ContainerStarted","Data":"08a7fff729d5dbd8008384c45e478366ba7ab2e596baf278b3ee947f87c37e77"} Sep 09 02:26:50.140970 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.140594 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4795s" Sep 09 02:26:50.157056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.156990 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4795s" podStartSLOduration=1.510983772 podStartE2EDuration="3.156976451s" totalImagesPullingTime="1.645992679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:50.15671384 +0000 UTC m=+51.879694239" watchObservedRunningTime="2026-09-09 02:26:50.156976451 +0000 UTC m=+51.879956841" Sep 09 02:26:50.890458 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.890426 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf"] Sep 09 02:26:50.893534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.893519 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:50.897093 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.897066 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 02:26:50.897093 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.897083 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 02:26:50.897265 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.897119 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 02:26:50.897265 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.897070 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dbl8r\"" Sep 09 02:26:50.897265 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.897066 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 02:26:50.897265 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.897080 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 02:26:50.903502 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.903481 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf"] Sep 09 02:26:50.908926 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.908404 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m"] Sep 09 02:26:50.911526 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.911504 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h4jj2"] Sep 09 02:26:50.911650 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.911634 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:50.913804 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.913780 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 09 02:26:50.913935 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.913851 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ph4ft\"" Sep 09 02:26:50.913935 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.913786 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 09 02:26:50.914044 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.913963 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 09 02:26:50.914529 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.914512 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:50.916795 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.916779 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7c5x9\"" Sep 09 02:26:50.917080 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.917055 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 02:26:50.917211 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.917088 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 02:26:50.917271 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.917191 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 02:26:50.924161 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:50.923884 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m"] Sep 09 02:26:51.041770 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.041690 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-textfile\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.041770 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.041728 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4d8ac876-7b02-4726-af92-b4400a61c596-root\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.041770 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.041771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nnkt\" (UniqueName: \"kubernetes.io/projected/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-kube-api-access-2nnkt\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.041991 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.041798 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.041991 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.041827 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgkh2\" (UniqueName: \"kubernetes.io/projected/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-api-access-cgkh2\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.041991 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.041848 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.041991 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.041895 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-tls\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.041991 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.041926 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.042144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.041998 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.042144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f70864e9-7a9e-41d0-8035-43f133aadfce-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.042144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042055 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwgws\" (UniqueName: \"kubernetes.io/projected/4d8ac876-7b02-4726-af92-b4400a61c596-kube-api-access-pwgws\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.042144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042073 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.042144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042089 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f70864e9-7a9e-41d0-8035-43f133aadfce-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.042144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042103 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d8ac876-7b02-4726-af92-b4400a61c596-metrics-client-ca\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.042144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-wtmp\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.042336 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042179 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.042336 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042194 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d8ac876-7b02-4726-af92-b4400a61c596-sys\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.042336 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042210 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-accelerators-collector-config\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.042336 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.042227 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.142617 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142588 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142623 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f70864e9-7a9e-41d0-8035-43f133aadfce-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142645 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwgws\" (UniqueName: \"kubernetes.io/projected/4d8ac876-7b02-4726-af92-b4400a61c596-kube-api-access-pwgws\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142671 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142696 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f70864e9-7a9e-41d0-8035-43f133aadfce-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142722 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d8ac876-7b02-4726-af92-b4400a61c596-metrics-client-ca\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142748 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-wtmp\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142793 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142815 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d8ac876-7b02-4726-af92-b4400a61c596-sys\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142840 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-accelerators-collector-config\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142867 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142899 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-textfile\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142921 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4d8ac876-7b02-4726-af92-b4400a61c596-root\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.142995 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nnkt\" (UniqueName: \"kubernetes.io/projected/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-kube-api-access-2nnkt\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.143043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143022 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143052 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkh2\" (UniqueName: \"kubernetes.io/projected/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-api-access-cgkh2\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143072 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f70864e9-7a9e-41d0-8035-43f133aadfce-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143087 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143135 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-tls\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143169 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:51.143274 2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:51.143331 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-tls podName:f70864e9-7a9e-41d0-8035-43f133aadfce nodeName:}" failed. No retries permitted until 2026-09-09 02:26:51.643313978 +0000 UTC m=+53.366294371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-pjr8m" (UID: "f70864e9-7a9e-41d0-8035-43f133aadfce") : secret "kube-state-metrics-tls" not found Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143426 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d8ac876-7b02-4726-af92-b4400a61c596-metrics-client-ca\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:51.143634 2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143641 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f70864e9-7a9e-41d0-8035-43f133aadfce-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143651 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143684 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.143729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143726 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d8ac876-7b02-4726-af92-b4400a61c596-sys\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.144261 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:51.143750 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-openshift-state-metrics-tls podName:9256fb8a-159d-4dc4-b8f6-7690b7c79dbe nodeName:}" failed. No retries permitted until 2026-09-09 02:26:51.643726187 +0000 UTC m=+53.366706575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-bg8cf" (UID: "9256fb8a-159d-4dc4-b8f6-7690b7c79dbe") : secret "openshift-state-metrics-tls" not found Sep 09 02:26:51.144261 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143816 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-textfile\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.144261 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143832 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-wtmp\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.144261 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:51.143821 2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 02:26:51.144261 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.143938 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4d8ac876-7b02-4726-af92-b4400a61c596-root\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.144261 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:51.144031 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-tls podName:4d8ac876-7b02-4726-af92-b4400a61c596 nodeName:}" failed. No retries permitted until 2026-09-09 02:26:51.644010117 +0000 UTC m=+53.366990534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-tls") pod "node-exporter-h4jj2" (UID: "4d8ac876-7b02-4726-af92-b4400a61c596") : secret "node-exporter-tls" not found Sep 09 02:26:51.144528 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.144472 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-accelerators-collector-config\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.147577 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.147550 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.148046 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.147580 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.148046 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.147627 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.148046 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.147842 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7n792" event={"ID":"638aa984-cf3f-4a3a-8d2d-96ead519d1f2","Type":"ContainerStarted","Data":"c456f1e7d0f18018ae603f0ba560774fc7188f10d84532d028ef2dca3f627951"} Sep 09 02:26:51.149764 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.149729 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cmpsd" event={"ID":"865b61c5-2aac-4242-8306-8349db3bbeda","Type":"ContainerStarted","Data":"10c51bbea86109f75707ea5d2066c316b8eec7592331565ac94838d795fd22f1"} Sep 09 02:26:51.150518 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.150493 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwgws\" (UniqueName: \"kubernetes.io/projected/4d8ac876-7b02-4726-af92-b4400a61c596-kube-api-access-pwgws\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.151822 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.151804 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgkh2\" (UniqueName: \"kubernetes.io/projected/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-api-access-cgkh2\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.152091 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.152072 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nnkt\" (UniqueName: \"kubernetes.io/projected/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-kube-api-access-2nnkt\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.171054 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.170999 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7n792" podStartSLOduration=1.358283344 podStartE2EDuration="4.170978474s" totalImagesPullingTime="2.81269513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:26:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:51.170920436 +0000 UTC m=+52.893900846" watchObservedRunningTime="2026-09-09 02:26:51.170978474 +0000 UTC m=+52.893958876" Sep 09 02:26:51.190011 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.189948 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cmpsd" podStartSLOduration=1.084704826 podStartE2EDuration="4.189929575s" totalImagesPullingTime="3.105224749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:51.189687957 +0000 UTC m=+52.912668357" watchObservedRunningTime="2026-09-09 02:26:51.189929575 +0000 UTC m=+52.912909975" Sep 09 02:26:51.648216 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.648166 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.648449 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.648239 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-tls\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.648449 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.648259 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.650870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.650843 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d8ac876-7b02-4726-af92-b4400a61c596-node-exporter-tls\") pod \"node-exporter-h4jj2\" (UID: \"4d8ac876-7b02-4726-af92-b4400a61c596\") " pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.650971 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.650900 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f70864e9-7a9e-41d0-8035-43f133aadfce-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-pjr8m\" (UID: \"f70864e9-7a9e-41d0-8035-43f133aadfce\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.651015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.650977 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9256fb8a-159d-4dc4-b8f6-7690b7c79dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-bg8cf\" (UID: \"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.803059 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.803025 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" Sep 09 02:26:51.823437 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.823411 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" Sep 09 02:26:51.830535 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.830512 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h4jj2" Sep 09 02:26:51.843403 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:51.842459 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8ac876_7b02_4726_af92_b4400a61c596.slice/crio-567ec64b8037b27d26b7e42769e22b8d881ede08e418a8a752224247e13e4963 WatchSource:0}: Error finding container 567ec64b8037b27d26b7e42769e22b8d881ede08e418a8a752224247e13e4963: Status 404 returned error can't find the container with id 567ec64b8037b27d26b7e42769e22b8d881ede08e418a8a752224247e13e4963 Sep 09 02:26:51.962306 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.962220 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 02:26:51.966681 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.966659 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:51.970017 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.969992 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 02:26:51.970703 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.970684 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 02:26:51.970855 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.970834 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 02:26:51.971118 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.971102 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 02:26:51.971199 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.971124 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 02:26:51.971421 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.971405 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dhjs5\"" Sep 09 02:26:51.971842 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.971827 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 02:26:51.971915 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.971891 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 02:26:51.971970 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.971941 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 02:26:51.972036 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.972024 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 02:26:51.982170 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:51.982142 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 02:26:52.053425 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053398 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053510 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053450 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-out\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053510 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053483 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053510 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053508 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053526 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053545 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053641 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053814 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053705 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053814 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053736 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-web-config\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053814 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053765 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053954 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053840 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053954 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053876 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwwf2\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-kube-api-access-fwwf2\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.053954 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.053906 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.078026 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.077998 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf"] Sep 09 02:26:52.081334 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:52.081313 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9256fb8a_159d_4dc4_b8f6_7690b7c79dbe.slice/crio-e5310b0c3177763647493946bd10e0459446ebfd17b2d98829c9c9dc91c2c511 WatchSource:0}: Error finding container e5310b0c3177763647493946bd10e0459446ebfd17b2d98829c9c9dc91c2c511: Status 404 returned error can't find the container with id e5310b0c3177763647493946bd10e0459446ebfd17b2d98829c9c9dc91c2c511 Sep 09 02:26:52.106371 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.106328 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m"] Sep 09 02:26:52.114301 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:52.114278 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70864e9_7a9e_41d0_8035_43f133aadfce.slice/crio-b1f493210b486b23944171cbbfb22113f0b0bd4dcbeb63cf47fb92a3bd746b63 WatchSource:0}: Error finding container b1f493210b486b23944171cbbfb22113f0b0bd4dcbeb63cf47fb92a3bd746b63: Status 404 returned error can't find the container with id b1f493210b486b23944171cbbfb22113f0b0bd4dcbeb63cf47fb92a3bd746b63 Sep 09 02:26:52.153675 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.153463 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" event={"ID":"f70864e9-7a9e-41d0-8035-43f133aadfce","Type":"ContainerStarted","Data":"b1f493210b486b23944171cbbfb22113f0b0bd4dcbeb63cf47fb92a3bd746b63"} Sep 09 02:26:52.154384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154185 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-out\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.154384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154214 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.154384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154235 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.154384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154259 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.154384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154284 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.154384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154317 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:26:52.154404 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-trusted-ca-bundle podName:5aa4e7f3-e871-45e8-94b1-e21a3f1885ae nodeName:}" failed. No retries permitted until 2026-09-09 02:26:52.654383727 +0000 UTC m=+54.377364120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae") : configmap references non-existent config key: ca-bundle.crt Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154499 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-web-config\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154527 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154579 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154624 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwwf2\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-kube-api-access-fwwf2\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154651 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.154684 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.157666 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.157666 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.157727 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.157973 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.157985 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.158241 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.158193 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-out\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.159001 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.158308 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.159001 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.158334 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.159001 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.158439 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" event={"ID":"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe","Type":"ContainerStarted","Data":"396de2f96539a8485e0ffbd6406ddd05ec3b61b0fb5213beb73ab06c8670d846"} Sep 09 02:26:52.159001 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.158501 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" event={"ID":"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe","Type":"ContainerStarted","Data":"e5310b0c3177763647493946bd10e0459446ebfd17b2d98829c9c9dc91c2c511"} Sep 09 02:26:52.159368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.159307 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.160202 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.160164 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-web-config\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.160277 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.160247 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.160436 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.160413 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4jj2" event={"ID":"4d8ac876-7b02-4726-af92-b4400a61c596","Type":"ContainerStarted","Data":"567ec64b8037b27d26b7e42769e22b8d881ede08e418a8a752224247e13e4963"} Sep 09 02:26:52.162985 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.162965 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwwf2\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-kube-api-access-fwwf2\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.659641 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.659606 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.660656 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.660626 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:52.876183 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:52.876157 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:26:53.167129 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.167043 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" event={"ID":"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe","Type":"ContainerStarted","Data":"59567ba17c8b55fd1ea4b055873c3d095d6aaa40eb9ccd036f577b5d2a0058f1"} Sep 09 02:26:53.169266 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.169204 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4jj2" event={"ID":"4d8ac876-7b02-4726-af92-b4400a61c596","Type":"ContainerStarted","Data":"901e72701eaa4d2b5c066c2c8730ef3794cde48898e1878e6a66519c77593e7a"} Sep 09 02:26:53.173557 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.173525 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 02:26:53.336209 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:53.336170 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa4e7f3_e871_45e8_94b1_e21a3f1885ae.slice/crio-0aa5bc827914c336035d31ea4f2766bfd8e4f34ed465ef277caac17234857ca5 WatchSource:0}: Error finding container 0aa5bc827914c336035d31ea4f2766bfd8e4f34ed465ef277caac17234857ca5: Status 404 returned error can't find the container with id 0aa5bc827914c336035d31ea4f2766bfd8e4f34ed465ef277caac17234857ca5 Sep 09 02:26:53.975882 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.975796 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-65b7944d4b-xx6xm"] Sep 09 02:26:53.979531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.979504 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:53.982237 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.981998 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 09 02:26:53.982237 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.982041 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 09 02:26:53.982237 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.982068 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 09 02:26:53.982237 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.982085 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8q4977qt8anbg\"" Sep 09 02:26:53.982237 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.982121 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 09 02:26:53.982237 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.982003 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 09 02:26:53.982237 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.981998 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jrhxb\"" Sep 09 02:26:53.990610 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:53.990571 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65b7944d4b-xx6xm"] Sep 09 02:26:54.074029 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.073993 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.074194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.074046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.074194 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.074154 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.074289 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.074193 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4h2h\" (UniqueName: \"kubernetes.io/projected/a81a18a0-1a32-490d-9ce8-f795cfadda14-kube-api-access-t4h2h\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.074289 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.074235 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.074289 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.074277 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a81a18a0-1a32-490d-9ce8-f795cfadda14-metrics-client-ca\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.074469 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.074332 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-grpc-tls\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.074469 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.074381 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-tls\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.174470 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.174433 2569 generic.go:356] "Generic (PLEG): container finished" podID="4d8ac876-7b02-4726-af92-b4400a61c596" containerID="901e72701eaa4d2b5c066c2c8730ef3794cde48898e1878e6a66519c77593e7a" exitCode=0 Sep 09 02:26:54.174896 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.174521 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4jj2" event={"ID":"4d8ac876-7b02-4726-af92-b4400a61c596","Type":"ContainerDied","Data":"901e72701eaa4d2b5c066c2c8730ef3794cde48898e1878e6a66519c77593e7a"} Sep 09 02:26:54.174896 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.174804 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.174896 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.174853 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.175070 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.174900 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.175070 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.174928 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4h2h\" (UniqueName: \"kubernetes.io/projected/a81a18a0-1a32-490d-9ce8-f795cfadda14-kube-api-access-t4h2h\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.175070 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.174957 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.175070 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.174990 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a81a18a0-1a32-490d-9ce8-f795cfadda14-metrics-client-ca\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.175070 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.175030 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-grpc-tls\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.175070 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.175061 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-tls\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.176117 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.176092 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a81a18a0-1a32-490d-9ce8-f795cfadda14-metrics-client-ca\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.177138 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.177106 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerStarted","Data":"0aa5bc827914c336035d31ea4f2766bfd8e4f34ed465ef277caac17234857ca5"} Sep 09 02:26:54.179367 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.178802 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.179367 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.178826 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-grpc-tls\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.179367 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.178881 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-tls\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.179367 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.178906 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.179367 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.178971 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.179367 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.179221 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a81a18a0-1a32-490d-9ce8-f795cfadda14-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.181399 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.181372 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" event={"ID":"f70864e9-7a9e-41d0-8035-43f133aadfce","Type":"ContainerStarted","Data":"14367b7de7883af555ff203b412855c9bfe36644e56232d12500f4231b52b218"} Sep 09 02:26:54.181496 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.181434 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" event={"ID":"f70864e9-7a9e-41d0-8035-43f133aadfce","Type":"ContainerStarted","Data":"6a5e23af4c2ac9e989dfe3672eaa2a55e2ddb66caee02c5c0b172cee58846e6a"} Sep 09 02:26:54.181496 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.181466 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" event={"ID":"f70864e9-7a9e-41d0-8035-43f133aadfce","Type":"ContainerStarted","Data":"d65f5c1e57eee13e055cd0789db01d2508f4827cdbb8e64df93a6f196768ae8e"} Sep 09 02:26:54.182363 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.182304 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4h2h\" (UniqueName: \"kubernetes.io/projected/a81a18a0-1a32-490d-9ce8-f795cfadda14-kube-api-access-t4h2h\") pod \"thanos-querier-65b7944d4b-xx6xm\" (UID: \"a81a18a0-1a32-490d-9ce8-f795cfadda14\") " pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.184022 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.183995 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" event={"ID":"9256fb8a-159d-4dc4-b8f6-7690b7c79dbe","Type":"ContainerStarted","Data":"8f2d5da24b463bfec1cb38379b2316ca667bd84d6370072226c44b76c2077bc9"} Sep 09 02:26:54.208514 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.208459 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-pjr8m" podStartSLOduration=2.7381571239999998 podStartE2EDuration="4.2084366s" totalImagesPullingTime="1.470279476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:54.206883313 +0000 UTC m=+55.929863704" watchObservedRunningTime="2026-09-09 02:26:54.2084366 +0000 UTC m=+55.931416998" Sep 09 02:26:54.224418 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.224359 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bg8cf" podStartSLOduration=2.841772109 podStartE2EDuration="4.22432413s" totalImagesPullingTime="1.382552021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:54.223014817 +0000 UTC m=+55.945995215" watchObservedRunningTime="2026-09-09 02:26:54.22432413 +0000 UTC m=+55.947304528" Sep 09 02:26:54.291541 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.291506 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:26:54.577854 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:54.577827 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65b7944d4b-xx6xm"] Sep 09 02:26:54.580169 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:54.580142 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81a18a0_1a32_490d_9ce8_f795cfadda14.slice/crio-b0fb61676c4ece1d9bb193b68d2e892296a5e73ed9e1cd5d83673c670fb4c769 WatchSource:0}: Error finding container b0fb61676c4ece1d9bb193b68d2e892296a5e73ed9e1cd5d83673c670fb4c769: Status 404 returned error can't find the container with id b0fb61676c4ece1d9bb193b68d2e892296a5e73ed9e1cd5d83673c670fb4c769 Sep 09 02:26:55.189677 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.189635 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" event={"ID":"a81a18a0-1a32-490d-9ce8-f795cfadda14","Type":"ContainerStarted","Data":"b0fb61676c4ece1d9bb193b68d2e892296a5e73ed9e1cd5d83673c670fb4c769"} Sep 09 02:26:55.192439 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.192407 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4jj2" event={"ID":"4d8ac876-7b02-4726-af92-b4400a61c596","Type":"ContainerStarted","Data":"a4eb560f3f5c3093deff2ec53ce9ecc89d4f6550a8578e1af8ff89f281955b42"} Sep 09 02:26:55.192579 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.192460 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4jj2" event={"ID":"4d8ac876-7b02-4726-af92-b4400a61c596","Type":"ContainerStarted","Data":"08d87945a2beafd1265dccc9fe3be3a99e6631eb713e8562355d223418952952"} Sep 09 02:26:55.194134 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.194105 2569 generic.go:356] "Generic (PLEG): container finished" podID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerID="a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d" exitCode=0 Sep 09 02:26:55.194269 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.194184 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerDied","Data":"a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d"} Sep 09 02:26:55.236712 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.236657 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h4jj2" podStartSLOduration=4.146467701 podStartE2EDuration="5.236636979s" totalImagesPullingTime="1.018971887s" totalInitContainerRuntime="71.197391ms" isStatefulPod=true podCreationTimestamp="2026-09-09 02:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:55.211107385 +0000 UTC m=+56.934087785" watchObservedRunningTime="2026-09-09 02:26:55.236636979 +0000 UTC m=+56.959617378" Sep 09 02:26:55.318211 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.318175 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-bc56664f4-qzlfn"] Sep 09 02:26:55.322427 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.322406 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.325064 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.324847 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 09 02:26:55.325064 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.324920 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9uktl4im6e6s5\"" Sep 09 02:26:55.325064 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.324934 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-smdss\"" Sep 09 02:26:55.325064 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.324973 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 09 02:26:55.325064 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.324982 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 09 02:26:55.325365 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.325192 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 02:26:55.329399 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.329365 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bc56664f4-qzlfn"] Sep 09 02:26:55.488206 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.488120 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9669f086-f924-4e4b-b613-8e6817a03690-secret-metrics-server-tls\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.488206 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.488178 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9669f086-f924-4e4b-b613-8e6817a03690-client-ca-bundle\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.488407 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.488248 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9669f086-f924-4e4b-b613-8e6817a03690-metrics-server-audit-profiles\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.488407 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.488331 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9669f086-f924-4e4b-b613-8e6817a03690-secret-metrics-server-client-certs\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.488407 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.488376 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjgtt\" (UniqueName: \"kubernetes.io/projected/9669f086-f924-4e4b-b613-8e6817a03690-kube-api-access-rjgtt\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.488529 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.488439 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9669f086-f924-4e4b-b613-8e6817a03690-audit-log\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.488529 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.488495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9669f086-f924-4e4b-b613-8e6817a03690-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.589651 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.589614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjgtt\" (UniqueName: \"kubernetes.io/projected/9669f086-f924-4e4b-b613-8e6817a03690-kube-api-access-rjgtt\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.589828 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.589683 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9669f086-f924-4e4b-b613-8e6817a03690-audit-log\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.589828 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.589730 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9669f086-f924-4e4b-b613-8e6817a03690-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.589828 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.589770 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9669f086-f924-4e4b-b613-8e6817a03690-secret-metrics-server-tls\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.589828 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.589805 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9669f086-f924-4e4b-b613-8e6817a03690-client-ca-bundle\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.590036 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.589832 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9669f086-f924-4e4b-b613-8e6817a03690-metrics-server-audit-profiles\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.590036 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.589894 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9669f086-f924-4e4b-b613-8e6817a03690-secret-metrics-server-client-certs\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.590144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.590119 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9669f086-f924-4e4b-b613-8e6817a03690-audit-log\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.590498 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.590471 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9669f086-f924-4e4b-b613-8e6817a03690-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.590772 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.590751 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9669f086-f924-4e4b-b613-8e6817a03690-metrics-server-audit-profiles\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.592325 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.592300 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9669f086-f924-4e4b-b613-8e6817a03690-client-ca-bundle\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.592440 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.592328 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9669f086-f924-4e4b-b613-8e6817a03690-secret-metrics-server-tls\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.592440 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.592325 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9669f086-f924-4e4b-b613-8e6817a03690-secret-metrics-server-client-certs\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.598041 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.598018 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjgtt\" (UniqueName: \"kubernetes.io/projected/9669f086-f924-4e4b-b613-8e6817a03690-kube-api-access-rjgtt\") pod \"metrics-server-bc56664f4-qzlfn\" (UID: \"9669f086-f924-4e4b-b613-8e6817a03690\") " pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.634934 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.634902 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:26:55.674187 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.674151 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4"] Sep 09 02:26:55.678994 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.678406 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:26:55.681013 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.680808 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4q5mq\"" Sep 09 02:26:55.681013 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.680959 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 09 02:26:55.690948 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.690880 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4"] Sep 09 02:26:55.792482 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.792394 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/180dfcee-9d88-46c6-96b9-5f25d32e9d38-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-j8vt4\" (UID: \"180dfcee-9d88-46c6-96b9-5f25d32e9d38\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:26:55.792658 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.792532 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntbcs\" (UniqueName: \"kubernetes.io/projected/180dfcee-9d88-46c6-96b9-5f25d32e9d38-kube-api-access-ntbcs\") pod \"monitoring-plugin-85bbbbbf4-j8vt4\" (UID: \"180dfcee-9d88-46c6-96b9-5f25d32e9d38\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:26:55.893906 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.893865 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntbcs\" (UniqueName: \"kubernetes.io/projected/180dfcee-9d88-46c6-96b9-5f25d32e9d38-kube-api-access-ntbcs\") pod \"monitoring-plugin-85bbbbbf4-j8vt4\" (UID: \"180dfcee-9d88-46c6-96b9-5f25d32e9d38\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:26:55.894097 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.893990 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/180dfcee-9d88-46c6-96b9-5f25d32e9d38-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-j8vt4\" (UID: \"180dfcee-9d88-46c6-96b9-5f25d32e9d38\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:26:55.896859 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.896828 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/180dfcee-9d88-46c6-96b9-5f25d32e9d38-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-j8vt4\" (UID: \"180dfcee-9d88-46c6-96b9-5f25d32e9d38\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:26:55.903301 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.903274 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntbcs\" (UniqueName: \"kubernetes.io/projected/180dfcee-9d88-46c6-96b9-5f25d32e9d38-kube-api-access-ntbcs\") pod \"monitoring-plugin-85bbbbbf4-j8vt4\" (UID: \"180dfcee-9d88-46c6-96b9-5f25d32e9d38\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:26:55.927739 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.927707 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bc56664f4-qzlfn"] Sep 09 02:26:55.931141 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:55.931115 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9669f086_f924_4e4b_b613_8e6817a03690.slice/crio-d6bcd32cf81bf01f3e961d8f24d3e20fc0278312ba93eb3a4b26f35ff25bcb18 WatchSource:0}: Error finding container d6bcd32cf81bf01f3e961d8f24d3e20fc0278312ba93eb3a4b26f35ff25bcb18: Status 404 returned error can't find the container with id d6bcd32cf81bf01f3e961d8f24d3e20fc0278312ba93eb3a4b26f35ff25bcb18 Sep 09 02:26:55.999382 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:55.999350 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:26:56.200154 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:56.200119 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" event={"ID":"9669f086-f924-4e4b-b613-8e6817a03690","Type":"ContainerStarted","Data":"d6bcd32cf81bf01f3e961d8f24d3e20fc0278312ba93eb3a4b26f35ff25bcb18"} Sep 09 02:26:56.282425 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:56.282391 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4"] Sep 09 02:26:56.945904 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:56.945867 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180dfcee_9d88_46c6_96b9_5f25d32e9d38.slice/crio-fe152525b1f29ac5148582791073cc759bd42ef8ee495639b4ada0b50f8631bd WatchSource:0}: Error finding container fe152525b1f29ac5148582791073cc759bd42ef8ee495639b4ada0b50f8631bd: Status 404 returned error can't find the container with id fe152525b1f29ac5148582791073cc759bd42ef8ee495639b4ada0b50f8631bd Sep 09 02:26:57.113666 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.113084 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 02:26:57.117439 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.117418 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.120174 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.120151 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 02:26:57.121917 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.121262 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-94sd180ai1pl7\"" Sep 09 02:26:57.121917 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.121437 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 02:26:57.121917 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.121521 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 02:26:57.121917 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.121659 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 02:26:57.121917 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.121747 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 02:26:57.121917 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.121862 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 02:26:57.122384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.122090 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 02:26:57.122384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.122126 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 02:26:57.122384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.122365 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 02:26:57.122587 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.122572 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 02:26:57.122956 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.122788 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 02:26:57.123324 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.123200 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 02:26:57.123452 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.123369 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cnvcx\"" Sep 09 02:26:57.123541 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.123505 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 02:26:57.124585 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.124259 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 02:26:57.132204 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.132179 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 02:26:57.202940 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.202880 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.202976 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203022 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh6hv\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-kube-api-access-zh6hv\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203087 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203128 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203164 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-web-config\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203223 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203276 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203300 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203323 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203376 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203413 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config-out\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203435 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203453 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203466 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203485 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203501 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203529 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.203841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.203569 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.209614 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.209517 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerStarted","Data":"a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0"} Sep 09 02:26:57.209614 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.209583 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerStarted","Data":"b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a"} Sep 09 02:26:57.211025 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.211001 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" event={"ID":"180dfcee-9d88-46c6-96b9-5f25d32e9d38","Type":"ContainerStarted","Data":"fe152525b1f29ac5148582791073cc759bd42ef8ee495639b4ada0b50f8631bd"} Sep 09 02:26:57.213598 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.213475 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" event={"ID":"a81a18a0-1a32-490d-9ce8-f795cfadda14","Type":"ContainerStarted","Data":"1e03a43f6c4fb5a7d818bcfb063920008d971786c5907abf84234ee3a96a8ef4"} Sep 09 02:26:57.213598 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.213548 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" event={"ID":"a81a18a0-1a32-490d-9ce8-f795cfadda14","Type":"ContainerStarted","Data":"f8254a1959867ba97473c9875ff18f448ccfead6f569fe1d8d788383704f3d85"} Sep 09 02:26:57.304523 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304492 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.304667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304536 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.304667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304553 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.304667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304567 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.304667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304584 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.304667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304615 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config-out\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.304667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.304667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304653 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304669 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304698 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304714 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304741 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304764 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304793 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304822 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304853 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh6hv\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-kube-api-access-zh6hv\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304885 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304920 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304957 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-web-config\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.305015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.304986 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.308066 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.307862 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.308066 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.308027 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.308788 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.308452 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.308963 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.308940 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.311429 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.310275 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.311429 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.310574 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.311429 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.310730 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.311429 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.310793 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.311429 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.311102 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.311844 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.311563 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.311844 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.311580 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.311844 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.311673 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-web-config\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.312281 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.312257 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config-out\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.312442 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.312420 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.314609 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.314581 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.315617 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.315594 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.315822 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.315793 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.316021 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.316002 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.316590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.316569 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.319021 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.318996 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh6hv\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-kube-api-access-zh6hv\") pod \"prometheus-k8s-0\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.445064 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.445021 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:26:57.957895 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:57.957864 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 02:26:57.961308 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:26:57.961236 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ca0f42_1c6b_479b_9699_3dd97ab4c194.slice/crio-04163f0737a4dd50c152d9704696a7d492cbcccfa186a19f4c33aa93f5f2998e WatchSource:0}: Error finding container 04163f0737a4dd50c152d9704696a7d492cbcccfa186a19f4c33aa93f5f2998e: Status 404 returned error can't find the container with id 04163f0737a4dd50c152d9704696a7d492cbcccfa186a19f4c33aa93f5f2998e Sep 09 02:26:58.220850 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:58.220817 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" event={"ID":"a81a18a0-1a32-490d-9ce8-f795cfadda14","Type":"ContainerStarted","Data":"bc940a6503a77ead0bddb1f14b8b6871bca5553dcb6be919373db6b00f6e92bd"} Sep 09 02:26:58.223014 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:58.222986 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" event={"ID":"9669f086-f924-4e4b-b613-8e6817a03690","Type":"ContainerStarted","Data":"37ef4c3d0422092f0ff3cd4aa0e305c8365a823a35a3b4e3de88497453e3fe80"} Sep 09 02:26:58.224440 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:58.224403 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerStarted","Data":"04163f0737a4dd50c152d9704696a7d492cbcccfa186a19f4c33aa93f5f2998e"} Sep 09 02:26:58.227984 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:58.227960 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerStarted","Data":"83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577"} Sep 09 02:26:58.228073 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:58.228028 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerStarted","Data":"b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb"} Sep 09 02:26:58.228073 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:58.228069 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerStarted","Data":"f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8"} Sep 09 02:26:58.239765 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:58.239714 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" podStartSLOduration=1.43337528 podStartE2EDuration="3.239693603s" totalImagesPullingTime="1.806318323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:26:58.23865 +0000 UTC m=+59.961630432" watchObservedRunningTime="2026-09-09 02:26:58.239693603 +0000 UTC m=+59.962673993" Sep 09 02:26:59.233765 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:59.233734 2569 generic.go:356] "Generic (PLEG): container finished" podID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerID="e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd" exitCode=0 Sep 09 02:26:59.234172 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:26:59.233807 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerDied","Data":"e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd"} Sep 09 02:27:00.153084 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.153046 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4795s" Sep 09 02:27:00.240689 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.240653 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" event={"ID":"180dfcee-9d88-46c6-96b9-5f25d32e9d38","Type":"ContainerStarted","Data":"5403c8c85eeb52e718cd738a543ba76715a3350c5a7707bc763f5f6a2ac34e11"} Sep 09 02:27:00.241238 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.240828 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:27:00.245696 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.245208 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" event={"ID":"a81a18a0-1a32-490d-9ce8-f795cfadda14","Type":"ContainerStarted","Data":"38c1303ab655e253883a9c87ef3afa934bea8519f20d903024941236f1cbb4c3"} Sep 09 02:27:00.245696 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.245280 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" event={"ID":"a81a18a0-1a32-490d-9ce8-f795cfadda14","Type":"ContainerStarted","Data":"83ccddc9c5dd2e717c60a8d662f610a848f5cec58ba310f06c41cb3d8021b2b7"} Sep 09 02:27:00.245696 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.245327 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" event={"ID":"a81a18a0-1a32-490d-9ce8-f795cfadda14","Type":"ContainerStarted","Data":"33027a45b9cacd46151d51f51882806e365b3b64f0a6e1585771b7d96587c0e8"} Sep 09 02:27:00.245696 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.245388 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:27:00.247448 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.247423 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" Sep 09 02:27:00.251784 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.251756 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerStarted","Data":"57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9"} Sep 09 02:27:00.256375 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.256315 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-j8vt4" podStartSLOduration=3.061112419 podStartE2EDuration="5.256302666s" totalImagesPullingTime="2.195190247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:00.2561127 +0000 UTC m=+61.979093129" watchObservedRunningTime="2026-09-09 02:27:00.256302666 +0000 UTC m=+61.979283075" Sep 09 02:27:00.285042 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.284973 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.009578213 podStartE2EDuration="9.284951003s" totalImagesPullingTime="4.25961159s" totalInitContainerRuntime="15.7612ms" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:00.282800011 +0000 UTC m=+62.005780433" watchObservedRunningTime="2026-09-09 02:27:00.284951003 +0000 UTC m=+62.007931404" Sep 09 02:27:00.318962 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:00.318898 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" podStartSLOduration=2.966603526 podStartE2EDuration="7.318874537s" totalImagesPullingTime="4.352271011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:00.317802361 +0000 UTC m=+62.040782794" watchObservedRunningTime="2026-09-09 02:27:00.318874537 +0000 UTC m=+62.041854936" Sep 09 02:27:01.089662 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:01.089631 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvxwv" Sep 09 02:27:02.266415 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:02.266214 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerStarted","Data":"eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949"} Sep 09 02:27:02.266415 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:02.266290 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerStarted","Data":"be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a"} Sep 09 02:27:02.266415 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:02.266354 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerStarted","Data":"7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439"} Sep 09 02:27:03.273527 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.273489 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerStarted","Data":"e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416"} Sep 09 02:27:03.273978 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.273582 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerStarted","Data":"5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56"} Sep 09 02:27:03.273978 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.273611 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerStarted","Data":"91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b"} Sep 09 02:27:03.305462 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.305408 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.4248122739999998 podStartE2EDuration="6.305388095s" totalImagesPullingTime="2.842036967s" totalInitContainerRuntime="38.538854ms" isStatefulPod=false podCreationTimestamp="2026-09-09 02:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:03.303471951 +0000 UTC m=+65.026452369" watchObservedRunningTime="2026-09-09 02:27:03.305388095 +0000 UTC m=+65.028368547" Sep 09 02:27:03.566106 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.566002 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:27:03.566106 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.566078 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:27:03.566106 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.566101 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:27:03.568591 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.568572 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 02:27:03.568591 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.568582 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 02:27:03.568678 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.568662 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 02:27:03.579361 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.579312 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 02:27:03.579361 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.579328 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c76f9c4-ed70-493b-b740-8d39b521b632-original-pull-secret\") pod \"global-pull-secret-syncer-kbfm9\" (UID: \"9c76f9c4-ed70-493b-b740-8d39b521b632\") " pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:27:03.579514 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.579365 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b35c6a8a-f317-44f5-beab-f0c46fd31ee5-metrics-certs\") pod \"network-metrics-daemon-2x72t\" (UID: \"b35c6a8a-f317-44f5-beab-f0c46fd31ee5\") " pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:27:03.589296 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.589266 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqfwm\" (UniqueName: \"kubernetes.io/projected/ace583ca-20c8-40bf-a3fa-aec1bf334eeb-kube-api-access-zqfwm\") pod \"network-check-target-hfwfs\" (UID: \"ace583ca-20c8-40bf-a3fa-aec1bf334eeb\") " pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:27:03.745807 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.745775 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kbfm9" Sep 09 02:27:03.753652 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.753630 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v2n6b\"" Sep 09 02:27:03.762453 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.762430 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:27:03.786436 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.786405 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-swb8h\"" Sep 09 02:27:03.794929 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:03.794905 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x72t" Sep 09 02:27:04.014783 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:04.014759 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kbfm9"] Sep 09 02:27:04.017083 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:27:04.017058 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c76f9c4_ed70_493b_b740_8d39b521b632.slice/crio-c95217ffdd6266152b6f229330bafddd89b3795c089b3f09137955efc9639d96 WatchSource:0}: Error finding container c95217ffdd6266152b6f229330bafddd89b3795c089b3f09137955efc9639d96: Status 404 returned error can't find the container with id c95217ffdd6266152b6f229330bafddd89b3795c089b3f09137955efc9639d96 Sep 09 02:27:04.040588 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:04.040561 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hfwfs"] Sep 09 02:27:04.043092 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:27:04.043067 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace583ca_20c8_40bf_a3fa_aec1bf334eeb.slice/crio-67295030476e85b83a5d27877473cd652bd172ee4a08def8e80a5e850437db70 WatchSource:0}: Error finding container 67295030476e85b83a5d27877473cd652bd172ee4a08def8e80a5e850437db70: Status 404 returned error can't find the container with id 67295030476e85b83a5d27877473cd652bd172ee4a08def8e80a5e850437db70 Sep 09 02:27:04.079805 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:04.079783 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2x72t"] Sep 09 02:27:04.082048 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:27:04.082025 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35c6a8a_f317_44f5_beab_f0c46fd31ee5.slice/crio-6d6a217078f78e7cbe11f7ecb8657dff44b528d5f572cc48b8683c9de0b2ec67 WatchSource:0}: Error finding container 6d6a217078f78e7cbe11f7ecb8657dff44b528d5f572cc48b8683c9de0b2ec67: Status 404 returned error can't find the container with id 6d6a217078f78e7cbe11f7ecb8657dff44b528d5f572cc48b8683c9de0b2ec67 Sep 09 02:27:04.278805 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:04.278768 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2x72t" event={"ID":"b35c6a8a-f317-44f5-beab-f0c46fd31ee5","Type":"ContainerStarted","Data":"6d6a217078f78e7cbe11f7ecb8657dff44b528d5f572cc48b8683c9de0b2ec67"} Sep 09 02:27:04.280004 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:04.279983 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kbfm9" event={"ID":"9c76f9c4-ed70-493b-b740-8d39b521b632","Type":"ContainerStarted","Data":"c95217ffdd6266152b6f229330bafddd89b3795c089b3f09137955efc9639d96"} Sep 09 02:27:04.281169 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:04.281146 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hfwfs" event={"ID":"ace583ca-20c8-40bf-a3fa-aec1bf334eeb","Type":"ContainerStarted","Data":"67295030476e85b83a5d27877473cd652bd172ee4a08def8e80a5e850437db70"} Sep 09 02:27:05.300532 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:05.300404 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2x72t" event={"ID":"b35c6a8a-f317-44f5-beab-f0c46fd31ee5","Type":"ContainerStarted","Data":"522a51646d837e241c61b091f8022c768dec6de68230ede72270a7bcfa61c120"} Sep 09 02:27:06.264555 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:06.264525 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-65b7944d4b-xx6xm" Sep 09 02:27:06.308759 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:06.308720 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2x72t" event={"ID":"b35c6a8a-f317-44f5-beab-f0c46fd31ee5","Type":"ContainerStarted","Data":"5af83ca17d3b7c8f2662d970ee8d0b20855b8fcbaf8769c48cf3919ad2913837"} Sep 09 02:27:06.323244 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:06.323185 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2x72t" podStartSLOduration=66.284446802 podStartE2EDuration="1m7.323166163s" totalImagesPullingTime="1.038719361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:06.323038397 +0000 UTC m=+68.046018796" watchObservedRunningTime="2026-09-09 02:27:06.323166163 +0000 UTC m=+68.046146562" Sep 09 02:27:07.445764 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:07.445729 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:09.323884 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:09.323831 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hfwfs" event={"ID":"ace583ca-20c8-40bf-a3fa-aec1bf334eeb","Type":"ContainerStarted","Data":"557add3765be650a206829ac4bf09a4e117ecc2a71d58e0127b8859e04f9175d"} Sep 09 02:27:09.324313 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:09.323950 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:27:09.325374 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:09.325334 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kbfm9" event={"ID":"9c76f9c4-ed70-493b-b740-8d39b521b632","Type":"ContainerStarted","Data":"33662fe0faad631d2129b6c911a455b4466ef67103ca0787a5005ad7f4cb8c17"} Sep 09 02:27:09.339016 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:09.338962 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hfwfs" podStartSLOduration=65.591365946 podStartE2EDuration="1m10.338945582s" totalImagesPullingTime="4.747579636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:09.337361806 +0000 UTC m=+71.060342217" watchObservedRunningTime="2026-09-09 02:27:09.338945582 +0000 UTC m=+71.061925980" Sep 09 02:27:09.349698 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:09.349633 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kbfm9" podStartSLOduration=65.572178124 podStartE2EDuration="1m10.349613742s" totalImagesPullingTime="4.777435618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:09.349530651 +0000 UTC m=+71.072511050" watchObservedRunningTime="2026-09-09 02:27:09.349613742 +0000 UTC m=+71.072594141" Sep 09 02:27:11.793519 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.793456 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d6b948f6f-q8nb7"] Sep 09 02:27:11.806853 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.806821 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6b948f6f-q8nb7"] Sep 09 02:27:11.807012 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.806928 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.809165 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.809140 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 02:27:11.809299 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.809262 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7lvnp\"" Sep 09 02:27:11.809378 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.809334 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 02:27:11.809545 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.809488 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 02:27:11.810099 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.810080 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 02:27:11.810217 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.810135 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 02:27:11.810414 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.810398 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 02:27:11.810843 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.810826 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 02:27:11.839360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.835837 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-config\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.839360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.835947 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-oauth-config\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.839360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.836022 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trzmv\" (UniqueName: \"kubernetes.io/projected/26ea52c1-9b91-4cd2-98e6-3a41306b351d-kube-api-access-trzmv\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.839360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.836077 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-serving-cert\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.839360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.836125 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-service-ca\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.839360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.836158 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-oauth-serving-cert\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.937368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.937299 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trzmv\" (UniqueName: \"kubernetes.io/projected/26ea52c1-9b91-4cd2-98e6-3a41306b351d-kube-api-access-trzmv\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.937571 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.937388 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-serving-cert\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.937571 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.937425 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-service-ca\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.937571 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.937449 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-oauth-serving-cert\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.937711 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.937575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-config\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.937711 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.937621 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-oauth-config\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.938185 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.938162 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-oauth-serving-cert\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.938288 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.938265 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-service-ca\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.938331 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.938285 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-config\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.939830 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.939802 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-serving-cert\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.939927 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.939851 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-oauth-config\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:11.944607 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:11.944584 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trzmv\" (UniqueName: \"kubernetes.io/projected/26ea52c1-9b91-4cd2-98e6-3a41306b351d-kube-api-access-trzmv\") pod \"console-7d6b948f6f-q8nb7\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:12.116841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:12.116749 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:12.385155 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:12.385129 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d6b948f6f-q8nb7"] Sep 09 02:27:12.387663 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:27:12.387641 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ea52c1_9b91_4cd2_98e6_3a41306b351d.slice/crio-8580035b06deddcbd452239aadf87f10d67c08dc469eb7835ef3c74f19c0f5c5 WatchSource:0}: Error finding container 8580035b06deddcbd452239aadf87f10d67c08dc469eb7835ef3c74f19c0f5c5: Status 404 returned error can't find the container with id 8580035b06deddcbd452239aadf87f10d67c08dc469eb7835ef3c74f19c0f5c5 Sep 09 02:27:13.344363 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:13.344304 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6b948f6f-q8nb7" event={"ID":"26ea52c1-9b91-4cd2-98e6-3a41306b351d","Type":"ContainerStarted","Data":"8580035b06deddcbd452239aadf87f10d67c08dc469eb7835ef3c74f19c0f5c5"} Sep 09 02:27:15.356532 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:15.356497 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6b948f6f-q8nb7" event={"ID":"26ea52c1-9b91-4cd2-98e6-3a41306b351d","Type":"ContainerStarted","Data":"c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1"} Sep 09 02:27:15.373512 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:15.373461 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d6b948f6f-q8nb7" podStartSLOduration=1.567239533 podStartE2EDuration="4.373445096s" totalImagesPullingTime="2.806205563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:15.372026197 +0000 UTC m=+77.095006608" watchObservedRunningTime="2026-09-09 02:27:15.373445096 +0000 UTC m=+77.096425504" Sep 09 02:27:15.635353 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:15.635305 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:27:15.635523 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:15.635383 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:27:20.110870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.110832 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58698f889d-d2w55"] Sep 09 02:27:20.114178 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.114157 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.121260 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.121235 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 02:27:20.126770 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.126743 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58698f889d-d2w55"] Sep 09 02:27:20.210674 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.210640 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-oauth-config\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.210844 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.210694 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-config\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.210844 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.210710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-service-ca\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.210844 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.210760 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-trusted-ca-bundle\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.210844 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.210802 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-serving-cert\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.210844 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.210819 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpnr7\" (UniqueName: \"kubernetes.io/projected/3adcedb5-6b6e-490d-9854-52f8d1903f43-kube-api-access-rpnr7\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.210996 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.210861 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-oauth-serving-cert\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.311701 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.311668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-oauth-config\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.311862 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.311718 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-config\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.311862 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.311734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-service-ca\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.311862 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.311757 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-trusted-ca-bundle\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.311862 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.311781 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-serving-cert\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.311862 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.311795 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpnr7\" (UniqueName: \"kubernetes.io/projected/3adcedb5-6b6e-490d-9854-52f8d1903f43-kube-api-access-rpnr7\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.311862 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.311816 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-oauth-serving-cert\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.312532 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.312503 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-config\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.312532 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.312519 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-service-ca\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.312715 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.312546 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-oauth-serving-cert\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.312774 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.312750 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-trusted-ca-bundle\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.314318 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.314295 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-oauth-config\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.314437 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.314397 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-serving-cert\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.319360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.319311 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpnr7\" (UniqueName: \"kubernetes.io/projected/3adcedb5-6b6e-490d-9854-52f8d1903f43-kube-api-access-rpnr7\") pod \"console-58698f889d-d2w55\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.423493 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.423395 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:20.695677 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:20.695554 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58698f889d-d2w55"] Sep 09 02:27:20.698245 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:27:20.698204 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adcedb5_6b6e_490d_9854_52f8d1903f43.slice/crio-f35daa90c9b1c043e7cba9f87ce8669933e6cb049e3c87bb9f0bcafa40e30fde WatchSource:0}: Error finding container f35daa90c9b1c043e7cba9f87ce8669933e6cb049e3c87bb9f0bcafa40e30fde: Status 404 returned error can't find the container with id f35daa90c9b1c043e7cba9f87ce8669933e6cb049e3c87bb9f0bcafa40e30fde Sep 09 02:27:21.382314 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:21.382278 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58698f889d-d2w55" event={"ID":"3adcedb5-6b6e-490d-9854-52f8d1903f43","Type":"ContainerStarted","Data":"6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2"} Sep 09 02:27:21.382704 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:21.382331 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58698f889d-d2w55" event={"ID":"3adcedb5-6b6e-490d-9854-52f8d1903f43","Type":"ContainerStarted","Data":"f35daa90c9b1c043e7cba9f87ce8669933e6cb049e3c87bb9f0bcafa40e30fde"} Sep 09 02:27:21.401922 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:21.401875 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58698f889d-d2w55" podStartSLOduration=1.401859663 podStartE2EDuration="1.401859663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:27:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:21.401105662 +0000 UTC m=+83.124086094" watchObservedRunningTime="2026-09-09 02:27:21.401859663 +0000 UTC m=+83.124840060" Sep 09 02:27:22.117202 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:22.117160 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:22.117430 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:22.117221 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:22.122154 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:22.122129 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:22.390164 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:22.390094 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:29.044272 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:29.044228 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:29.063525 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:29.063497 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:29.429944 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:29.429871 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:30.424420 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:30.424388 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:30.424794 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:30.424440 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:30.429433 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:30.429409 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:31.427109 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:31.427082 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:27:31.468140 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:31.468099 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6b948f6f-q8nb7"] Sep 09 02:27:35.640894 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:35.640863 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:27:35.644731 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:35.644707 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-bc56664f4-qzlfn" Sep 09 02:27:40.333144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:40.333105 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hfwfs" Sep 09 02:27:41.161848 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.161814 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 02:27:41.162184 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.162130 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="alertmanager" containerID="cri-o://b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a" gracePeriod=120 Sep 09 02:27:41.162304 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.162185 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy-metric" containerID="cri-o://83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577" gracePeriod=120 Sep 09 02:27:41.162304 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.162237 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy-web" containerID="cri-o://f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8" gracePeriod=120 Sep 09 02:27:41.162450 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.162298 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="prom-label-proxy" containerID="cri-o://57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9" gracePeriod=120 Sep 09 02:27:41.162450 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.162333 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="config-reloader" containerID="cri-o://a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0" gracePeriod=120 Sep 09 02:27:41.162450 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.162391 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy" containerID="cri-o://b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb" gracePeriod=120 Sep 09 02:27:41.468808 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.468727 2569 generic.go:356] "Generic (PLEG): container finished" podID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerID="57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9" exitCode=0 Sep 09 02:27:41.468808 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.468751 2569 generic.go:356] "Generic (PLEG): container finished" podID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerID="b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb" exitCode=0 Sep 09 02:27:41.468808 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.468759 2569 generic.go:356] "Generic (PLEG): container finished" podID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerID="a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0" exitCode=0 Sep 09 02:27:41.468808 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.468764 2569 generic.go:356] "Generic (PLEG): container finished" podID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerID="b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a" exitCode=0 Sep 09 02:27:41.469223 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.468803 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerDied","Data":"57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9"} Sep 09 02:27:41.469223 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.468869 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerDied","Data":"b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb"} Sep 09 02:27:41.469223 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.468895 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerDied","Data":"a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0"} Sep 09 02:27:41.469223 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:41.468917 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerDied","Data":"b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a"} Sep 09 02:27:42.430723 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.430693 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.477147 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.477065 2569 generic.go:356] "Generic (PLEG): container finished" podID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerID="83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577" exitCode=0 Sep 09 02:27:42.477147 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.477095 2569 generic.go:356] "Generic (PLEG): container finished" podID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerID="f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8" exitCode=0 Sep 09 02:27:42.477147 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.477113 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerDied","Data":"83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577"} Sep 09 02:27:42.477683 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.477147 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.477683 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.477204 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerDied","Data":"f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8"} Sep 09 02:27:42.477683 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.477253 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae","Type":"ContainerDied","Data":"0aa5bc827914c336035d31ea4f2766bfd8e4f34ed465ef277caac17234857ca5"} Sep 09 02:27:42.477683 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.477276 2569 scope.go:117] "RemoveContainer" containerID="57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9" Sep 09 02:27:42.487906 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.487887 2569 scope.go:117] "RemoveContainer" containerID="83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577" Sep 09 02:27:42.495110 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.495092 2569 scope.go:117] "RemoveContainer" containerID="b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb" Sep 09 02:27:42.501896 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.501880 2569 scope.go:117] "RemoveContainer" containerID="f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8" Sep 09 02:27:42.509312 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.509292 2569 scope.go:117] "RemoveContainer" containerID="a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0" Sep 09 02:27:42.511515 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511495 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.511601 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511523 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.511601 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511543 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.511601 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511566 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-cluster-tls-config\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.511767 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511620 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-metrics-client-ca\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.511767 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511647 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-trusted-ca-bundle\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.511767 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511675 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-web-config\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.511767 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511700 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-main-db\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.511767 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511733 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-volume\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.512009 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511777 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-out\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.512009 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511815 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-main-tls\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.512009 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511847 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-tls-assets\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.512009 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.511879 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwwf2\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-kube-api-access-fwwf2\") pod \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\" (UID: \"5aa4e7f3-e871-45e8-94b1-e21a3f1885ae\") " Sep 09 02:27:42.512523 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.512414 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:42.512633 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.512543 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:42.515006 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.512879 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:27:42.515006 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.514612 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:42.516224 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.516146 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-kube-api-access-fwwf2" (OuterVolumeSpecName: "kube-api-access-fwwf2") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "kube-api-access-fwwf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:27:42.516449 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.516240 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:42.516449 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.516405 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:27:42.517196 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.516734 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-volume" (OuterVolumeSpecName: "config-volume") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:42.517196 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.516830 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:42.517196 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.516900 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:42.517590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.517565 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-out" (OuterVolumeSpecName: "config-out") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:27:42.520537 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.520353 2569 scope.go:117] "RemoveContainer" containerID="b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a" Sep 09 02:27:42.521634 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.521609 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:42.530212 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.530183 2569 scope.go:117] "RemoveContainer" containerID="a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d" Sep 09 02:27:42.531458 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.531439 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-web-config" (OuterVolumeSpecName: "web-config") pod "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" (UID: "5aa4e7f3-e871-45e8-94b1-e21a3f1885ae"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:42.542844 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.542826 2569 scope.go:117] "RemoveContainer" containerID="57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9" Sep 09 02:27:42.543116 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:42.543097 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9\": container with ID starting with 57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9 not found: ID does not exist" containerID="57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9" Sep 09 02:27:42.543161 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.543125 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9"} err="failed to get container status \"57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9\": rpc error: code = NotFound desc = could not find container \"57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9\": container with ID starting with 57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9 not found: ID does not exist" Sep 09 02:27:42.543161 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.543156 2569 scope.go:117] "RemoveContainer" containerID="83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577" Sep 09 02:27:42.543429 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:42.543411 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577\": container with ID starting with 83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577 not found: ID does not exist" containerID="83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577" Sep 09 02:27:42.543489 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.543437 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577"} err="failed to get container status \"83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577\": rpc error: code = NotFound desc = could not find container \"83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577\": container with ID starting with 83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577 not found: ID does not exist" Sep 09 02:27:42.543489 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.543456 2569 scope.go:117] "RemoveContainer" containerID="b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb" Sep 09 02:27:42.543695 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:42.543679 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb\": container with ID starting with b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb not found: ID does not exist" containerID="b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb" Sep 09 02:27:42.543735 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.543698 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb"} err="failed to get container status \"b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb\": rpc error: code = NotFound desc = could not find container \"b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb\": container with ID starting with b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb not found: ID does not exist" Sep 09 02:27:42.543735 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.543711 2569 scope.go:117] "RemoveContainer" containerID="f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8" Sep 09 02:27:42.543945 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:42.543929 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8\": container with ID starting with f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8 not found: ID does not exist" containerID="f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8" Sep 09 02:27:42.543983 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.543950 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8"} err="failed to get container status \"f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8\": rpc error: code = NotFound desc = could not find container \"f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8\": container with ID starting with f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8 not found: ID does not exist" Sep 09 02:27:42.543983 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.543962 2569 scope.go:117] "RemoveContainer" containerID="a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0" Sep 09 02:27:42.544154 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:42.544139 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0\": container with ID starting with a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0 not found: ID does not exist" containerID="a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0" Sep 09 02:27:42.544195 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.544157 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0"} err="failed to get container status \"a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0\": rpc error: code = NotFound desc = could not find container \"a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0\": container with ID starting with a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0 not found: ID does not exist" Sep 09 02:27:42.544195 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.544169 2569 scope.go:117] "RemoveContainer" containerID="b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a" Sep 09 02:27:42.544424 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:42.544405 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a\": container with ID starting with b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a not found: ID does not exist" containerID="b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a" Sep 09 02:27:42.544481 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.544431 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a"} err="failed to get container status \"b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a\": rpc error: code = NotFound desc = could not find container \"b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a\": container with ID starting with b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a not found: ID does not exist" Sep 09 02:27:42.544481 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.544459 2569 scope.go:117] "RemoveContainer" containerID="a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d" Sep 09 02:27:42.544689 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:42.544669 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d\": container with ID starting with a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d not found: ID does not exist" containerID="a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d" Sep 09 02:27:42.544736 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.544693 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d"} err="failed to get container status \"a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d\": rpc error: code = NotFound desc = could not find container \"a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d\": container with ID starting with a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d not found: ID does not exist" Sep 09 02:27:42.544736 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.544704 2569 scope.go:117] "RemoveContainer" containerID="57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9" Sep 09 02:27:42.544922 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.544907 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9"} err="failed to get container status \"57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9\": rpc error: code = NotFound desc = could not find container \"57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9\": container with ID starting with 57aaa9a98f1f74b4c45bd3cb6ed43d75d1b4f116c9e3109a15f9512b3eda5ff9 not found: ID does not exist" Sep 09 02:27:42.544980 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.544923 2569 scope.go:117] "RemoveContainer" containerID="83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577" Sep 09 02:27:42.545147 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.545131 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577"} err="failed to get container status \"83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577\": rpc error: code = NotFound desc = could not find container \"83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577\": container with ID starting with 83135afd371a625f4f36433157e66999048256a4837039082e52966b4ee30577 not found: ID does not exist" Sep 09 02:27:42.545147 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.545146 2569 scope.go:117] "RemoveContainer" containerID="b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb" Sep 09 02:27:42.545387 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.545369 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb"} err="failed to get container status \"b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb\": rpc error: code = NotFound desc = could not find container \"b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb\": container with ID starting with b7cec6759ac1b3aa6a3f2591a3c0f7aecacf46d376847df6d51ffff1f59aeafb not found: ID does not exist" Sep 09 02:27:42.545450 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.545387 2569 scope.go:117] "RemoveContainer" containerID="f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8" Sep 09 02:27:42.545610 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.545594 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8"} err="failed to get container status \"f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8\": rpc error: code = NotFound desc = could not find container \"f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8\": container with ID starting with f033118c9efabedc3282cbc3d5190d64541bdb8a70af47f79a1ce7b09b2d59d8 not found: ID does not exist" Sep 09 02:27:42.545651 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.545611 2569 scope.go:117] "RemoveContainer" containerID="a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0" Sep 09 02:27:42.545814 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.545800 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0"} err="failed to get container status \"a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0\": rpc error: code = NotFound desc = could not find container \"a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0\": container with ID starting with a8d45d13d3881cee1bfb80a4f8d972934a0eeb91f0458c151ea3e3abb88f17a0 not found: ID does not exist" Sep 09 02:27:42.545857 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.545815 2569 scope.go:117] "RemoveContainer" containerID="b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a" Sep 09 02:27:42.546011 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.545997 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a"} err="failed to get container status \"b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a\": rpc error: code = NotFound desc = could not find container \"b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a\": container with ID starting with b147ccc584b49612a003200517c867a13d97428353184da4bb3b30f3e9d4063a not found: ID does not exist" Sep 09 02:27:42.546050 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.546013 2569 scope.go:117] "RemoveContainer" containerID="a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d" Sep 09 02:27:42.546223 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.546202 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d"} err="failed to get container status \"a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d\": rpc error: code = NotFound desc = could not find container \"a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d\": container with ID starting with a6fb34ab08523a16bfa79dec30a1db02725a72fa78d772b44d0d9ad3d6dd3e9d not found: ID does not exist" Sep 09 02:27:42.612840 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612805 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-main-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.612840 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612837 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-tls-assets\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612852 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwwf2\" (UniqueName: \"kubernetes.io/projected/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-kube-api-access-fwwf2\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612865 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612880 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612891 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612902 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-cluster-tls-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612914 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-metrics-client-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612926 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612938 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-web-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612949 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-alertmanager-main-db\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612960 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-volume\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.613056 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.612971 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae-config-out\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:42.797918 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.797885 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 02:27:42.800917 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.800889 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 02:27:42.827970 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.827937 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 02:27:42.828234 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828222 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy" Sep 09 02:27:42.828284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828236 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy" Sep 09 02:27:42.828284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828245 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="prom-label-proxy" Sep 09 02:27:42.828284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828250 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="prom-label-proxy" Sep 09 02:27:42.828284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828258 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="config-reloader" Sep 09 02:27:42.828284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828264 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="config-reloader" Sep 09 02:27:42.828284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828271 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="alertmanager" Sep 09 02:27:42.828284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828276 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="alertmanager" Sep 09 02:27:42.828284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828285 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy-metric" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828291 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy-metric" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828300 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy-web" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828305 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy-web" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828317 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="init-config-reloader" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828323 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="init-config-reloader" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828383 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828391 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="prom-label-proxy" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828397 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="alertmanager" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828404 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy-web" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828409 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="kube-rbac-proxy-metric" Sep 09 02:27:42.828534 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.828414 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" containerName="config-reloader" Sep 09 02:27:42.841993 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.841922 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.844595 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.844573 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 02:27:42.844717 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.844635 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 02:27:42.844780 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.844762 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 02:27:42.844824 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.844792 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 02:27:42.845026 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.845007 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 02:27:42.845173 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.845042 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 02:27:42.845173 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.845052 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dhjs5\"" Sep 09 02:27:42.845173 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.845100 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 02:27:42.845328 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.845173 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 02:27:42.845487 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.845469 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 02:27:42.849544 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.849525 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 02:27:42.915129 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915096 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915129 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915129 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915365 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915154 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69cb466e-d550-4aa4-a781-8a3a8488e792-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915365 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915188 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915365 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915208 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69cb466e-d550-4aa4-a781-8a3a8488e792-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915365 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915231 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69cb466e-d550-4aa4-a781-8a3a8488e792-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915365 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915263 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915365 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915282 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915365 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915305 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-web-config\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915603 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915373 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-config-volume\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915603 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915405 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69cb466e-d550-4aa4-a781-8a3a8488e792-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915603 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915433 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69cb466e-d550-4aa4-a781-8a3a8488e792-config-out\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:42.915603 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:42.915462 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsj2z\" (UniqueName: \"kubernetes.io/projected/69cb466e-d550-4aa4-a781-8a3a8488e792-kube-api-access-vsj2z\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.015889 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.015845 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69cb466e-d550-4aa4-a781-8a3a8488e792-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.015889 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.015895 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016148 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.015918 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016148 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.015943 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-web-config\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016148 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016050 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-config-volume\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016148 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016134 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69cb466e-d550-4aa4-a781-8a3a8488e792-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016374 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016180 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69cb466e-d550-4aa4-a781-8a3a8488e792-config-out\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016374 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016210 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsj2z\" (UniqueName: \"kubernetes.io/projected/69cb466e-d550-4aa4-a781-8a3a8488e792-kube-api-access-vsj2z\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016374 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016374 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016298 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016374 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016320 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69cb466e-d550-4aa4-a781-8a3a8488e792-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016621 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016375 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016621 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016409 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69cb466e-d550-4aa4-a781-8a3a8488e792-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.016621 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016527 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69cb466e-d550-4aa4-a781-8a3a8488e792-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.017028 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.016999 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69cb466e-d550-4aa4-a781-8a3a8488e792-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.018879 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.018847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69cb466e-d550-4aa4-a781-8a3a8488e792-config-out\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.019060 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.019038 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.019139 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.019115 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69cb466e-d550-4aa4-a781-8a3a8488e792-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.019199 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.019157 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-web-config\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.019199 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.019184 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.019395 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.019374 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.019462 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.019448 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69cb466e-d550-4aa4-a781-8a3a8488e792-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.019518 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.019497 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-config-volume\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.019770 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.019751 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.020921 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.020901 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69cb466e-d550-4aa4-a781-8a3a8488e792-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.024082 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.024061 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsj2z\" (UniqueName: \"kubernetes.io/projected/69cb466e-d550-4aa4-a781-8a3a8488e792-kube-api-access-vsj2z\") pod \"alertmanager-main-0\" (UID: \"69cb466e-d550-4aa4-a781-8a3a8488e792\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.153060 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.152977 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 02:27:43.461098 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.460906 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 02:27:43.463578 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:27:43.463544 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69cb466e_d550_4aa4_a781_8a3a8488e792.slice/crio-38d326e45fb768c7909877c7d921545d82105697395c3c4e3123a4a17eabae3f WatchSource:0}: Error finding container 38d326e45fb768c7909877c7d921545d82105697395c3c4e3123a4a17eabae3f: Status 404 returned error can't find the container with id 38d326e45fb768c7909877c7d921545d82105697395c3c4e3123a4a17eabae3f Sep 09 02:27:43.482187 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:43.482153 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69cb466e-d550-4aa4-a781-8a3a8488e792","Type":"ContainerStarted","Data":"38d326e45fb768c7909877c7d921545d82105697395c3c4e3123a4a17eabae3f"} Sep 09 02:27:44.488242 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:44.488193 2569 generic.go:356] "Generic (PLEG): container finished" podID="69cb466e-d550-4aa4-a781-8a3a8488e792" containerID="3dec21537d50d019eb87d4ba64b8299ad21f3134c940bc01e3f4c7eaa3216949" exitCode=0 Sep 09 02:27:44.488682 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:44.488290 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69cb466e-d550-4aa4-a781-8a3a8488e792","Type":"ContainerDied","Data":"3dec21537d50d019eb87d4ba64b8299ad21f3134c940bc01e3f4c7eaa3216949"} Sep 09 02:27:44.776622 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:44.776596 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aa4e7f3-e871-45e8-94b1-e21a3f1885ae" path="/var/lib/kubelet/pods/5aa4e7f3-e871-45e8-94b1-e21a3f1885ae/volumes" Sep 09 02:27:45.183043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.183010 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75d57fc448-8ddwf"] Sep 09 02:27:45.209813 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.209779 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75d57fc448-8ddwf"] Sep 09 02:27:45.209962 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.209884 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.212260 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.212220 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 09 02:27:45.212398 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.212265 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tq2j8\"" Sep 09 02:27:45.212513 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.212403 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 09 02:27:45.212967 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.212932 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 09 02:27:45.213360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.212425 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 09 02:27:45.213360 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.213142 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 09 02:27:45.224576 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.224545 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 09 02:27:45.236994 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.236962 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f653ebcf-cb48-4339-9ac8-7048fa11639d-serving-certs-ca-bundle\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.237143 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.237002 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.237143 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.237034 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6f9m\" (UniqueName: \"kubernetes.io/projected/f653ebcf-cb48-4339-9ac8-7048fa11639d-kube-api-access-l6f9m\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.237143 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.237083 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f653ebcf-cb48-4339-9ac8-7048fa11639d-metrics-client-ca\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.237143 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.237109 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f653ebcf-cb48-4339-9ac8-7048fa11639d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.237306 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.237198 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-secret-telemeter-client\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.237306 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.237222 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-telemeter-client-tls\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.237306 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.237273 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-federate-client-tls\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.338520 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.338434 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-secret-telemeter-client\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.338520 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.338472 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-telemeter-client-tls\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.338520 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.338510 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-federate-client-tls\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.338778 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.338542 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f653ebcf-cb48-4339-9ac8-7048fa11639d-serving-certs-ca-bundle\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.338778 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.338562 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.338778 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.338582 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6f9m\" (UniqueName: \"kubernetes.io/projected/f653ebcf-cb48-4339-9ac8-7048fa11639d-kube-api-access-l6f9m\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.338778 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.338717 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f653ebcf-cb48-4339-9ac8-7048fa11639d-metrics-client-ca\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.338778 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.338770 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f653ebcf-cb48-4339-9ac8-7048fa11639d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.339381 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.339326 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f653ebcf-cb48-4339-9ac8-7048fa11639d-serving-certs-ca-bundle\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.339503 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.339441 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f653ebcf-cb48-4339-9ac8-7048fa11639d-metrics-client-ca\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.339719 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.339688 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f653ebcf-cb48-4339-9ac8-7048fa11639d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.341132 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.341103 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.341316 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.341292 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-telemeter-client-tls\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.341527 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.341509 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-secret-telemeter-client\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.341527 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.341522 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f653ebcf-cb48-4339-9ac8-7048fa11639d-federate-client-tls\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.346710 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.346687 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6f9m\" (UniqueName: \"kubernetes.io/projected/f653ebcf-cb48-4339-9ac8-7048fa11639d-kube-api-access-l6f9m\") pod \"telemeter-client-75d57fc448-8ddwf\" (UID: \"f653ebcf-cb48-4339-9ac8-7048fa11639d\") " pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.466001 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.465971 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 02:27:45.466368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.466319 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="prometheus" containerID="cri-o://7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439" gracePeriod=600 Sep 09 02:27:45.466483 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.466313 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy-web" containerID="cri-o://91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b" gracePeriod=600 Sep 09 02:27:45.466483 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.466366 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="config-reloader" containerID="cri-o://be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a" gracePeriod=600 Sep 09 02:27:45.466483 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.466412 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416" gracePeriod=600 Sep 09 02:27:45.466483 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.466380 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy" containerID="cri-o://5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56" gracePeriod=600 Sep 09 02:27:45.466726 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.466486 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="thanos-sidecar" containerID="cri-o://eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949" gracePeriod=600 Sep 09 02:27:45.498126 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.498092 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69cb466e-d550-4aa4-a781-8a3a8488e792","Type":"ContainerStarted","Data":"114c3163fd296b2ed23e28ad28a431f7c7adcfe7e47c438fabf52003024a43ff"} Sep 09 02:27:45.498550 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.498182 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69cb466e-d550-4aa4-a781-8a3a8488e792","Type":"ContainerStarted","Data":"328ff4443f9da3bc00e5672c8cf5197edf6dbf3af3639519735f623df59ee173"} Sep 09 02:27:45.498550 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.498225 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69cb466e-d550-4aa4-a781-8a3a8488e792","Type":"ContainerStarted","Data":"71abe303fb2588170f4d3e845fc8dcb5aff0fe4eddd5e56e9c962b7608a4ad9f"} Sep 09 02:27:45.498550 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.498266 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69cb466e-d550-4aa4-a781-8a3a8488e792","Type":"ContainerStarted","Data":"1ae383136e4921ffa180c1f8b983b7a61cd2972f3d302c02289e5e2e585617a8"} Sep 09 02:27:45.498550 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.498301 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69cb466e-d550-4aa4-a781-8a3a8488e792","Type":"ContainerStarted","Data":"a7f4855faa2bd0cb304622076eede5b88f95d093d5c0cf6d406ec387aae9cde2"} Sep 09 02:27:45.498550 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.498361 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69cb466e-d550-4aa4-a781-8a3a8488e792","Type":"ContainerStarted","Data":"c3c8c2a004819130ed86fc9851912edeb0aed0643f57bc92665905e2f36dfdff"} Sep 09 02:27:45.524531 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.524487 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.509812151 podStartE2EDuration="3.524471186s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.659035ms" isStatefulPod=false podCreationTimestamp="2026-09-09 02:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:45.523416657 +0000 UTC m=+107.246397057" watchObservedRunningTime="2026-09-09 02:27:45.524471186 +0000 UTC m=+107.247451583" Sep 09 02:27:45.529415 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.529392 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" Sep 09 02:27:45.832183 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:45.832158 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75d57fc448-8ddwf"] Sep 09 02:27:45.834163 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:27:45.834136 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf653ebcf_cb48_4339_9ac8_7048fa11639d.slice/crio-17311f99eb1498bee8b4f2725e6c17033a80a3d1536b80832ef66abd4a6d5213 WatchSource:0}: Error finding container 17311f99eb1498bee8b4f2725e6c17033a80a3d1536b80832ef66abd4a6d5213: Status 404 returned error can't find the container with id 17311f99eb1498bee8b4f2725e6c17033a80a3d1536b80832ef66abd4a6d5213 Sep 09 02:27:46.507495 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507463 2569 generic.go:356] "Generic (PLEG): container finished" podID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerID="e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416" exitCode=0 Sep 09 02:27:46.507495 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507487 2569 generic.go:356] "Generic (PLEG): container finished" podID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerID="5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56" exitCode=0 Sep 09 02:27:46.507495 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507496 2569 generic.go:356] "Generic (PLEG): container finished" podID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerID="eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949" exitCode=0 Sep 09 02:27:46.507495 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507501 2569 generic.go:356] "Generic (PLEG): container finished" podID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerID="be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a" exitCode=0 Sep 09 02:27:46.508120 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507506 2569 generic.go:356] "Generic (PLEG): container finished" podID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerID="7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439" exitCode=0 Sep 09 02:27:46.508120 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507540 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerDied","Data":"e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416"} Sep 09 02:27:46.508120 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507618 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerDied","Data":"5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56"} Sep 09 02:27:46.508120 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507660 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerDied","Data":"eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949"} Sep 09 02:27:46.508120 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507691 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerDied","Data":"be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a"} Sep 09 02:27:46.508120 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.507731 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerDied","Data":"7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439"} Sep 09 02:27:46.508922 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.508898 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" event={"ID":"f653ebcf-cb48-4339-9ac8-7048fa11639d","Type":"ContainerStarted","Data":"17311f99eb1498bee8b4f2725e6c17033a80a3d1536b80832ef66abd4a6d5213"} Sep 09 02:27:46.820299 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.820263 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:46.854803 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.854777 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-2\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.854969 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.854827 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.854969 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.854863 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.854969 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.854934 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-thanos-prometheus-http-client-file\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.854969 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.854959 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855185 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.854981 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-tls-assets\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855185 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855007 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-0\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855185 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855039 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-kubelet-serving-ca-bundle\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855185 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855071 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-web-config\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855185 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855095 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-trusted-ca-bundle\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855185 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855136 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh6hv\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-kube-api-access-zh6hv\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855185 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855161 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-grpc-tls\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855186 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-serving-certs-ca-bundle\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855198 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:46.855556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855215 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-kube-rbac-proxy\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855251 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-tls\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855291 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-metrics-client-certs\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855324 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-1\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855373 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config-out\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855411 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-db\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.855556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855443 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-metrics-client-ca\") pod \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\" (UID: \"30ca0f42-1c6b-479b-9699-3dd97ab4c194\") " Sep 09 02:27:46.856015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855723 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:46.856015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.855784 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.859193 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.859162 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:46.859698 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.859673 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:46.862946 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.862673 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:46.862946 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.862797 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config" (OuterVolumeSpecName: "config") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:46.863431 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.863167 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:46.864655 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.864629 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:27:46.865509 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.865485 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:46.865654 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.865611 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:46.865835 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.865810 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:46.866834 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.866793 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config-out" (OuterVolumeSpecName: "config-out") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 02:27:46.866996 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.866975 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:46.868912 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.868887 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:46.869893 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.869709 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:46.869893 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.869827 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:27:46.869893 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.869864 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:46.870242 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.870006 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-kube-api-access-zh6hv" (OuterVolumeSpecName: "kube-api-access-zh6hv") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "kube-api-access-zh6hv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:27:46.871289 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.871261 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:46.875638 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.875617 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-web-config" (OuterVolumeSpecName: "web-config") pod "30ca0f42-1c6b-479b-9699-3dd97ab4c194" (UID: "30ca0f42-1c6b-479b-9699-3dd97ab4c194"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:46.956643 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956603 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config-out\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956643 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956635 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-db\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956643 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956645 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-metrics-client-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956655 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956666 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956676 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956685 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956693 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-tls-assets\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956701 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956711 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956721 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-web-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956730 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956739 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh6hv\" (UniqueName: \"kubernetes.io/projected/30ca0f42-1c6b-479b-9699-3dd97ab4c194-kube-api-access-zh6hv\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956747 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-grpc-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956768 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956776 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-kube-rbac-proxy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956784 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956792 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30ca0f42-1c6b-479b-9699-3dd97ab4c194-secret-metrics-client-certs\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:46.956858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:46.956800 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30ca0f42-1c6b-479b-9699-3dd97ab4c194-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:47.526920 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.526891 2569 generic.go:356] "Generic (PLEG): container finished" podID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerID="91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b" exitCode=0 Sep 09 02:27:47.527249 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.526948 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerDied","Data":"91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b"} Sep 09 02:27:47.527249 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.526982 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.527249 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.527042 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30ca0f42-1c6b-479b-9699-3dd97ab4c194","Type":"ContainerDied","Data":"04163f0737a4dd50c152d9704696a7d492cbcccfa186a19f4c33aa93f5f2998e"} Sep 09 02:27:47.527249 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.527074 2569 scope.go:117] "RemoveContainer" containerID="e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416" Sep 09 02:27:47.536205 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.536182 2569 scope.go:117] "RemoveContainer" containerID="5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56" Sep 09 02:27:47.550984 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.550694 2569 scope.go:117] "RemoveContainer" containerID="91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b" Sep 09 02:27:47.553881 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.553855 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 02:27:47.559614 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.559591 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 02:27:47.560442 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.560425 2569 scope.go:117] "RemoveContainer" containerID="eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949" Sep 09 02:27:47.568528 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.568509 2569 scope.go:117] "RemoveContainer" containerID="be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a" Sep 09 02:27:47.580032 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.580014 2569 scope.go:117] "RemoveContainer" containerID="7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.582862 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.583917 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy-web" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.583940 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy-web" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.583958 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="config-reloader" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.583966 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="config-reloader" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.583975 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.583983 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.583995 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy-thanos" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584004 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy-thanos" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584018 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="prometheus" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584026 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="prometheus" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584049 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="thanos-sidecar" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584057 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="thanos-sidecar" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584069 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="init-config-reloader" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584078 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="init-config-reloader" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584154 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="config-reloader" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584164 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584175 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy-thanos" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584186 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="prometheus" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584195 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="thanos-sidecar" Sep 09 02:27:47.584806 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.584205 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" containerName="kube-rbac-proxy-web" Sep 09 02:27:47.587677 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.587647 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.590164 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.589874 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 02:27:47.590164 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.589908 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 02:27:47.590164 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.590012 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 02:27:47.590398 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.590184 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 02:27:47.590398 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.590261 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 02:27:47.590398 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.590274 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 02:27:47.590529 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.590403 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cnvcx\"" Sep 09 02:27:47.590529 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.590493 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 02:27:47.590782 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.590765 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 02:27:47.590899 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.590883 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-94sd180ai1pl7\"" Sep 09 02:27:47.590930 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.590774 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 02:27:47.591201 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.591184 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 02:27:47.591673 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.591656 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 02:27:47.591907 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.591683 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 02:27:47.593716 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.593676 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 02:27:47.596155 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.596137 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 02:27:47.601605 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.601491 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 02:27:47.601605 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.601599 2569 scope.go:117] "RemoveContainer" containerID="e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd" Sep 09 02:27:47.617174 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.617151 2569 scope.go:117] "RemoveContainer" containerID="e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416" Sep 09 02:27:47.617863 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:47.617833 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416\": container with ID starting with e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416 not found: ID does not exist" containerID="e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416" Sep 09 02:27:47.618020 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.617878 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416"} err="failed to get container status \"e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416\": rpc error: code = NotFound desc = could not find container \"e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416\": container with ID starting with e73d36bf5c3a7ebeff8200a5fd9019517e48ee6aa22d39fe322dfa0508828416 not found: ID does not exist" Sep 09 02:27:47.618020 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.617907 2569 scope.go:117] "RemoveContainer" containerID="5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56" Sep 09 02:27:47.618270 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:47.618251 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56\": container with ID starting with 5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56 not found: ID does not exist" containerID="5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56" Sep 09 02:27:47.618329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.618277 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56"} err="failed to get container status \"5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56\": rpc error: code = NotFound desc = could not find container \"5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56\": container with ID starting with 5e1da5efe9c9748310df16eacb32ba19eb46548051d979b626a45750ed1f5f56 not found: ID does not exist" Sep 09 02:27:47.618329 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.618294 2569 scope.go:117] "RemoveContainer" containerID="91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b" Sep 09 02:27:47.618594 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:47.618571 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b\": container with ID starting with 91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b not found: ID does not exist" containerID="91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b" Sep 09 02:27:47.618644 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.618602 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b"} err="failed to get container status \"91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b\": rpc error: code = NotFound desc = could not find container \"91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b\": container with ID starting with 91c02a0c07fe6869122383d9c9d1d2daceaf2bd2060667cf172d7b46d3cdbb1b not found: ID does not exist" Sep 09 02:27:47.618644 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.618623 2569 scope.go:117] "RemoveContainer" containerID="eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949" Sep 09 02:27:47.618953 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:47.618931 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949\": container with ID starting with eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949 not found: ID does not exist" containerID="eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949" Sep 09 02:27:47.619008 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.618962 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949"} err="failed to get container status \"eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949\": rpc error: code = NotFound desc = could not find container \"eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949\": container with ID starting with eaab3525533fef24010b914aa3c3adee175221c82b756ea5dae5500c068f5949 not found: ID does not exist" Sep 09 02:27:47.619008 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.618986 2569 scope.go:117] "RemoveContainer" containerID="be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a" Sep 09 02:27:47.619260 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:47.619236 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a\": container with ID starting with be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a not found: ID does not exist" containerID="be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a" Sep 09 02:27:47.619317 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.619267 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a"} err="failed to get container status \"be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a\": rpc error: code = NotFound desc = could not find container \"be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a\": container with ID starting with be75d3cefc6d4fb448a771fd666483ab9255dbc6c1ad407424fd3752a10e396a not found: ID does not exist" Sep 09 02:27:47.619317 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.619286 2569 scope.go:117] "RemoveContainer" containerID="7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439" Sep 09 02:27:47.619742 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:47.619633 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439\": container with ID starting with 7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439 not found: ID does not exist" containerID="7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439" Sep 09 02:27:47.619742 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.619663 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439"} err="failed to get container status \"7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439\": rpc error: code = NotFound desc = could not find container \"7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439\": container with ID starting with 7830d0fbec73c1b6ce4baf33766337e7e760de38842e9ebd2ca2b82300401439 not found: ID does not exist" Sep 09 02:27:47.619742 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.619684 2569 scope.go:117] "RemoveContainer" containerID="e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd" Sep 09 02:27:47.619921 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:47.619902 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd\": container with ID starting with e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd not found: ID does not exist" containerID="e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd" Sep 09 02:27:47.619978 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.619927 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd"} err="failed to get container status \"e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd\": rpc error: code = NotFound desc = could not find container \"e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd\": container with ID starting with e9fdca883bffe7c408214d13915b5f9a1c79f7ab810caa5a10ab535e0ca6a3fd not found: ID does not exist" Sep 09 02:27:47.663198 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663169 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663309 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663209 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663309 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663241 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-config\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663417 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663322 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663417 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663487 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663425 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663487 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663448 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663579 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663483 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6ec0eba-b018-4618-8a65-8756243af9e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663579 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663512 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663579 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663562 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663727 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663604 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvftj\" (UniqueName: \"kubernetes.io/projected/a6ec0eba-b018-4618-8a65-8756243af9e7-kube-api-access-zvftj\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663727 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663641 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663727 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663673 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6ec0eba-b018-4618-8a65-8756243af9e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663727 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663709 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663890 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663737 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663890 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663764 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663890 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663810 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663890 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663833 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.663890 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663863 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.664109 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.663909 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.764803 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.764762 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.764953 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.764818 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.764953 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.764860 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-config\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.764953 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.764886 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.764953 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.764914 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765111 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.764953 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765111 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.764976 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765111 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765001 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6ec0eba-b018-4618-8a65-8756243af9e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765111 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765025 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765111 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765047 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765111 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765075 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvftj\" (UniqueName: \"kubernetes.io/projected/a6ec0eba-b018-4618-8a65-8756243af9e7-kube-api-access-zvftj\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765111 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765105 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765441 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765132 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6ec0eba-b018-4618-8a65-8756243af9e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765441 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765161 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765441 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765186 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765441 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765300 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.765948 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.765918 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.766165 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.766132 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.766405 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.766381 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.767247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.766706 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.767247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.766790 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.767247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.766824 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.767247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.766873 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.767247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.766906 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.767247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.767165 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.768648 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.768621 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.769423 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.769366 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.770298 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.769544 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.770298 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.769845 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6ec0eba-b018-4618-8a65-8756243af9e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.770298 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.769963 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.770298 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.770254 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-config\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.771678 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.771116 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.771678 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.771171 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.771678 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.771252 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.771678 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.771270 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.771678 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.771612 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.771967 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.771936 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6ec0eba-b018-4618-8a65-8756243af9e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.772185 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.772164 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6ec0eba-b018-4618-8a65-8756243af9e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.772626 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.772607 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6ec0eba-b018-4618-8a65-8756243af9e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.773775 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.773753 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvftj\" (UniqueName: \"kubernetes.io/projected/a6ec0eba-b018-4618-8a65-8756243af9e7-kube-api-access-zvftj\") pod \"prometheus-k8s-0\" (UID: \"a6ec0eba-b018-4618-8a65-8756243af9e7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:47.916013 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:47.915977 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:48.196971 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.196917 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 02:27:48.199889 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:27:48.199859 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ec0eba_b018_4618_8a65_8756243af9e7.slice/crio-0b21acb5b127bbadd84e5818aacf054dbb242488efef0d24a3ad8c556ca0f07e WatchSource:0}: Error finding container 0b21acb5b127bbadd84e5818aacf054dbb242488efef0d24a3ad8c556ca0f07e: Status 404 returned error can't find the container with id 0b21acb5b127bbadd84e5818aacf054dbb242488efef0d24a3ad8c556ca0f07e Sep 09 02:27:48.534080 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.534044 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" event={"ID":"f653ebcf-cb48-4339-9ac8-7048fa11639d","Type":"ContainerStarted","Data":"c9574929b612b66f690b0ef88982d9f0bda9422858173100e6626171025a120a"} Sep 09 02:27:48.534520 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.534104 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" event={"ID":"f653ebcf-cb48-4339-9ac8-7048fa11639d","Type":"ContainerStarted","Data":"80147839029dd483a701690427994f4e29b7f64681ecd07c809b0a48b26e1e9c"} Sep 09 02:27:48.534520 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.534131 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" event={"ID":"f653ebcf-cb48-4339-9ac8-7048fa11639d","Type":"ContainerStarted","Data":"0f1468bfd056cde4e490f1f6c7c9174ac9d05f96bd3adb41ccca625f0227f9ee"} Sep 09 02:27:48.535655 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.535626 2569 generic.go:356] "Generic (PLEG): container finished" podID="a6ec0eba-b018-4618-8a65-8756243af9e7" containerID="811c75ccdc134e9dd42e71f0bb08ae1e1ce14618909746e70212c97aa44fce2d" exitCode=0 Sep 09 02:27:48.535778 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.535706 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6ec0eba-b018-4618-8a65-8756243af9e7","Type":"ContainerDied","Data":"811c75ccdc134e9dd42e71f0bb08ae1e1ce14618909746e70212c97aa44fce2d"} Sep 09 02:27:48.535778 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.535759 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6ec0eba-b018-4618-8a65-8756243af9e7","Type":"ContainerStarted","Data":"0b21acb5b127bbadd84e5818aacf054dbb242488efef0d24a3ad8c556ca0f07e"} Sep 09 02:27:48.553289 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.553239 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75d57fc448-8ddwf" podStartSLOduration=1.897469598 podStartE2EDuration="3.553223792s" totalImagesPullingTime="1.655754194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:48.551918346 +0000 UTC m=+110.274898761" watchObservedRunningTime="2026-09-09 02:27:48.553223792 +0000 UTC m=+110.276204208" Sep 09 02:27:48.639417 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.639387 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55cb89f78d-snshq"] Sep 09 02:27:48.643091 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.643067 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.654169 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.654130 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cb89f78d-snshq"] Sep 09 02:27:48.677740 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.677709 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-oauth-serving-cert\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.677881 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.677766 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-oauth-config\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.677881 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.677822 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-trusted-ca-bundle\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.677881 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.677870 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-config\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.678059 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.677912 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kl72\" (UniqueName: \"kubernetes.io/projected/fcddf74b-1488-4e3f-8be2-cbd849103a59-kube-api-access-4kl72\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.678059 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.677989 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-service-ca\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.678059 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.678030 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-serving-cert\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.779852 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.779819 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-oauth-config\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.780082 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.780062 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-trusted-ca-bundle\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.780183 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.780130 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-config\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.780183 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.780174 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kl72\" (UniqueName: \"kubernetes.io/projected/fcddf74b-1488-4e3f-8be2-cbd849103a59-kube-api-access-4kl72\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.780284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.780228 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-service-ca\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.780284 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.780268 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-serving-cert\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.780494 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.780315 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-oauth-serving-cert\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.781834 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.781060 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-oauth-serving-cert\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.781834 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.781682 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-config\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.781834 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.781719 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-trusted-ca-bundle\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.781834 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.781736 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-service-ca\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.784785 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.784100 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30ca0f42-1c6b-479b-9699-3dd97ab4c194" path="/var/lib/kubelet/pods/30ca0f42-1c6b-479b-9699-3dd97ab4c194/volumes" Sep 09 02:27:48.784785 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.784550 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-serving-cert\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.785684 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.785646 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-oauth-config\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.791276 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.791250 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kl72\" (UniqueName: \"kubernetes.io/projected/fcddf74b-1488-4e3f-8be2-cbd849103a59-kube-api-access-4kl72\") pod \"console-55cb89f78d-snshq\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:48.971309 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:48.971279 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:49.260434 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.260407 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cb89f78d-snshq"] Sep 09 02:27:49.262732 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:27:49.262701 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcddf74b_1488_4e3f_8be2_cbd849103a59.slice/crio-0a65c4d511aaf81fa01d63e6bbe5b2e151de8388b91122dc4de067d4e2a19ca8 WatchSource:0}: Error finding container 0a65c4d511aaf81fa01d63e6bbe5b2e151de8388b91122dc4de067d4e2a19ca8: Status 404 returned error can't find the container with id 0a65c4d511aaf81fa01d63e6bbe5b2e151de8388b91122dc4de067d4e2a19ca8 Sep 09 02:27:49.545390 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.545263 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cb89f78d-snshq" event={"ID":"fcddf74b-1488-4e3f-8be2-cbd849103a59","Type":"ContainerStarted","Data":"ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4"} Sep 09 02:27:49.545390 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.545383 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cb89f78d-snshq" event={"ID":"fcddf74b-1488-4e3f-8be2-cbd849103a59","Type":"ContainerStarted","Data":"0a65c4d511aaf81fa01d63e6bbe5b2e151de8388b91122dc4de067d4e2a19ca8"} Sep 09 02:27:49.550322 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.550287 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6ec0eba-b018-4618-8a65-8756243af9e7","Type":"ContainerStarted","Data":"aa78ba9165f8b3ccab9c534ce36b5a3e18112f29ab366c293bcb46a4cd312112"} Sep 09 02:27:49.550493 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.550366 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6ec0eba-b018-4618-8a65-8756243af9e7","Type":"ContainerStarted","Data":"98e218030054e3cc670328c5c6ffbd738981be8e8b80f9fcb3f459e625250de1"} Sep 09 02:27:49.550493 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.550393 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6ec0eba-b018-4618-8a65-8756243af9e7","Type":"ContainerStarted","Data":"7df80a902e67238b368e6d970a340c01d5cb2054b6fd70938d4f511daedad9bc"} Sep 09 02:27:49.550493 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.550417 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6ec0eba-b018-4618-8a65-8756243af9e7","Type":"ContainerStarted","Data":"5f8be74b233adee5d47bee74000d526835b3a2e348bb1f87774caf77a3f4b687"} Sep 09 02:27:49.550493 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.550440 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6ec0eba-b018-4618-8a65-8756243af9e7","Type":"ContainerStarted","Data":"8b1c84eb1c46b530a1d07eddf7bb16451ec2ada299b1d27686894b00270cc35f"} Sep 09 02:27:49.550493 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.550463 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6ec0eba-b018-4618-8a65-8756243af9e7","Type":"ContainerStarted","Data":"15099e6d9c50b0b040c3681ef91e4265a8f5c833f01f95bbaa01a0d1b1506124"} Sep 09 02:27:49.562059 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.562003 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55cb89f78d-snshq" podStartSLOduration=1.561982276 podStartE2EDuration="1.561982276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:27:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:49.560904432 +0000 UTC m=+111.283884843" watchObservedRunningTime="2026-09-09 02:27:49.561982276 +0000 UTC m=+111.284962674" Sep 09 02:27:49.587879 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:49.587821 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.566714352 podStartE2EDuration="2.587798915s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.084563ms" isStatefulPod=false podCreationTimestamp="2026-09-09 02:27:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:27:49.58577014 +0000 UTC m=+111.308750606" watchObservedRunningTime="2026-09-09 02:27:49.587798915 +0000 UTC m=+111.310779316" Sep 09 02:27:52.916942 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:52.916892 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:27:56.488906 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.488843 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d6b948f6f-q8nb7" podUID="26ea52c1-9b91-4cd2-98e6-3a41306b351d" containerName="console" containerID="cri-o://c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1" gracePeriod=15 Sep 09 02:27:56.737491 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.737468 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:56.858403 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.858365 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-oauth-config\") pod \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " Sep 09 02:27:56.858551 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.858433 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-oauth-serving-cert\") pod \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " Sep 09 02:27:56.858551 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.858457 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-serving-cert\") pod \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " Sep 09 02:27:56.858644 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.858618 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-config\") pod \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " Sep 09 02:27:56.858718 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.858703 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trzmv\" (UniqueName: \"kubernetes.io/projected/26ea52c1-9b91-4cd2-98e6-3a41306b351d-kube-api-access-trzmv\") pod \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " Sep 09 02:27:56.858783 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.858767 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-service-ca\") pod \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\" (UID: \"26ea52c1-9b91-4cd2-98e6-3a41306b351d\") " Sep 09 02:27:56.858874 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.858851 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26ea52c1-9b91-4cd2-98e6-3a41306b351d" (UID: "26ea52c1-9b91-4cd2-98e6-3a41306b351d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:56.859051 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.858987 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-config" (OuterVolumeSpecName: "console-config") pod "26ea52c1-9b91-4cd2-98e6-3a41306b351d" (UID: "26ea52c1-9b91-4cd2-98e6-3a41306b351d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:56.859188 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.859085 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-service-ca" (OuterVolumeSpecName: "service-ca") pod "26ea52c1-9b91-4cd2-98e6-3a41306b351d" (UID: "26ea52c1-9b91-4cd2-98e6-3a41306b351d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:27:56.859188 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.859137 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-oauth-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:56.859188 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.859154 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:56.860690 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.860668 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26ea52c1-9b91-4cd2-98e6-3a41306b351d" (UID: "26ea52c1-9b91-4cd2-98e6-3a41306b351d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:56.860777 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.860762 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26ea52c1-9b91-4cd2-98e6-3a41306b351d" (UID: "26ea52c1-9b91-4cd2-98e6-3a41306b351d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:27:56.860821 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.860761 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ea52c1-9b91-4cd2-98e6-3a41306b351d-kube-api-access-trzmv" (OuterVolumeSpecName: "kube-api-access-trzmv") pod "26ea52c1-9b91-4cd2-98e6-3a41306b351d" (UID: "26ea52c1-9b91-4cd2-98e6-3a41306b351d"). InnerVolumeSpecName "kube-api-access-trzmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:27:56.960416 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.960379 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trzmv\" (UniqueName: \"kubernetes.io/projected/26ea52c1-9b91-4cd2-98e6-3a41306b351d-kube-api-access-trzmv\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:56.960416 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.960412 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ea52c1-9b91-4cd2-98e6-3a41306b351d-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:56.960416 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.960423 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-oauth-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:56.960635 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:56.960433 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ea52c1-9b91-4cd2-98e6-3a41306b351d-console-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:27:57.591588 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:57.591553 2569 generic.go:356] "Generic (PLEG): container finished" podID="26ea52c1-9b91-4cd2-98e6-3a41306b351d" containerID="c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1" exitCode=0 Sep 09 02:27:57.592028 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:57.591600 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d6b948f6f-q8nb7" Sep 09 02:27:57.592028 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:57.591623 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6b948f6f-q8nb7" event={"ID":"26ea52c1-9b91-4cd2-98e6-3a41306b351d","Type":"ContainerDied","Data":"c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1"} Sep 09 02:27:57.592028 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:57.591662 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d6b948f6f-q8nb7" event={"ID":"26ea52c1-9b91-4cd2-98e6-3a41306b351d","Type":"ContainerDied","Data":"8580035b06deddcbd452239aadf87f10d67c08dc469eb7835ef3c74f19c0f5c5"} Sep 09 02:27:57.592028 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:57.591682 2569 scope.go:117] "RemoveContainer" containerID="c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1" Sep 09 02:27:57.600600 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:57.600582 2569 scope.go:117] "RemoveContainer" containerID="c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1" Sep 09 02:27:57.600863 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:27:57.600844 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1\": container with ID starting with c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1 not found: ID does not exist" containerID="c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1" Sep 09 02:27:57.600906 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:57.600871 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1"} err="failed to get container status \"c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1\": rpc error: code = NotFound desc = could not find container \"c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1\": container with ID starting with c5d4b4e11eeab210aaa2984a4563289f6e5a726b661ba108e40eb04d2c2943e1 not found: ID does not exist" Sep 09 02:27:57.616495 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:57.616461 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d6b948f6f-q8nb7"] Sep 09 02:27:57.619757 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:57.619734 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d6b948f6f-q8nb7"] Sep 09 02:27:58.775506 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:58.775475 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ea52c1-9b91-4cd2-98e6-3a41306b351d" path="/var/lib/kubelet/pods/26ea52c1-9b91-4cd2-98e6-3a41306b351d/volumes" Sep 09 02:27:58.971973 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:58.971892 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:58.972121 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:58.971975 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:58.976803 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:58.976777 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:59.609783 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:59.609752 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:27:59.654462 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:27:59.654422 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58698f889d-d2w55"] Sep 09 02:28:24.674674 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:24.674622 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58698f889d-d2w55" podUID="3adcedb5-6b6e-490d-9854-52f8d1903f43" containerName="console" containerID="cri-o://6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2" gracePeriod=15 Sep 09 02:28:24.936562 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:24.936503 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:28:25.007120 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007080 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-serving-cert\") pod \"3adcedb5-6b6e-490d-9854-52f8d1903f43\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " Sep 09 02:28:25.007120 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007120 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-oauth-serving-cert\") pod \"3adcedb5-6b6e-490d-9854-52f8d1903f43\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " Sep 09 02:28:25.007394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007164 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-oauth-config\") pod \"3adcedb5-6b6e-490d-9854-52f8d1903f43\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " Sep 09 02:28:25.007394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007188 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-config\") pod \"3adcedb5-6b6e-490d-9854-52f8d1903f43\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " Sep 09 02:28:25.007394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007211 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpnr7\" (UniqueName: \"kubernetes.io/projected/3adcedb5-6b6e-490d-9854-52f8d1903f43-kube-api-access-rpnr7\") pod \"3adcedb5-6b6e-490d-9854-52f8d1903f43\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " Sep 09 02:28:25.007394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007247 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-service-ca\") pod \"3adcedb5-6b6e-490d-9854-52f8d1903f43\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " Sep 09 02:28:25.007394 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007271 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-trusted-ca-bundle\") pod \"3adcedb5-6b6e-490d-9854-52f8d1903f43\" (UID: \"3adcedb5-6b6e-490d-9854-52f8d1903f43\") " Sep 09 02:28:25.007726 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007697 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-service-ca" (OuterVolumeSpecName: "service-ca") pod "3adcedb5-6b6e-490d-9854-52f8d1903f43" (UID: "3adcedb5-6b6e-490d-9854-52f8d1903f43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:28:25.007782 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007699 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3adcedb5-6b6e-490d-9854-52f8d1903f43" (UID: "3adcedb5-6b6e-490d-9854-52f8d1903f43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:28:25.007782 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007764 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-config" (OuterVolumeSpecName: "console-config") pod "3adcedb5-6b6e-490d-9854-52f8d1903f43" (UID: "3adcedb5-6b6e-490d-9854-52f8d1903f43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:28:25.007871 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.007827 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3adcedb5-6b6e-490d-9854-52f8d1903f43" (UID: "3adcedb5-6b6e-490d-9854-52f8d1903f43"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:28:25.009391 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.009373 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3adcedb5-6b6e-490d-9854-52f8d1903f43-kube-api-access-rpnr7" (OuterVolumeSpecName: "kube-api-access-rpnr7") pod "3adcedb5-6b6e-490d-9854-52f8d1903f43" (UID: "3adcedb5-6b6e-490d-9854-52f8d1903f43"). InnerVolumeSpecName "kube-api-access-rpnr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:28:25.009757 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.009728 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3adcedb5-6b6e-490d-9854-52f8d1903f43" (UID: "3adcedb5-6b6e-490d-9854-52f8d1903f43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:28:25.009757 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.009750 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3adcedb5-6b6e-490d-9854-52f8d1903f43" (UID: "3adcedb5-6b6e-490d-9854-52f8d1903f43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:28:25.108274 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.108236 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-oauth-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:28:25.108274 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.108265 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:28:25.108274 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.108276 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpnr7\" (UniqueName: \"kubernetes.io/projected/3adcedb5-6b6e-490d-9854-52f8d1903f43-kube-api-access-rpnr7\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:28:25.108274 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.108285 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:28:25.108567 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.108294 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-trusted-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:28:25.108567 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.108302 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3adcedb5-6b6e-490d-9854-52f8d1903f43-console-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:28:25.108567 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.108310 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3adcedb5-6b6e-490d-9854-52f8d1903f43-oauth-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:28:25.702698 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.702659 2569 generic.go:356] "Generic (PLEG): container finished" podID="3adcedb5-6b6e-490d-9854-52f8d1903f43" containerID="6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2" exitCode=0 Sep 09 02:28:25.703074 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.702710 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58698f889d-d2w55" Sep 09 02:28:25.703074 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.702732 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58698f889d-d2w55" event={"ID":"3adcedb5-6b6e-490d-9854-52f8d1903f43","Type":"ContainerDied","Data":"6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2"} Sep 09 02:28:25.703074 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.702782 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58698f889d-d2w55" event={"ID":"3adcedb5-6b6e-490d-9854-52f8d1903f43","Type":"ContainerDied","Data":"f35daa90c9b1c043e7cba9f87ce8669933e6cb049e3c87bb9f0bcafa40e30fde"} Sep 09 02:28:25.703074 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.702808 2569 scope.go:117] "RemoveContainer" containerID="6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2" Sep 09 02:28:25.711292 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.711270 2569 scope.go:117] "RemoveContainer" containerID="6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2" Sep 09 02:28:25.711605 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:28:25.711585 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2\": container with ID starting with 6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2 not found: ID does not exist" containerID="6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2" Sep 09 02:28:25.711676 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.711618 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2"} err="failed to get container status \"6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2\": rpc error: code = NotFound desc = could not find container \"6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2\": container with ID starting with 6ea4decebceefdc9043798e58ab209ddb2e74a0798e099065da674b7e50fc6d2 not found: ID does not exist" Sep 09 02:28:25.722539 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.722515 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58698f889d-d2w55"] Sep 09 02:28:25.725876 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:25.725853 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58698f889d-d2w55"] Sep 09 02:28:26.773967 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:26.773933 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3adcedb5-6b6e-490d-9854-52f8d1903f43" path="/var/lib/kubelet/pods/3adcedb5-6b6e-490d-9854-52f8d1903f43/volumes" Sep 09 02:28:47.916871 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:47.916819 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:28:47.932802 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:47.932777 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:28:48.805953 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:28:48.805919 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 02:29:01.418696 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.418655 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5db8899f6d-zkqc2"] Sep 09 02:29:01.419198 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.419183 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ea52c1-9b91-4cd2-98e6-3a41306b351d" containerName="console" Sep 09 02:29:01.419267 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.419206 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ea52c1-9b91-4cd2-98e6-3a41306b351d" containerName="console" Sep 09 02:29:01.419267 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.419223 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3adcedb5-6b6e-490d-9854-52f8d1903f43" containerName="console" Sep 09 02:29:01.419267 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.419233 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3adcedb5-6b6e-490d-9854-52f8d1903f43" containerName="console" Sep 09 02:29:01.419433 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.419311 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3adcedb5-6b6e-490d-9854-52f8d1903f43" containerName="console" Sep 09 02:29:01.419433 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.419326 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ea52c1-9b91-4cd2-98e6-3a41306b351d" containerName="console" Sep 09 02:29:01.423368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.423334 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.436468 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.436436 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5db8899f6d-zkqc2"] Sep 09 02:29:01.525020 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.524978 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-oauth-serving-cert\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.525020 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.525019 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwsw5\" (UniqueName: \"kubernetes.io/projected/e8951c94-68f6-4d6c-a1e4-e690d53259b9-kube-api-access-qwsw5\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.525247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.525062 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-serving-cert\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.525247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.525098 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-config\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.525247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.525126 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-trusted-ca-bundle\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.525247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.525198 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-oauth-config\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.525247 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.525229 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-service-ca\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.626138 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.626095 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-oauth-config\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.626138 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.626138 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-service-ca\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.626384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.626166 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-oauth-serving-cert\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.626384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.626191 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwsw5\" (UniqueName: \"kubernetes.io/projected/e8951c94-68f6-4d6c-a1e4-e690d53259b9-kube-api-access-qwsw5\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.626384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.626256 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-serving-cert\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.626384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.626290 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-config\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.626384 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.626380 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-trusted-ca-bundle\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.626938 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.626913 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-service-ca\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.627057 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.626998 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-oauth-serving-cert\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.627206 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.627182 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-config\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.627276 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.627205 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-trusted-ca-bundle\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.628841 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.628816 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-serving-cert\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.628922 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.628847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-oauth-config\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.633510 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.633492 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwsw5\" (UniqueName: \"kubernetes.io/projected/e8951c94-68f6-4d6c-a1e4-e690d53259b9-kube-api-access-qwsw5\") pod \"console-5db8899f6d-zkqc2\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:01.739992 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:01.739912 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:02.007870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:02.007840 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5db8899f6d-zkqc2"] Sep 09 02:29:02.011033 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:29:02.011007 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8951c94_68f6_4d6c_a1e4_e690d53259b9.slice/crio-d265fee6b8cedf3b8b72f859119e93c79900191e25bf68986c3d41e678ae721c WatchSource:0}: Error finding container d265fee6b8cedf3b8b72f859119e93c79900191e25bf68986c3d41e678ae721c: Status 404 returned error can't find the container with id d265fee6b8cedf3b8b72f859119e93c79900191e25bf68986c3d41e678ae721c Sep 09 02:29:02.845898 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:02.845858 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db8899f6d-zkqc2" event={"ID":"e8951c94-68f6-4d6c-a1e4-e690d53259b9","Type":"ContainerStarted","Data":"19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800"} Sep 09 02:29:02.846289 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:02.845915 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db8899f6d-zkqc2" event={"ID":"e8951c94-68f6-4d6c-a1e4-e690d53259b9","Type":"ContainerStarted","Data":"d265fee6b8cedf3b8b72f859119e93c79900191e25bf68986c3d41e678ae721c"} Sep 09 02:29:02.866200 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:02.866143 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5db8899f6d-zkqc2" podStartSLOduration=1.866125615 podStartE2EDuration="1.866125615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:29:02.864804135 +0000 UTC m=+184.587784559" watchObservedRunningTime="2026-09-09 02:29:02.866125615 +0000 UTC m=+184.589106012" Sep 09 02:29:11.740114 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:11.740071 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:11.740600 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:11.740155 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:11.744982 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:11.744961 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:11.890830 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:11.890799 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:29:11.925784 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:11.925749 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cb89f78d-snshq"] Sep 09 02:29:36.949602 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:36.949558 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55cb89f78d-snshq" podUID="fcddf74b-1488-4e3f-8be2-cbd849103a59" containerName="console" containerID="cri-o://ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4" gracePeriod=15 Sep 09 02:29:37.189680 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.189655 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:29:37.324077 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324043 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-trusted-ca-bundle\") pod \"fcddf74b-1488-4e3f-8be2-cbd849103a59\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " Sep 09 02:29:37.324281 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324111 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kl72\" (UniqueName: \"kubernetes.io/projected/fcddf74b-1488-4e3f-8be2-cbd849103a59-kube-api-access-4kl72\") pod \"fcddf74b-1488-4e3f-8be2-cbd849103a59\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " Sep 09 02:29:37.324281 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324149 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-config\") pod \"fcddf74b-1488-4e3f-8be2-cbd849103a59\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " Sep 09 02:29:37.324281 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324180 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-serving-cert\") pod \"fcddf74b-1488-4e3f-8be2-cbd849103a59\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " Sep 09 02:29:37.324281 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324237 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-oauth-config\") pod \"fcddf74b-1488-4e3f-8be2-cbd849103a59\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " Sep 09 02:29:37.324281 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324276 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-service-ca\") pod \"fcddf74b-1488-4e3f-8be2-cbd849103a59\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " Sep 09 02:29:37.324567 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324304 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-oauth-serving-cert\") pod \"fcddf74b-1488-4e3f-8be2-cbd849103a59\" (UID: \"fcddf74b-1488-4e3f-8be2-cbd849103a59\") " Sep 09 02:29:37.324668 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324640 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fcddf74b-1488-4e3f-8be2-cbd849103a59" (UID: "fcddf74b-1488-4e3f-8be2-cbd849103a59"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:29:37.324721 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324655 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-config" (OuterVolumeSpecName: "console-config") pod "fcddf74b-1488-4e3f-8be2-cbd849103a59" (UID: "fcddf74b-1488-4e3f-8be2-cbd849103a59"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:29:37.324792 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324771 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-service-ca" (OuterVolumeSpecName: "service-ca") pod "fcddf74b-1488-4e3f-8be2-cbd849103a59" (UID: "fcddf74b-1488-4e3f-8be2-cbd849103a59"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:29:37.324874 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.324851 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fcddf74b-1488-4e3f-8be2-cbd849103a59" (UID: "fcddf74b-1488-4e3f-8be2-cbd849103a59"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:29:37.326424 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.326391 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcddf74b-1488-4e3f-8be2-cbd849103a59-kube-api-access-4kl72" (OuterVolumeSpecName: "kube-api-access-4kl72") pod "fcddf74b-1488-4e3f-8be2-cbd849103a59" (UID: "fcddf74b-1488-4e3f-8be2-cbd849103a59"). InnerVolumeSpecName "kube-api-access-4kl72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:29:37.326549 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.326418 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fcddf74b-1488-4e3f-8be2-cbd849103a59" (UID: "fcddf74b-1488-4e3f-8be2-cbd849103a59"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:29:37.326549 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.326430 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fcddf74b-1488-4e3f-8be2-cbd849103a59" (UID: "fcddf74b-1488-4e3f-8be2-cbd849103a59"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:29:37.425948 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.425905 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:29:37.425948 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.425942 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-oauth-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:29:37.425948 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.425955 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-trusted-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:29:37.426208 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.425966 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kl72\" (UniqueName: \"kubernetes.io/projected/fcddf74b-1488-4e3f-8be2-cbd849103a59-kube-api-access-4kl72\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:29:37.426208 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.425978 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:29:37.426208 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.425989 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:29:37.426208 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.426000 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcddf74b-1488-4e3f-8be2-cbd849103a59-console-oauth-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:29:37.989131 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.989088 2569 generic.go:356] "Generic (PLEG): container finished" podID="fcddf74b-1488-4e3f-8be2-cbd849103a59" containerID="ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4" exitCode=0 Sep 09 02:29:37.989131 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.989131 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cb89f78d-snshq" Sep 09 02:29:37.989588 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.989163 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cb89f78d-snshq" event={"ID":"fcddf74b-1488-4e3f-8be2-cbd849103a59","Type":"ContainerDied","Data":"ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4"} Sep 09 02:29:37.989588 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.989206 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cb89f78d-snshq" event={"ID":"fcddf74b-1488-4e3f-8be2-cbd849103a59","Type":"ContainerDied","Data":"0a65c4d511aaf81fa01d63e6bbe5b2e151de8388b91122dc4de067d4e2a19ca8"} Sep 09 02:29:37.989588 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.989228 2569 scope.go:117] "RemoveContainer" containerID="ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4" Sep 09 02:29:37.998537 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.998515 2569 scope.go:117] "RemoveContainer" containerID="ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4" Sep 09 02:29:37.998815 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:29:37.998795 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4\": container with ID starting with ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4 not found: ID does not exist" containerID="ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4" Sep 09 02:29:37.998877 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:37.998828 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4"} err="failed to get container status \"ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4\": rpc error: code = NotFound desc = could not find container \"ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4\": container with ID starting with ae8ef0d07105e5b5e498b820e00829e0c66129798a1bd12356f4845595da9cc4 not found: ID does not exist" Sep 09 02:29:38.009628 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:38.009601 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cb89f78d-snshq"] Sep 09 02:29:38.011787 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:38.011761 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55cb89f78d-snshq"] Sep 09 02:29:38.774307 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:29:38.774274 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcddf74b-1488-4e3f-8be2-cbd849103a59" path="/var/lib/kubelet/pods/fcddf74b-1488-4e3f-8be2-cbd849103a59/volumes" Sep 09 02:30:15.555857 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.555819 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8rphz"] Sep 09 02:30:15.556318 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.556160 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcddf74b-1488-4e3f-8be2-cbd849103a59" containerName="console" Sep 09 02:30:15.556318 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.556172 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcddf74b-1488-4e3f-8be2-cbd849103a59" containerName="console" Sep 09 02:30:15.556318 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.556220 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcddf74b-1488-4e3f-8be2-cbd849103a59" containerName="console" Sep 09 02:30:15.560378 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.560360 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:15.562687 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.562663 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 02:30:15.562783 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.562722 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 02:30:15.562783 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.562768 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-j62t5\"" Sep 09 02:30:15.572996 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.572970 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8rphz"] Sep 09 02:30:15.657063 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.657028 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a428d33c-b9f6-44d0-8cb0-fa28b1731fc4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8rphz\" (UID: \"a428d33c-b9f6-44d0-8cb0-fa28b1731fc4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:15.657227 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.657086 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q45nv\" (UniqueName: \"kubernetes.io/projected/a428d33c-b9f6-44d0-8cb0-fa28b1731fc4-kube-api-access-q45nv\") pod \"cert-manager-webhook-6486ffd997-8rphz\" (UID: \"a428d33c-b9f6-44d0-8cb0-fa28b1731fc4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:15.757797 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.757749 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q45nv\" (UniqueName: \"kubernetes.io/projected/a428d33c-b9f6-44d0-8cb0-fa28b1731fc4-kube-api-access-q45nv\") pod \"cert-manager-webhook-6486ffd997-8rphz\" (UID: \"a428d33c-b9f6-44d0-8cb0-fa28b1731fc4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:15.757944 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.757839 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a428d33c-b9f6-44d0-8cb0-fa28b1731fc4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8rphz\" (UID: \"a428d33c-b9f6-44d0-8cb0-fa28b1731fc4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:15.772141 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.772107 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a428d33c-b9f6-44d0-8cb0-fa28b1731fc4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8rphz\" (UID: \"a428d33c-b9f6-44d0-8cb0-fa28b1731fc4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:15.776429 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.776402 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q45nv\" (UniqueName: \"kubernetes.io/projected/a428d33c-b9f6-44d0-8cb0-fa28b1731fc4-kube-api-access-q45nv\") pod \"cert-manager-webhook-6486ffd997-8rphz\" (UID: \"a428d33c-b9f6-44d0-8cb0-fa28b1731fc4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:15.888408 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:15.888304 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:16.157418 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:16.157328 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8rphz"] Sep 09 02:30:16.160486 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:30:16.160445 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda428d33c_b9f6_44d0_8cb0_fa28b1731fc4.slice/crio-f1d3391963265c6d13799f94242687399895186e7eb2827a0f682a36a654e6e2 WatchSource:0}: Error finding container f1d3391963265c6d13799f94242687399895186e7eb2827a0f682a36a654e6e2: Status 404 returned error can't find the container with id f1d3391963265c6d13799f94242687399895186e7eb2827a0f682a36a654e6e2 Sep 09 02:30:17.143646 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:17.143610 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" event={"ID":"a428d33c-b9f6-44d0-8cb0-fa28b1731fc4","Type":"ContainerStarted","Data":"f1d3391963265c6d13799f94242687399895186e7eb2827a0f682a36a654e6e2"} Sep 09 02:30:20.159452 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:20.159413 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" event={"ID":"a428d33c-b9f6-44d0-8cb0-fa28b1731fc4","Type":"ContainerStarted","Data":"b17121286a73a324a270d46f8cf1a5469f80b9d89e8094c6b9aa284c43441ed4"} Sep 09 02:30:20.159861 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:20.159555 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:20.174564 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:20.174518 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" podStartSLOduration=1.3429704089999999 podStartE2EDuration="5.174504025s" totalImagesPullingTime="3.831533616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:30:20.173365046 +0000 UTC m=+261.896345446" watchObservedRunningTime="2026-09-09 02:30:20.174504025 +0000 UTC m=+261.897484422" Sep 09 02:30:25.515085 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.515005 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9j5kw"] Sep 09 02:30:25.518301 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.518283 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9j5kw" Sep 09 02:30:25.520364 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.520325 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-r7lk6\"" Sep 09 02:30:25.528266 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.528243 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9j5kw"] Sep 09 02:30:25.663984 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.663940 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvpfm\" (UniqueName: \"kubernetes.io/projected/0a168234-24d1-40d3-a045-f7643ac72ea8-kube-api-access-bvpfm\") pod \"cert-manager-55b4d954d5-9j5kw\" (UID: \"0a168234-24d1-40d3-a045-f7643ac72ea8\") " pod="cert-manager/cert-manager-55b4d954d5-9j5kw" Sep 09 02:30:25.664159 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.663995 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a168234-24d1-40d3-a045-f7643ac72ea8-bound-sa-token\") pod \"cert-manager-55b4d954d5-9j5kw\" (UID: \"0a168234-24d1-40d3-a045-f7643ac72ea8\") " pod="cert-manager/cert-manager-55b4d954d5-9j5kw" Sep 09 02:30:25.765389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.765265 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvpfm\" (UniqueName: \"kubernetes.io/projected/0a168234-24d1-40d3-a045-f7643ac72ea8-kube-api-access-bvpfm\") pod \"cert-manager-55b4d954d5-9j5kw\" (UID: \"0a168234-24d1-40d3-a045-f7643ac72ea8\") " pod="cert-manager/cert-manager-55b4d954d5-9j5kw" Sep 09 02:30:25.765389 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.765312 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a168234-24d1-40d3-a045-f7643ac72ea8-bound-sa-token\") pod \"cert-manager-55b4d954d5-9j5kw\" (UID: \"0a168234-24d1-40d3-a045-f7643ac72ea8\") " pod="cert-manager/cert-manager-55b4d954d5-9j5kw" Sep 09 02:30:25.772952 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.772926 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a168234-24d1-40d3-a045-f7643ac72ea8-bound-sa-token\") pod \"cert-manager-55b4d954d5-9j5kw\" (UID: \"0a168234-24d1-40d3-a045-f7643ac72ea8\") " pod="cert-manager/cert-manager-55b4d954d5-9j5kw" Sep 09 02:30:25.773082 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.773024 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvpfm\" (UniqueName: \"kubernetes.io/projected/0a168234-24d1-40d3-a045-f7643ac72ea8-kube-api-access-bvpfm\") pod \"cert-manager-55b4d954d5-9j5kw\" (UID: \"0a168234-24d1-40d3-a045-f7643ac72ea8\") " pod="cert-manager/cert-manager-55b4d954d5-9j5kw" Sep 09 02:30:25.828045 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:25.828010 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9j5kw" Sep 09 02:30:26.094390 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:26.094362 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9j5kw"] Sep 09 02:30:26.096955 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:30:26.096927 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a168234_24d1_40d3_a045_f7643ac72ea8.slice/crio-8c085862d7f811d071320c3fa3f000f4105c89691b6bfccb0356cc06b4774c21 WatchSource:0}: Error finding container 8c085862d7f811d071320c3fa3f000f4105c89691b6bfccb0356cc06b4774c21: Status 404 returned error can't find the container with id 8c085862d7f811d071320c3fa3f000f4105c89691b6bfccb0356cc06b4774c21 Sep 09 02:30:26.165709 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:26.165684 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8rphz" Sep 09 02:30:26.186761 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:26.186677 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9j5kw" event={"ID":"0a168234-24d1-40d3-a045-f7643ac72ea8","Type":"ContainerStarted","Data":"668847b2dc88bef6c936712d789bd0990b6c143fe518dcbd5a3a95b029fe8cad"} Sep 09 02:30:26.186761 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:26.186723 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9j5kw" event={"ID":"0a168234-24d1-40d3-a045-f7643ac72ea8","Type":"ContainerStarted","Data":"8c085862d7f811d071320c3fa3f000f4105c89691b6bfccb0356cc06b4774c21"} Sep 09 02:30:26.201673 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:26.201623 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9j5kw" podStartSLOduration=1.201605722 podStartE2EDuration="1.201605722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:30:26.201033994 +0000 UTC m=+267.924014393" watchObservedRunningTime="2026-09-09 02:30:26.201605722 +0000 UTC m=+267.924586120" Sep 09 02:30:31.499776 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.499730 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx"] Sep 09 02:30:31.503281 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.503257 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" Sep 09 02:30:31.505453 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.505427 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 02:30:31.505562 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.505497 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 02:30:31.506288 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.506270 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5r2qr\"" Sep 09 02:30:31.510049 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.510027 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx"] Sep 09 02:30:31.614574 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.614520 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgwj6\" (UniqueName: \"kubernetes.io/projected/947d7782-7d6d-41da-a124-da6af6028dd0-kube-api-access-dgwj6\") pod \"openshift-lws-operator-fd8ccff4c-vkmxx\" (UID: \"947d7782-7d6d-41da-a124-da6af6028dd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" Sep 09 02:30:31.614758 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.614675 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/947d7782-7d6d-41da-a124-da6af6028dd0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vkmxx\" (UID: \"947d7782-7d6d-41da-a124-da6af6028dd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" Sep 09 02:30:31.715492 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.715456 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/947d7782-7d6d-41da-a124-da6af6028dd0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vkmxx\" (UID: \"947d7782-7d6d-41da-a124-da6af6028dd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" Sep 09 02:30:31.715623 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.715510 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgwj6\" (UniqueName: \"kubernetes.io/projected/947d7782-7d6d-41da-a124-da6af6028dd0-kube-api-access-dgwj6\") pod \"openshift-lws-operator-fd8ccff4c-vkmxx\" (UID: \"947d7782-7d6d-41da-a124-da6af6028dd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" Sep 09 02:30:31.715830 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.715811 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/947d7782-7d6d-41da-a124-da6af6028dd0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vkmxx\" (UID: \"947d7782-7d6d-41da-a124-da6af6028dd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" Sep 09 02:30:31.723211 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.723179 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgwj6\" (UniqueName: \"kubernetes.io/projected/947d7782-7d6d-41da-a124-da6af6028dd0-kube-api-access-dgwj6\") pod \"openshift-lws-operator-fd8ccff4c-vkmxx\" (UID: \"947d7782-7d6d-41da-a124-da6af6028dd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" Sep 09 02:30:31.812973 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:31.812939 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" Sep 09 02:30:32.079351 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:32.079284 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx"] Sep 09 02:30:32.081853 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:30:32.081830 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod947d7782_7d6d_41da_a124_da6af6028dd0.slice/crio-33e797c5df6ee8ceeb1d9ddfe42f03f9733c85c44cf43726baa6081a4569b7d5 WatchSource:0}: Error finding container 33e797c5df6ee8ceeb1d9ddfe42f03f9733c85c44cf43726baa6081a4569b7d5: Status 404 returned error can't find the container with id 33e797c5df6ee8ceeb1d9ddfe42f03f9733c85c44cf43726baa6081a4569b7d5 Sep 09 02:30:32.213557 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:32.213523 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" event={"ID":"947d7782-7d6d-41da-a124-da6af6028dd0","Type":"ContainerStarted","Data":"33e797c5df6ee8ceeb1d9ddfe42f03f9733c85c44cf43726baa6081a4569b7d5"} Sep 09 02:30:35.228555 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:35.228503 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" event={"ID":"947d7782-7d6d-41da-a124-da6af6028dd0","Type":"ContainerStarted","Data":"ecaebd56c4f6245ffb5789fc26c4f0ccf332973f818d78ddb9d5fced69eb56c6"} Sep 09 02:30:35.242721 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:35.242663 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vkmxx" podStartSLOduration=1.6392309680000001 podStartE2EDuration="4.24264334s" totalImagesPullingTime="2.603412372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:30:35.242067487 +0000 UTC m=+276.965047885" watchObservedRunningTime="2026-09-09 02:30:35.24264334 +0000 UTC m=+276.965623759" Sep 09 02:30:54.775530 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.775500 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq"] Sep 09 02:30:54.778299 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.778283 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.780871 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.780840 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 02:30:54.780997 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.780898 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 02:30:54.780997 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.780895 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w24vw\"" Sep 09 02:30:54.781117 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.780999 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 02:30:54.781279 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.781262 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 02:30:54.794151 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.794122 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq"] Sep 09 02:30:54.817689 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.817659 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.817825 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.817706 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-manifests\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.817825 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.817724 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-tmp\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.817825 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.817809 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.817926 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.817841 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8vdj\" (UniqueName: \"kubernetes.io/projected/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-kube-api-access-k8vdj\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.918479 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.918443 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-manifests\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.918479 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.918481 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-tmp\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.918689 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.918516 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.918689 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.918644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8vdj\" (UniqueName: \"kubernetes.io/projected/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-kube-api-access-k8vdj\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.918784 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.918767 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.918965 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.918943 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-manifests\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.920833 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.920805 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-tmp\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.921045 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.921028 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-webhook-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.921092 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.921042 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:54.933556 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:54.933533 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8vdj\" (UniqueName: \"kubernetes.io/projected/ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d-kube-api-access-k8vdj\") pod \"opendatahub-operator-controller-manager-66fb449fdb-g4jzq\" (UID: \"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d\") " pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:55.090590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:55.090504 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:30:55.378254 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:55.378227 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq"] Sep 09 02:30:55.380150 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:30:55.380120 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf9dc5e_0112_4dc8_bdc2_15148dab6d9d.slice/crio-d35ead1fd411f5b390f35a414fc0d409d3686bb41ae7357e60ef607fcb281dd0 WatchSource:0}: Error finding container d35ead1fd411f5b390f35a414fc0d409d3686bb41ae7357e60ef607fcb281dd0: Status 404 returned error can't find the container with id d35ead1fd411f5b390f35a414fc0d409d3686bb41ae7357e60ef607fcb281dd0 Sep 09 02:30:56.315572 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:56.315533 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" event={"ID":"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d","Type":"ContainerStarted","Data":"d35ead1fd411f5b390f35a414fc0d409d3686bb41ae7357e60ef607fcb281dd0"} Sep 09 02:30:58.919571 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:58.919538 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/0.log" Sep 09 02:30:58.921054 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:58.919766 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/0.log" Sep 09 02:30:58.926255 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:58.926237 2569 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 02:30:59.334989 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:30:59.334953 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" event={"ID":"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d","Type":"ContainerStarted","Data":"554b57426c8d2e0b41c0026f871369449d9b5d8a174540a449c31f29e4613253"} Sep 09 02:31:00.340379 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:00.340271 2569 generic.go:356] "Generic (PLEG): container finished" podID="ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d" containerID="554b57426c8d2e0b41c0026f871369449d9b5d8a174540a449c31f29e4613253" exitCode=0 Sep 09 02:31:00.340379 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:00.340365 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" event={"ID":"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d","Type":"ContainerDied","Data":"554b57426c8d2e0b41c0026f871369449d9b5d8a174540a449c31f29e4613253"} Sep 09 02:31:00.340880 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:00.340864 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 02:31:01.347311 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:01.347271 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" event={"ID":"ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d","Type":"ContainerStarted","Data":"176c38ce37af23a83ad33b7433b746aea06a3c8eeaec53cf296046eeec081186"} Sep 09 02:31:01.347707 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:01.347417 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:31:01.367487 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:01.367436 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" podStartSLOduration=2.25490234 podStartE2EDuration="7.367420169s" totalImagesPullingTime="4.06108449s" totalInitContainerRuntime="1.051433339s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:30:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:01.365712962 +0000 UTC m=+303.088693397" watchObservedRunningTime="2026-09-09 02:31:01.367420169 +0000 UTC m=+303.090400576" Sep 09 02:31:12.353255 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:12.353224 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66fb449fdb-g4jzq" Sep 09 02:31:31.798519 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.798481 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n"] Sep 09 02:31:31.804809 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.804789 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:31.807234 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.807210 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 09 02:31:31.807385 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.807267 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 09 02:31:31.807385 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.807322 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 02:31:31.807544 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.807391 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 02:31:31.807544 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.807483 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 02:31:31.807544 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.807517 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 09 02:31:31.807686 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.807587 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w8jlw\"" Sep 09 02:31:31.812911 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.812891 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n"] Sep 09 02:31:31.949211 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.949174 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2800f7fe-1660-446c-a5f6-dc2066bba88d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:31.949464 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.949239 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:31.949464 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.949319 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npgf8\" (UniqueName: \"kubernetes.io/projected/2800f7fe-1660-446c-a5f6-dc2066bba88d-kube-api-access-npgf8\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:31.949464 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.949398 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:31.949464 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.949424 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:31.949464 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.949452 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:31.949664 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:31.949514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2800f7fe-1660-446c-a5f6-dc2066bba88d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.050487 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.050390 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npgf8\" (UniqueName: \"kubernetes.io/projected/2800f7fe-1660-446c-a5f6-dc2066bba88d-kube-api-access-npgf8\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.050487 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.050431 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.050487 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.050452 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.050487 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.050476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.050817 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.050512 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2800f7fe-1660-446c-a5f6-dc2066bba88d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.050817 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.050586 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2800f7fe-1660-446c-a5f6-dc2066bba88d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.050817 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.050660 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.051156 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.051128 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.053052 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.053031 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.053052 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.053041 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2800f7fe-1660-446c-a5f6-dc2066bba88d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.053205 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.053062 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2800f7fe-1660-446c-a5f6-dc2066bba88d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.053205 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.053063 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.057980 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.057960 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2800f7fe-1660-446c-a5f6-dc2066bba88d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.058658 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.058637 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npgf8\" (UniqueName: \"kubernetes.io/projected/2800f7fe-1660-446c-a5f6-dc2066bba88d-kube-api-access-npgf8\") pod \"istiod-openshift-gateway-5677ccb49b-nbj8n\" (UID: \"2800f7fe-1660-446c-a5f6-dc2066bba88d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.114618 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.114574 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:32.392833 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.392809 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n"] Sep 09 02:31:32.394909 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:31:32.394878 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2800f7fe_1660_446c_a5f6_dc2066bba88d.slice/crio-ef8695495612c271d2c76ce3398f484923a4782e4451f22fe27e1df3e6571aee WatchSource:0}: Error finding container ef8695495612c271d2c76ce3398f484923a4782e4451f22fe27e1df3e6571aee: Status 404 returned error can't find the container with id ef8695495612c271d2c76ce3398f484923a4782e4451f22fe27e1df3e6571aee Sep 09 02:31:32.489681 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:32.489646 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" event={"ID":"2800f7fe-1660-446c-a5f6-dc2066bba88d","Type":"ContainerStarted","Data":"ef8695495612c271d2c76ce3398f484923a4782e4451f22fe27e1df3e6571aee"} Sep 09 02:31:33.362716 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.362590 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5"] Sep 09 02:31:33.367601 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.367561 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.370183 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.370161 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 02:31:33.371015 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.370989 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 02:31:33.371170 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.371129 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hjhvn\"" Sep 09 02:31:33.371243 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.370989 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 02:31:33.378538 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.378514 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5"] Sep 09 02:31:33.466775 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.466726 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d37ef7c-1f8c-49c3-b114-d9c63221d567-metrics-cert\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.466964 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.466788 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d37ef7c-1f8c-49c3-b114-d9c63221d567-cert\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.466964 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.466896 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qmkr\" (UniqueName: \"kubernetes.io/projected/2d37ef7c-1f8c-49c3-b114-d9c63221d567-kube-api-access-5qmkr\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.466964 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.466927 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d37ef7c-1f8c-49c3-b114-d9c63221d567-manager-config\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.567787 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.567748 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qmkr\" (UniqueName: \"kubernetes.io/projected/2d37ef7c-1f8c-49c3-b114-d9c63221d567-kube-api-access-5qmkr\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.567964 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.567801 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d37ef7c-1f8c-49c3-b114-d9c63221d567-manager-config\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.567964 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.567861 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d37ef7c-1f8c-49c3-b114-d9c63221d567-metrics-cert\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.567964 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.567908 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d37ef7c-1f8c-49c3-b114-d9c63221d567-cert\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.568807 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.568753 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d37ef7c-1f8c-49c3-b114-d9c63221d567-manager-config\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.571140 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.570810 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d37ef7c-1f8c-49c3-b114-d9c63221d567-metrics-cert\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.571140 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.571024 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d37ef7c-1f8c-49c3-b114-d9c63221d567-cert\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.580417 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.580392 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qmkr\" (UniqueName: \"kubernetes.io/projected/2d37ef7c-1f8c-49c3-b114-d9c63221d567-kube-api-access-5qmkr\") pod \"lws-controller-manager-5cf499d5f9-vdqr5\" (UID: \"2d37ef7c-1f8c-49c3-b114-d9c63221d567\") " pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.679674 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.679601 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:33.986155 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:33.986067 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5"] Sep 09 02:31:33.988494 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:31:33.988451 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d37ef7c_1f8c_49c3_b114_d9c63221d567.slice/crio-59ed6aeb0cf5f6d8f32e92cae7f99095b75e530015f135d230e75e3ea106a160 WatchSource:0}: Error finding container 59ed6aeb0cf5f6d8f32e92cae7f99095b75e530015f135d230e75e3ea106a160: Status 404 returned error can't find the container with id 59ed6aeb0cf5f6d8f32e92cae7f99095b75e530015f135d230e75e3ea106a160 Sep 09 02:31:34.503836 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:34.503799 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" event={"ID":"2d37ef7c-1f8c-49c3-b114-d9c63221d567","Type":"ContainerStarted","Data":"59ed6aeb0cf5f6d8f32e92cae7f99095b75e530015f135d230e75e3ea106a160"} Sep 09 02:31:35.248022 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:35.247981 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 02:31:35.248144 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:35.248057 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 02:31:35.510250 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:35.510217 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" event={"ID":"2800f7fe-1660-446c-a5f6-dc2066bba88d","Type":"ContainerStarted","Data":"0aca9734a88c0a41051be35913dfb230402188ef6a1a274acaab9b27ceb4349f"} Sep 09 02:31:35.510729 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:35.510362 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:35.535692 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:35.535625 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" podStartSLOduration=1.684794733 podStartE2EDuration="4.535604018s" totalImagesPullingTime="2.850809285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:35.534033798 +0000 UTC m=+337.257014195" watchObservedRunningTime="2026-09-09 02:31:35.535604018 +0000 UTC m=+337.258584414" Sep 09 02:31:36.517652 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:36.517620 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nbj8n" Sep 09 02:31:37.520944 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:37.520909 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" event={"ID":"2d37ef7c-1f8c-49c3-b114-d9c63221d567","Type":"ContainerStarted","Data":"e5ab14e2527ffbd71566ee131260db6aea6b143b77fea674eb80dae354ec6e5e"} Sep 09 02:31:37.539043 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:37.538988 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" podStartSLOduration=1.681647945 podStartE2EDuration="4.538970814s" totalImagesPullingTime="2.857322869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:31:37.537799932 +0000 UTC m=+339.260780341" watchObservedRunningTime="2026-09-09 02:31:37.538970814 +0000 UTC m=+339.261951211" Sep 09 02:31:38.525581 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:38.525550 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:31:49.531825 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:31:49.531795 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cf499d5f9-vdqr5" Sep 09 02:32:17.012392 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.012357 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b9dbfd5-kvrfh"] Sep 09 02:32:17.018491 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.018468 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.027077 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.027051 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b9dbfd5-kvrfh"] Sep 09 02:32:17.154721 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.154682 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65d320f6-c857-4718-849f-56e1b942660a-console-serving-cert\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.154721 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.154728 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-oauth-serving-cert\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.154972 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.154743 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2xzj\" (UniqueName: \"kubernetes.io/projected/65d320f6-c857-4718-849f-56e1b942660a-kube-api-access-p2xzj\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.154972 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.154838 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-console-config\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.154972 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.154928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65d320f6-c857-4718-849f-56e1b942660a-console-oauth-config\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.154972 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.154956 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-service-ca\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.155127 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.155010 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-trusted-ca-bundle\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.256132 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.256097 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65d320f6-c857-4718-849f-56e1b942660a-console-serving-cert\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.256323 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.256141 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-oauth-serving-cert\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.256323 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.256164 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2xzj\" (UniqueName: \"kubernetes.io/projected/65d320f6-c857-4718-849f-56e1b942660a-kube-api-access-p2xzj\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.256323 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.256203 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-console-config\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.256323 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.256263 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65d320f6-c857-4718-849f-56e1b942660a-console-oauth-config\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.256323 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.256285 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-service-ca\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.256635 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.256331 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-trusted-ca-bundle\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.256993 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.256952 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-oauth-serving-cert\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.257098 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.257004 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-console-config\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.257202 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.257181 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-service-ca\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.257306 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.257284 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d320f6-c857-4718-849f-56e1b942660a-trusted-ca-bundle\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.258906 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.258879 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65d320f6-c857-4718-849f-56e1b942660a-console-oauth-config\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.258989 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.258925 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65d320f6-c857-4718-849f-56e1b942660a-console-serving-cert\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.263876 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.263823 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2xzj\" (UniqueName: \"kubernetes.io/projected/65d320f6-c857-4718-849f-56e1b942660a-kube-api-access-p2xzj\") pod \"console-7b9dbfd5-kvrfh\" (UID: \"65d320f6-c857-4718-849f-56e1b942660a\") " pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.329216 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.329169 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:17.596900 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.596822 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b9dbfd5-kvrfh"] Sep 09 02:32:17.600361 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:32:17.600314 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d320f6_c857_4718_849f_56e1b942660a.slice/crio-5fc892eb91704a5e33edc49a6b0278604e85f05a6d5f10dfbb6006414956c9de WatchSource:0}: Error finding container 5fc892eb91704a5e33edc49a6b0278604e85f05a6d5f10dfbb6006414956c9de: Status 404 returned error can't find the container with id 5fc892eb91704a5e33edc49a6b0278604e85f05a6d5f10dfbb6006414956c9de Sep 09 02:32:17.702621 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.702587 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9dbfd5-kvrfh" event={"ID":"65d320f6-c857-4718-849f-56e1b942660a","Type":"ContainerStarted","Data":"7d59c2fa3bb4a3ef5aba4b0449aca9d9e29f9d3fa5a33c2d7f8383f123425fd9"} Sep 09 02:32:17.702803 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.702634 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9dbfd5-kvrfh" event={"ID":"65d320f6-c857-4718-849f-56e1b942660a","Type":"ContainerStarted","Data":"5fc892eb91704a5e33edc49a6b0278604e85f05a6d5f10dfbb6006414956c9de"} Sep 09 02:32:17.720713 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:17.720652 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b9dbfd5-kvrfh" podStartSLOduration=1.720635081 podStartE2EDuration="1.720635081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:32:17.718502409 +0000 UTC m=+379.441482888" watchObservedRunningTime="2026-09-09 02:32:17.720635081 +0000 UTC m=+379.443615478" Sep 09 02:32:27.329858 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:27.329824 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:27.330262 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:27.329880 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:27.334542 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:27.334519 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:27.754563 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:27.754538 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b9dbfd5-kvrfh" Sep 09 02:32:27.800238 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:27.800200 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5db8899f6d-zkqc2"] Sep 09 02:32:52.820522 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:52.820473 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5db8899f6d-zkqc2" podUID="e8951c94-68f6-4d6c-a1e4-e690d53259b9" containerName="console" containerID="cri-o://19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800" gracePeriod=15 Sep 09 02:32:53.058377 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.058354 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:32:53.188403 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188302 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-oauth-serving-cert\") pod \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " Sep 09 02:32:53.188403 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188362 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-service-ca\") pod \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " Sep 09 02:32:53.188617 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188408 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-serving-cert\") pod \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " Sep 09 02:32:53.188617 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188448 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-trusted-ca-bundle\") pod \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " Sep 09 02:32:53.188617 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188468 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-config\") pod \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " Sep 09 02:32:53.188617 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188482 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-oauth-config\") pod \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " Sep 09 02:32:53.188617 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188534 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwsw5\" (UniqueName: \"kubernetes.io/projected/e8951c94-68f6-4d6c-a1e4-e690d53259b9-kube-api-access-qwsw5\") pod \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\" (UID: \"e8951c94-68f6-4d6c-a1e4-e690d53259b9\") " Sep 09 02:32:53.188869 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188808 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8951c94-68f6-4d6c-a1e4-e690d53259b9" (UID: "e8951c94-68f6-4d6c-a1e4-e690d53259b9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:32:53.188869 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188838 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8951c94-68f6-4d6c-a1e4-e690d53259b9" (UID: "e8951c94-68f6-4d6c-a1e4-e690d53259b9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:32:53.188869 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.188852 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-config" (OuterVolumeSpecName: "console-config") pod "e8951c94-68f6-4d6c-a1e4-e690d53259b9" (UID: "e8951c94-68f6-4d6c-a1e4-e690d53259b9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:32:53.189032 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.189014 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8951c94-68f6-4d6c-a1e4-e690d53259b9" (UID: "e8951c94-68f6-4d6c-a1e4-e690d53259b9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 02:32:53.190741 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.190714 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8951c94-68f6-4d6c-a1e4-e690d53259b9-kube-api-access-qwsw5" (OuterVolumeSpecName: "kube-api-access-qwsw5") pod "e8951c94-68f6-4d6c-a1e4-e690d53259b9" (UID: "e8951c94-68f6-4d6c-a1e4-e690d53259b9"). InnerVolumeSpecName "kube-api-access-qwsw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 02:32:53.191008 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.190989 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8951c94-68f6-4d6c-a1e4-e690d53259b9" (UID: "e8951c94-68f6-4d6c-a1e4-e690d53259b9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:32:53.191080 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.191003 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8951c94-68f6-4d6c-a1e4-e690d53259b9" (UID: "e8951c94-68f6-4d6c-a1e4-e690d53259b9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 02:32:53.289749 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.289710 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-oauth-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:32:53.289749 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.289741 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:32:53.289749 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.289757 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-serving-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:32:53.289984 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.289769 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-trusted-ca-bundle\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:32:53.289984 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.289780 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:32:53.289984 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.289792 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8951c94-68f6-4d6c-a1e4-e690d53259b9-console-oauth-config\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:32:53.289984 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.289803 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwsw5\" (UniqueName: \"kubernetes.io/projected/e8951c94-68f6-4d6c-a1e4-e690d53259b9-kube-api-access-qwsw5\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\"" Sep 09 02:32:53.872040 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.872005 2569 generic.go:356] "Generic (PLEG): container finished" podID="e8951c94-68f6-4d6c-a1e4-e690d53259b9" containerID="19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800" exitCode=0 Sep 09 02:32:53.872425 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.872055 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db8899f6d-zkqc2" Sep 09 02:32:53.872425 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.872091 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db8899f6d-zkqc2" event={"ID":"e8951c94-68f6-4d6c-a1e4-e690d53259b9","Type":"ContainerDied","Data":"19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800"} Sep 09 02:32:53.872425 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.872143 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db8899f6d-zkqc2" event={"ID":"e8951c94-68f6-4d6c-a1e4-e690d53259b9","Type":"ContainerDied","Data":"d265fee6b8cedf3b8b72f859119e93c79900191e25bf68986c3d41e678ae721c"} Sep 09 02:32:53.872425 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.872169 2569 scope.go:117] "RemoveContainer" containerID="19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800" Sep 09 02:32:53.881307 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.881289 2569 scope.go:117] "RemoveContainer" containerID="19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800" Sep 09 02:32:53.881614 ip-10-0-137-93 kubenswrapper[2569]: E0909 02:32:53.881593 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800\": container with ID starting with 19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800 not found: ID does not exist" containerID="19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800" Sep 09 02:32:53.881669 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.881623 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800"} err="failed to get container status \"19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800\": rpc error: code = NotFound desc = could not find container \"19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800\": container with ID starting with 19712349af01a94634cd43e37259e3304a1fdb96785a719ec9a67164c538b800 not found: ID does not exist" Sep 09 02:32:53.892137 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.892109 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5db8899f6d-zkqc2"] Sep 09 02:32:53.893938 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:53.893909 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5db8899f6d-zkqc2"] Sep 09 02:32:54.775684 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:32:54.775647 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8951c94-68f6-4d6c-a1e4-e690d53259b9" path="/var/lib/kubelet/pods/e8951c94-68f6-4d6c-a1e4-e690d53259b9/volumes" Sep 09 02:33:52.078335 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.078295 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:33:52.078741 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.078688 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8951c94-68f6-4d6c-a1e4-e690d53259b9" containerName="console" Sep 09 02:33:52.078741 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.078703 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8951c94-68f6-4d6c-a1e4-e690d53259b9" containerName="console" Sep 09 02:33:52.078813 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.078771 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8951c94-68f6-4d6c-a1e4-e690d53259b9" containerName="console" Sep 09 02:33:52.082023 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.082004 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:33:52.084006 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.083981 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9v59b\"" Sep 09 02:33:52.084179 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.084161 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 02:33:52.084741 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.084725 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 02:33:52.084815 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.084742 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 09 02:33:52.088807 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.088787 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:33:52.115655 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.115627 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:33:52.123433 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.123412 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wnnt\" (UniqueName: \"kubernetes.io/projected/d5c282f3-fce6-43c2-92d6-1900bc4e66bd-kube-api-access-6wnnt\") pod \"limitador-limitador-84994f7ffc-m5x9m\" (UID: \"d5c282f3-fce6-43c2-92d6-1900bc4e66bd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:33:52.123543 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.123465 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5c282f3-fce6-43c2-92d6-1900bc4e66bd-config-file\") pod \"limitador-limitador-84994f7ffc-m5x9m\" (UID: \"d5c282f3-fce6-43c2-92d6-1900bc4e66bd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:33:52.224663 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.224628 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5c282f3-fce6-43c2-92d6-1900bc4e66bd-config-file\") pod \"limitador-limitador-84994f7ffc-m5x9m\" (UID: \"d5c282f3-fce6-43c2-92d6-1900bc4e66bd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:33:52.224845 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.224733 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wnnt\" (UniqueName: \"kubernetes.io/projected/d5c282f3-fce6-43c2-92d6-1900bc4e66bd-kube-api-access-6wnnt\") pod \"limitador-limitador-84994f7ffc-m5x9m\" (UID: \"d5c282f3-fce6-43c2-92d6-1900bc4e66bd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:33:52.225372 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.225324 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5c282f3-fce6-43c2-92d6-1900bc4e66bd-config-file\") pod \"limitador-limitador-84994f7ffc-m5x9m\" (UID: \"d5c282f3-fce6-43c2-92d6-1900bc4e66bd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:33:52.232189 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.232158 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wnnt\" (UniqueName: \"kubernetes.io/projected/d5c282f3-fce6-43c2-92d6-1900bc4e66bd-kube-api-access-6wnnt\") pod \"limitador-limitador-84994f7ffc-m5x9m\" (UID: \"d5c282f3-fce6-43c2-92d6-1900bc4e66bd\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:33:52.392839 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.392750 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:33:52.662606 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:52.662537 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:33:52.665032 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:33:52.665008 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c282f3_fce6_43c2_92d6_1900bc4e66bd.slice/crio-df9671a2fbd6acf0db03f299d3a132569a3498fec2a078a4f1087074760a94bf WatchSource:0}: Error finding container df9671a2fbd6acf0db03f299d3a132569a3498fec2a078a4f1087074760a94bf: Status 404 returned error can't find the container with id df9671a2fbd6acf0db03f299d3a132569a3498fec2a078a4f1087074760a94bf Sep 09 02:33:53.150178 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:53.150123 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" event={"ID":"d5c282f3-fce6-43c2-92d6-1900bc4e66bd","Type":"ContainerStarted","Data":"df9671a2fbd6acf0db03f299d3a132569a3498fec2a078a4f1087074760a94bf"} Sep 09 02:33:55.160578 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:55.160538 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" event={"ID":"d5c282f3-fce6-43c2-92d6-1900bc4e66bd","Type":"ContainerStarted","Data":"8abf9d7098184b784f02123e74270e4898fbe8550ec7f1f40089cfcca5e56214"} Sep 09 02:33:55.161039 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:55.160608 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:33:55.176622 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:33:55.176576 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" podStartSLOduration=1.125348634 podStartE2EDuration="3.176562208s" totalImagesPullingTime="2.051213574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:33:55.174428518 +0000 UTC m=+476.897408932" watchObservedRunningTime="2026-09-09 02:33:55.176562208 +0000 UTC m=+476.899542605" Sep 09 02:34:06.165764 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:34:06.165736 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-m5x9m" Sep 09 02:35:02.683590 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:02.683532 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:35:37.437880 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.437838 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw"] Sep 09 02:35:37.441546 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.441521 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.444502 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.444479 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tp54s\"" Sep 09 02:35:37.444640 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.444502 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 02:35:37.444640 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.444551 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 02:35:37.444640 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.444616 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 09 02:35:37.449694 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.449674 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw"] Sep 09 02:35:37.546607 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.546577 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.546770 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.546624 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn96g\" (UniqueName: \"kubernetes.io/projected/321c40c8-a6ee-48fc-b236-4c5604b91f14-kube-api-access-rn96g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.546770 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.546696 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.546770 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.546725 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.546875 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.546771 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.546875 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.546792 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/321c40c8-a6ee-48fc-b236-4c5604b91f14-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.647262 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.647227 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.647262 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.647263 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.647528 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.647315 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.647528 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.647367 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/321c40c8-a6ee-48fc-b236-4c5604b91f14-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.647528 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.647424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.647528 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.647474 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn96g\" (UniqueName: \"kubernetes.io/projected/321c40c8-a6ee-48fc-b236-4c5604b91f14-kube-api-access-rn96g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.647721 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.647692 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.647773 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.647728 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.647855 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.647836 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.649618 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.649591 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/321c40c8-a6ee-48fc-b236-4c5604b91f14-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.649862 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.649847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/321c40c8-a6ee-48fc-b236-4c5604b91f14-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.654667 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.654648 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn96g\" (UniqueName: \"kubernetes.io/projected/321c40c8-a6ee-48fc-b236-4c5604b91f14-kube-api-access-rn96g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw\" (UID: \"321c40c8-a6ee-48fc-b236-4c5604b91f14\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.752548 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.752514 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:37.847679 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:37.847643 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:35:38.020024 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:38.020000 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw"] Sep 09 02:35:38.022131 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:35:38.022103 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321c40c8_a6ee_48fc_b236_4c5604b91f14.slice/crio-667ac8b2dfbffd8400c76377e4612847a836645307bbae7603d4c645f71557b5 WatchSource:0}: Error finding container 667ac8b2dfbffd8400c76377e4612847a836645307bbae7603d4c645f71557b5: Status 404 returned error can't find the container with id 667ac8b2dfbffd8400c76377e4612847a836645307bbae7603d4c645f71557b5 Sep 09 02:35:38.642682 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:38.642649 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" event={"ID":"321c40c8-a6ee-48fc-b236-4c5604b91f14","Type":"ContainerStarted","Data":"667ac8b2dfbffd8400c76377e4612847a836645307bbae7603d4c645f71557b5"} Sep 09 02:35:39.648777 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:39.648740 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" event={"ID":"321c40c8-a6ee-48fc-b236-4c5604b91f14","Type":"ContainerStarted","Data":"39b14dcb6e5ce87f15c9d5751156275c005189bf8bf66dd184e028a00ea0e4ac"} Sep 09 02:35:39.664580 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:39.664532 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" podStartSLOduration=1.546309068 podStartE2EDuration="2.664515015s" totalImagesPullingTime="1.118205947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:35:39.663012682 +0000 UTC m=+581.385993080" watchObservedRunningTime="2026-09-09 02:35:39.664515015 +0000 UTC m=+581.387495446" Sep 09 02:35:47.753149 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:47.753111 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:47.753708 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:47.753194 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:47.765873 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:47.765849 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:48.699409 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:48.699380 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw" Sep 09 02:35:58.952055 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:58.951940 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/0.log" Sep 09 02:35:58.952055 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:35:58.952012 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/0.log" Sep 09 02:36:08.531404 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:08.531366 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:36:25.430176 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.430076 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt"] Sep 09 02:36:25.433734 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.433707 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.436106 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.436083 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 09 02:36:25.443404 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.443381 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt"] Sep 09 02:36:25.491030 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.490994 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.491030 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.491026 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/892b073f-5a23-48e8-ab4e-376881848af1-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.491226 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.491054 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.491226 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.491163 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.491226 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.491190 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7mf6\" (UniqueName: \"kubernetes.io/projected/892b073f-5a23-48e8-ab4e-376881848af1-kube-api-access-k7mf6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.491368 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.491263 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.592122 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.592080 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.592122 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.592122 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7mf6\" (UniqueName: \"kubernetes.io/projected/892b073f-5a23-48e8-ab4e-376881848af1-kube-api-access-k7mf6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.592420 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.592182 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.592420 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.592226 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.592420 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.592252 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/892b073f-5a23-48e8-ab4e-376881848af1-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.592420 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.592295 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.592659 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.592597 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.592659 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.592610 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.592745 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.592704 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.594514 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.594492 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/892b073f-5a23-48e8-ab4e-376881848af1-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.594678 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.594661 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/892b073f-5a23-48e8-ab4e-376881848af1-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.599604 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.599583 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7mf6\" (UniqueName: \"kubernetes.io/projected/892b073f-5a23-48e8-ab4e-376881848af1-kube-api-access-k7mf6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt\" (UID: \"892b073f-5a23-48e8-ab4e-376881848af1\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:25.745146 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:25.745060 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:26.014859 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:26.014837 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt"] Sep 09 02:36:26.017071 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:36:26.017047 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892b073f_5a23_48e8_ab4e_376881848af1.slice/crio-d06bfb9bde93706b52c5c8e5c0360ae43833a9b2a2ff93d5829919cb0164ae81 WatchSource:0}: Error finding container d06bfb9bde93706b52c5c8e5c0360ae43833a9b2a2ff93d5829919cb0164ae81: Status 404 returned error can't find the container with id d06bfb9bde93706b52c5c8e5c0360ae43833a9b2a2ff93d5829919cb0164ae81 Sep 09 02:36:26.018305 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:26.018289 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 02:36:26.433103 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:26.433016 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:36:26.867277 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:26.867239 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" event={"ID":"892b073f-5a23-48e8-ab4e-376881848af1","Type":"ContainerStarted","Data":"5d929ae2d6ce62db37870fa1bb2d316045114c2ea9b0e52d8eaa38af6c88263c"} Sep 09 02:36:26.867478 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:26.867289 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" event={"ID":"892b073f-5a23-48e8-ab4e-376881848af1","Type":"ContainerStarted","Data":"d06bfb9bde93706b52c5c8e5c0360ae43833a9b2a2ff93d5829919cb0164ae81"} Sep 09 02:36:26.885300 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:26.885248 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" podStartSLOduration=1.697370958 podStartE2EDuration="1.885232782s" totalImagesPullingTime="187.861824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:36:26.883835353 +0000 UTC m=+628.606815752" watchObservedRunningTime="2026-09-09 02:36:26.885232782 +0000 UTC m=+628.608213180" Sep 09 02:36:35.745971 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:35.745931 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:35.746484 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:35.746062 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:35.758583 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:35.758554 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:35.920737 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:35.920706 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt" Sep 09 02:36:39.635777 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:36:39.635743 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:37:07.632282 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:07.632248 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:37:16.038968 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.038933 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj"] Sep 09 02:37:16.042837 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.042816 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.045738 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.045717 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 09 02:37:16.060383 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.060358 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj"] Sep 09 02:37:16.080965 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.080930 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.081113 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.080989 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.081113 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.081029 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.081113 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.081072 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.081113 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.081098 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.081283 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.081121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xjjf\" (UniqueName: \"kubernetes.io/projected/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-kube-api-access-8xjjf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.182320 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.182284 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.182320 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.182326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.182577 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.182385 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.182577 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.182403 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.182577 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.182419 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xjjf\" (UniqueName: \"kubernetes.io/projected/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-kube-api-access-8xjjf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.182577 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.182506 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.182894 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.182873 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.182944 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.182908 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.182998 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.182943 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.184750 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.184733 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.184830 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.184814 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.190025 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.190001 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xjjf\" (UniqueName: \"kubernetes.io/projected/22fd2443-1789-4f76-8fcd-91b1b1b65ff2-kube-api-access-8xjjf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7p2wj\" (UID: \"22fd2443-1789-4f76-8fcd-91b1b1b65ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.354090 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.353985 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:16.630022 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:16.625245 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj"] Sep 09 02:37:16.631464 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:37:16.631435 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22fd2443_1789_4f76_8fcd_91b1b1b65ff2.slice/crio-28982fa772e0f891bf3630a277fe1f100710516a66dae7307491f909c8ab4b2d WatchSource:0}: Error finding container 28982fa772e0f891bf3630a277fe1f100710516a66dae7307491f909c8ab4b2d: Status 404 returned error can't find the container with id 28982fa772e0f891bf3630a277fe1f100710516a66dae7307491f909c8ab4b2d Sep 09 02:37:17.100925 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:17.100880 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" event={"ID":"22fd2443-1789-4f76-8fcd-91b1b1b65ff2","Type":"ContainerStarted","Data":"c149a8fc254af7d5ba9e212be29118b5aaf6d01124a86b9b9a26f7a7a4863a2a"} Sep 09 02:37:17.101286 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:17.100945 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" event={"ID":"22fd2443-1789-4f76-8fcd-91b1b1b65ff2","Type":"ContainerStarted","Data":"28982fa772e0f891bf3630a277fe1f100710516a66dae7307491f909c8ab4b2d"} Sep 09 02:37:17.118817 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:17.118765 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" podStartSLOduration=0.938100668 podStartE2EDuration="1.118747929s" totalImagesPullingTime="180.647261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 02:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:37:17.116699986 +0000 UTC m=+678.839680387" watchObservedRunningTime="2026-09-09 02:37:17.118747929 +0000 UTC m=+678.841728326" Sep 09 02:37:17.734956 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:17.734923 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:37:26.354218 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:26.354181 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:26.354632 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:26.354236 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:26.366626 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:26.366600 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:27.160834 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:27.160805 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7p2wj" Sep 09 02:37:30.634108 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:37:30.634067 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-m5x9m"] Sep 09 02:39:46.617967 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:39:46.617897 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66fb449fdb-g4jzq_ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d/copy-manifests/0.log" Sep 09 02:39:46.624635 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:39:46.624612 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66fb449fdb-g4jzq_ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d/manager/0.log" Sep 09 02:39:48.633088 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:39:48.633053 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-m5x9m_d5c282f3-fce6-43c2-92d6-1900bc4e66bd/limitador/0.log" Sep 09 02:39:49.312918 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:39:49.312885 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nbj8n_2800f7fe-1660-446c-a5f6-dc2066bba88d/discovery/0.log" Sep 09 02:39:50.477305 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:39:50.477278 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-72zmw_321c40c8-a6ee-48fc-b236-4c5604b91f14/main/0.log" Sep 09 02:39:50.724705 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:39:50.724678 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-c4kxt_892b073f-5a23-48e8-ab4e-376881848af1/main/0.log" Sep 09 02:39:51.137165 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:39:51.137128 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7p2wj_22fd2443-1789-4f76-8fcd-91b1b1b65ff2/main/0.log" Sep 09 02:40:00.480292 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:00.480257 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kbfm9_9c76f9c4-ed70-493b-b740-8d39b521b632/global-pull-secret-syncer/0.log" Sep 09 02:40:00.632625 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:00.632592 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xfhtn_e63eaf31-cde7-4a3a-8860-052cfee574c8/konnectivity-agent/0.log" Sep 09 02:40:00.711800 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:00.711769 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-93.ec2.internal_576b87c7ce5e7cfdcb6002e50599d6cf/haproxy/0.log" Sep 09 02:40:04.163546 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:04.163509 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-m5x9m_d5c282f3-fce6-43c2-92d6-1900bc4e66bd/limitador/0.log" Sep 09 02:40:06.547562 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.547531 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69cb466e-d550-4aa4-a781-8a3a8488e792/alertmanager/0.log" Sep 09 02:40:06.584747 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.584718 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69cb466e-d550-4aa4-a781-8a3a8488e792/config-reloader/0.log" Sep 09 02:40:06.609742 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.609714 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69cb466e-d550-4aa4-a781-8a3a8488e792/kube-rbac-proxy-web/0.log" Sep 09 02:40:06.630617 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.630589 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69cb466e-d550-4aa4-a781-8a3a8488e792/kube-rbac-proxy/0.log" Sep 09 02:40:06.653746 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.653671 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69cb466e-d550-4aa4-a781-8a3a8488e792/kube-rbac-proxy-metric/0.log" Sep 09 02:40:06.675752 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.675716 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69cb466e-d550-4aa4-a781-8a3a8488e792/prom-label-proxy/0.log" Sep 09 02:40:06.699510 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.699483 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69cb466e-d550-4aa4-a781-8a3a8488e792/init-config-reloader/0.log" Sep 09 02:40:06.806945 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.806915 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pjr8m_f70864e9-7a9e-41d0-8035-43f133aadfce/kube-state-metrics/0.log" Sep 09 02:40:06.822011 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.821986 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pjr8m_f70864e9-7a9e-41d0-8035-43f133aadfce/kube-rbac-proxy-main/0.log" Sep 09 02:40:06.844152 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.844125 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-pjr8m_f70864e9-7a9e-41d0-8035-43f133aadfce/kube-rbac-proxy-self/0.log" Sep 09 02:40:06.869871 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.869841 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-bc56664f4-qzlfn_9669f086-f924-4e4b-b613-8e6817a03690/metrics-server/0.log" Sep 09 02:40:06.907027 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:06.906948 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-j8vt4_180dfcee-9d88-46c6-96b9-5f25d32e9d38/monitoring-plugin/0.log" Sep 09 02:40:07.036045 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.036019 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h4jj2_4d8ac876-7b02-4726-af92-b4400a61c596/node-exporter/0.log" Sep 09 02:40:07.054789 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.054767 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h4jj2_4d8ac876-7b02-4726-af92-b4400a61c596/kube-rbac-proxy/0.log" Sep 09 02:40:07.074129 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.074105 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h4jj2_4d8ac876-7b02-4726-af92-b4400a61c596/init-textfile/0.log" Sep 09 02:40:07.162638 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.162557 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-bg8cf_9256fb8a-159d-4dc4-b8f6-7690b7c79dbe/kube-rbac-proxy-main/0.log" Sep 09 02:40:07.183126 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.183097 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-bg8cf_9256fb8a-159d-4dc4-b8f6-7690b7c79dbe/kube-rbac-proxy-self/0.log" Sep 09 02:40:07.202780 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.202750 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-bg8cf_9256fb8a-159d-4dc4-b8f6-7690b7c79dbe/openshift-state-metrics/0.log" Sep 09 02:40:07.254187 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.254158 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6ec0eba-b018-4618-8a65-8756243af9e7/prometheus/0.log" Sep 09 02:40:07.272927 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.272898 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6ec0eba-b018-4618-8a65-8756243af9e7/config-reloader/0.log" Sep 09 02:40:07.293058 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.293032 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6ec0eba-b018-4618-8a65-8756243af9e7/thanos-sidecar/0.log" Sep 09 02:40:07.313659 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.313637 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6ec0eba-b018-4618-8a65-8756243af9e7/kube-rbac-proxy-web/0.log" Sep 09 02:40:07.333936 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.333894 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6ec0eba-b018-4618-8a65-8756243af9e7/kube-rbac-proxy/0.log" Sep 09 02:40:07.356052 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.356019 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6ec0eba-b018-4618-8a65-8756243af9e7/kube-rbac-proxy-thanos/0.log" Sep 09 02:40:07.375004 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.374980 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6ec0eba-b018-4618-8a65-8756243af9e7/init-config-reloader/0.log" Sep 09 02:40:07.477948 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.477815 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75d57fc448-8ddwf_f653ebcf-cb48-4339-9ac8-7048fa11639d/telemeter-client/0.log" Sep 09 02:40:07.500914 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.500885 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75d57fc448-8ddwf_f653ebcf-cb48-4339-9ac8-7048fa11639d/reload/0.log" Sep 09 02:40:07.526812 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.526780 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75d57fc448-8ddwf_f653ebcf-cb48-4339-9ac8-7048fa11639d/kube-rbac-proxy/0.log" Sep 09 02:40:07.566541 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.566499 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65b7944d4b-xx6xm_a81a18a0-1a32-490d-9ce8-f795cfadda14/thanos-query/0.log" Sep 09 02:40:07.584529 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.584503 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65b7944d4b-xx6xm_a81a18a0-1a32-490d-9ce8-f795cfadda14/kube-rbac-proxy-web/0.log" Sep 09 02:40:07.604123 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.604097 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65b7944d4b-xx6xm_a81a18a0-1a32-490d-9ce8-f795cfadda14/kube-rbac-proxy/0.log" Sep 09 02:40:07.627703 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.627675 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65b7944d4b-xx6xm_a81a18a0-1a32-490d-9ce8-f795cfadda14/prom-label-proxy/0.log" Sep 09 02:40:07.648738 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.648712 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65b7944d4b-xx6xm_a81a18a0-1a32-490d-9ce8-f795cfadda14/kube-rbac-proxy-rules/0.log" Sep 09 02:40:07.674926 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:07.674900 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65b7944d4b-xx6xm_a81a18a0-1a32-490d-9ce8-f795cfadda14/kube-rbac-proxy-metrics/0.log" Sep 09 02:40:10.656785 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:10.656753 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b9dbfd5-kvrfh_65d320f6-c857-4718-849f-56e1b942660a/console/0.log" Sep 09 02:40:11.240991 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.240956 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5"] Sep 09 02:40:11.244579 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.244557 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.246870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.246849 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b28xp\"/\"kube-root-ca.crt\"" Sep 09 02:40:11.247555 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.247530 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b28xp\"/\"openshift-service-ca.crt\"" Sep 09 02:40:11.247555 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.247530 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b28xp\"/\"default-dockercfg-7crwr\"" Sep 09 02:40:11.250855 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.250833 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5"] Sep 09 02:40:11.335642 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.335607 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-sys\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.335795 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.335649 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6h6\" (UniqueName: \"kubernetes.io/projected/907d2d10-9d4f-4f0f-98a6-39bf34612996-kube-api-access-jq6h6\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.335795 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.335671 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-proc\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.335795 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.335694 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-podres\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.335918 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.335794 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-lib-modules\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.436809 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.436771 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-sys\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.436809 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.436814 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6h6\" (UniqueName: \"kubernetes.io/projected/907d2d10-9d4f-4f0f-98a6-39bf34612996-kube-api-access-jq6h6\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.437031 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.436832 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-proc\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.437031 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.436848 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-podres\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.437031 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.436911 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-lib-modules\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.437031 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.436918 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-proc\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.437031 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.436906 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-sys\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.437031 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.437012 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-podres\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.437259 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.437059 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/907d2d10-9d4f-4f0f-98a6-39bf34612996-lib-modules\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.444229 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.444199 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6h6\" (UniqueName: \"kubernetes.io/projected/907d2d10-9d4f-4f0f-98a6-39bf34612996-kube-api-access-jq6h6\") pod \"perf-node-gather-daemonset-b6wv5\" (UID: \"907d2d10-9d4f-4f0f-98a6-39bf34612996\") " pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.555718 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.555684 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:11.824371 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.824330 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5"] Sep 09 02:40:11.827078 ip-10-0-137-93 kubenswrapper[2569]: W0909 02:40:11.827051 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod907d2d10_9d4f_4f0f_98a6_39bf34612996.slice/crio-864cac97fe91d9eaada20cb806a1b45eadb24a92b212742fb8f863b9b9dc436f WatchSource:0}: Error finding container 864cac97fe91d9eaada20cb806a1b45eadb24a92b212742fb8f863b9b9dc436f: Status 404 returned error can't find the container with id 864cac97fe91d9eaada20cb806a1b45eadb24a92b212742fb8f863b9b9dc436f Sep 09 02:40:11.941722 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:11.941685 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" event={"ID":"907d2d10-9d4f-4f0f-98a6-39bf34612996","Type":"ContainerStarted","Data":"864cac97fe91d9eaada20cb806a1b45eadb24a92b212742fb8f863b9b9dc436f"} Sep 09 02:40:12.479385 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:12.479327 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4795s_6bff2849-12db-42e5-9c99-89d7669e3e24/dns/0.log" Sep 09 02:40:12.501226 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:12.500809 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4795s_6bff2849-12db-42e5-9c99-89d7669e3e24/kube-rbac-proxy/0.log" Sep 09 02:40:12.611576 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:12.611543 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kc97x_448e25db-e22b-482b-9fa8-b81898d97a32/dns-node-resolver/0.log" Sep 09 02:40:12.947934 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:12.947904 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" event={"ID":"907d2d10-9d4f-4f0f-98a6-39bf34612996","Type":"ContainerStarted","Data":"021e88110c24baa7971c215ce42a8b86a84b2c2825fc7ae876ecaafa1db2ecea"} Sep 09 02:40:12.948304 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:12.947983 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:12.965050 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:12.965001 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" podStartSLOduration=1.964986658 podStartE2EDuration="1.964986658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 02:40:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 02:40:12.963221626 +0000 UTC m=+854.686202025" watchObservedRunningTime="2026-09-09 02:40:12.964986658 +0000 UTC m=+854.687967055" Sep 09 02:40:13.180280 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:13.180252 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mcbbx_8fad9731-782f-46cb-a223-117f6b98abba/node-ca/0.log" Sep 09 02:40:14.183163 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:14.183133 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nbj8n_2800f7fe-1660-446c-a5f6-dc2066bba88d/discovery/0.log" Sep 09 02:40:14.962947 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:14.962918 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cmpsd_865b61c5-2aac-4242-8306-8349db3bbeda/serve-healthcheck-canary/0.log" Sep 09 02:40:15.456236 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:15.456206 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7n792_638aa984-cf3f-4a3a-8d2d-96ead519d1f2/kube-rbac-proxy/0.log" Sep 09 02:40:15.475757 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:15.475732 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7n792_638aa984-cf3f-4a3a-8d2d-96ead519d1f2/exporter/0.log" Sep 09 02:40:15.496663 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:15.496633 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7n792_638aa984-cf3f-4a3a-8d2d-96ead519d1f2/extractor/0.log" Sep 09 02:40:18.002945 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:18.002914 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66fb449fdb-g4jzq_ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d/manager/0.log" Sep 09 02:40:18.022096 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:18.022062 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66fb449fdb-g4jzq_ebf9dc5e-0112-4dc8-bdc2-15148dab6d9d/copy-manifests/0.log" Sep 09 02:40:18.963096 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:18.963068 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b28xp/perf-node-gather-daemonset-b6wv5" Sep 09 02:40:19.156713 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:19.156682 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cf499d5f9-vdqr5_2d37ef7c-1f8c-49c3-b114-d9c63221d567/manager/0.log" Sep 09 02:40:19.181209 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:19.181178 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vkmxx_947d7782-7d6d-41da-a124-da6af6028dd0/openshift-lws-operator/0.log" Sep 09 02:40:21.243203 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:21.243165 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nbj8n_2800f7fe-1660-446c-a5f6-dc2066bba88d/discovery/0.log" Sep 09 02:40:22.845700 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:22.845602 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nbj8n_2800f7fe-1660-446c-a5f6-dc2066bba88d/discovery/0.log" Sep 09 02:40:25.920532 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:25.920502 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6qvsx_0e42ce9b-1ffa-4e30-9a17-dc9b16abcc28/kube-multus/0.log" Sep 09 02:40:26.314928 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:26.314894 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmccn_2786b854-1597-4011-953d-901c9a9f3ac0/kube-multus-additional-cni-plugins/0.log" Sep 09 02:40:26.343191 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:26.343164 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmccn_2786b854-1597-4011-953d-901c9a9f3ac0/egress-router-binary-copy/0.log" Sep 09 02:40:26.366631 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:26.366606 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmccn_2786b854-1597-4011-953d-901c9a9f3ac0/cni-plugins/0.log" Sep 09 02:40:26.385536 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:26.385512 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmccn_2786b854-1597-4011-953d-901c9a9f3ac0/bond-cni-plugin/0.log" Sep 09 02:40:26.403870 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:26.403839 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmccn_2786b854-1597-4011-953d-901c9a9f3ac0/routeoverride-cni/0.log" Sep 09 02:40:26.423943 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:26.423918 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmccn_2786b854-1597-4011-953d-901c9a9f3ac0/whereabouts-cni-bincopy/0.log" Sep 09 02:40:26.441815 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:26.441790 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmccn_2786b854-1597-4011-953d-901c9a9f3ac0/whereabouts-cni/0.log" Sep 09 02:40:26.499159 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:26.499127 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2x72t_b35c6a8a-f317-44f5-beab-f0c46fd31ee5/network-metrics-daemon/0.log" Sep 09 02:40:26.516547 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:26.516520 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2x72t_b35c6a8a-f317-44f5-beab-f0c46fd31ee5/kube-rbac-proxy/0.log" Sep 09 02:40:27.597774 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:27.597744 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-controller/0.log" Sep 09 02:40:27.611989 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:27.611967 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/0.log" Sep 09 02:40:27.612147 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:27.611969 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovn-acl-logging/1.log" Sep 09 02:40:27.628551 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:27.628523 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/kube-rbac-proxy-node/0.log" Sep 09 02:40:27.648719 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:27.648681 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 02:40:27.665126 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:27.665097 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/northd/0.log" Sep 09 02:40:27.683467 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:27.683442 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/nbdb/0.log" Sep 09 02:40:27.701890 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:27.701862 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/sbdb/0.log" Sep 09 02:40:27.753773 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:27.753728 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvxwv_9424a69c-24c6-46e6-9912-93ec9e2f66dc/ovnkube-controller/0.log" Sep 09 02:40:29.131497 ip-10-0-137-93 kubenswrapper[2569]: I0909 02:40:29.131467 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hfwfs_ace583ca-20c8-40bf-a3fa-aec1bf334eeb/network-check-target-container/0.log"