2026-10-31T02:12:56.264006296Z [disk usage checker] Started 2026-10-31T02:12:56.267724787Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:12:56.661580827Z Detected Kubernetes distribution: ocp 2026-10-31T02:12:56.661943173Z ========================================== 2026-10-31T02:12:56.661951843Z DEBUG: OpenShift detected. Running RHOAI-specific collection... 2026-10-31T02:12:56.661951843Z DEBUG: Using KUBECTL=oc 2026-10-31T02:12:56.661958890Z ========================================== 2026-10-31T02:12:57.330840175Z Error from server (NotFound): deployments.apps "rhods-operator" not found 2026-10-31T02:12:57.781580539Z Gathering data for ns/openshift-operators... 2026-10-31T02:12:58.657982847Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:12:59.181446987Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:12:59.614589568Z Wrote inspect data to must-gather. 2026-10-31T02:13:00.064097302Z Gathering data for ns/opendatahub... 2026-10-31T02:13:01.273136108Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:04.596336857Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:13:05.315730494Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:13:05.826795359Z Wrote inspect data to must-gather. 2026-10-31T02:13:06.278820235Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:06.278820235Z Gathering data for ns/opendatahub... 2026-10-31T02:13:11.295083792Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:12.741403537Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:13:13.523812454Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:13:14.131545822Z Wrote inspect data to must-gather. 2026-10-31T02:13:14.643360111Z Gathering data for ns/opendatahub... 2026-10-31T02:13:16.304009734Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:19.602121804Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:13:20.313171956Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:13:20.865833097Z Wrote inspect data to must-gather. 2026-10-31T02:13:21.309663784Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:21.348356298Z Wrote inspect data to must-gather. 2026-10-31T02:13:21.348398637Z error: inspection completed with the errors occurred while gathering data: 2026-10-31T02:13:21.348398637Z namespaces "rhoai-model-registries" not found 2026-10-31T02:13:21.352226389Z Error getting logs from rhoai-model-registries 2026-10-31T02:13:21.781205956Z Gathering data for ns/openshift-ingress... 2026-10-31T02:13:25.285143453Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:13:26.315162248Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:27.160752381Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:13:28.256709745Z Wrote inspect data to must-gather. 2026-10-31T02:13:28.750588081Z Gathering data for ns/kuadrant-system... 2026-10-31T02:13:31.320479199Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:32.468461198Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:13:33.163586199Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:13:34.194346255Z Wrote inspect data to must-gather. 2026-10-31T02:13:35.224366819Z Wrote inspect data to must-gather. 2026-10-31T02:13:35.224418063Z error: inspection completed with the errors occurred while gathering data: 2026-10-31T02:13:35.224418063Z namespaces "rhai-gitops" not found 2026-10-31T02:13:35.229453155Z Error getting logs from rhai-gitops 2026-10-31T02:13:35.229453155Z Collecting Helm release information... 2026-10-31T02:13:36.244460154Z Wrote inspect data to must-gather. 2026-10-31T02:13:36.325433240Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:37.313990818Z Wrote inspect data to must-gather. 2026-10-31T02:13:38.434491071Z Wrote inspect data to must-gather. 2026-10-31T02:13:38.767893739Z error: the server doesn't have a resource type "monitorings" 2026-10-31T02:13:38.771487798Z Error collecting monitorings.services.platform.opendatahub.io 2026-10-31T02:13:39.928269858Z Wrote inspect data to must-gather. 2026-10-31T02:13:41.051617816Z Wrote inspect data to must-gather. 2026-10-31T02:13:41.330514182Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:41.385392990Z error: the server doesn't have a resource type "dashboards" 2026-10-31T02:13:41.389344204Z Error collecting dashboards.components.platform.opendatahub.io 2026-10-31T02:13:41.719705616Z error: the server doesn't have a resource type "datasciencepipelines" 2026-10-31T02:13:41.723402900Z Error collecting datasciencepipelines.components.platform.opendatahub.io 2026-10-31T02:13:42.055881555Z error: the server doesn't have a resource type "feastoperators" 2026-10-31T02:13:42.059627518Z Error collecting feastoperators.components.platform.opendatahub.io 2026-10-31T02:13:43.281679541Z Wrote inspect data to must-gather. 2026-10-31T02:13:43.643435256Z error: the server doesn't have a resource type "modelcontrollers" 2026-10-31T02:13:43.647099382Z Error collecting modelcontrollers.components.platform.opendatahub.io 2026-10-31T02:13:43.972510223Z error: the server doesn't have a resource type "modelregistries" 2026-10-31T02:13:43.976306720Z Error collecting modelregistries.components.platform.opendatahub.io 2026-10-31T02:13:44.315707534Z error: the server doesn't have a resource type "rays" 2026-10-31T02:13:44.320646129Z Error collecting rays.components.platform.opendatahub.io 2026-10-31T02:13:44.658721342Z error: the server doesn't have a resource type "trainingoperators" 2026-10-31T02:13:44.665301036Z Error collecting trainingoperators.components.platform.opendatahub.io 2026-10-31T02:13:44.996004184Z error: the server doesn't have a resource type "trustyais" 2026-10-31T02:13:44.999541462Z Error collecting trustyais.components.platform.opendatahub.io 2026-10-31T02:13:45.353371926Z error: the server doesn't have a resource type "workbenches" 2026-10-31T02:13:45.356797424Z Error collecting workbenches.components.platform.opendatahub.io 2026-10-31T02:13:45.680691391Z error: the server doesn't have a resource type "llamastackoperators" 2026-10-31T02:13:45.684265463Z Error collecting llamastackoperators.components.platform.opendatahub.io 2026-10-31T02:13:46.035162205Z error: the server doesn't have a resource type "mlflowoperators" 2026-10-31T02:13:46.039035114Z Error collecting mlflowoperators.components.platform.opendatahub.io 2026-10-31T02:13:46.336101809Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:46.761502433Z Gathering data for ns/cert-manager... 2026-10-31T02:13:48.256559724Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:13:48.955542795Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:13:49.457843145Z Gathering data for ns/opendatahub-operator-system... 2026-10-31T02:13:51.341179513Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:52.752041119Z Gathering data for ns/opendatahub... 2026-10-31T02:13:56.346051717Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:13:58.104586555Z Gathering data for ns/openshift-ingress... 2026-10-31T02:14:01.350950857Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:03.594691770Z Gathering data for ns/openshift-jobset-operator... 2026-10-31T02:14:06.355913879Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:06.466382446Z Wrote inspect data to must-gather. 2026-10-31T02:14:06.813768972Z error: the server doesn't have a resource type "validationwebhookconfigurations" 2026-10-31T02:14:06.820082919Z Error collecting validationwebhookconfigurations.admissionregistration.k8s.io 2026-10-31T02:14:07.984518778Z Wrote inspect data to must-gather. 2026-10-31T02:14:09.179478440Z Wrote inspect data to must-gather. 2026-10-31T02:14:10.333190200Z Wrote inspect data to must-gather. 2026-10-31T02:14:10.697901674Z error: the server doesn't have a resource type "trainers" 2026-10-31T02:14:10.702255311Z Error collecting trainers.components.platform.opendatahub.io 2026-10-31T02:14:11.103713149Z error: the server doesn't have a resource type "sparkoperators" 2026-10-31T02:14:11.107375138Z Error collecting sparkoperators.components.platform.opendatahub.io 2026-10-31T02:14:11.360969772Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:16.365889788Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:21.202833780Z E1031 02:14:21.202775 530 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://172.31.0.1:443/api?timeout=32s\": net/http: TLS handshake timeout" 2026-10-31T02:14:21.373144421Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:21.431488247Z error: the server doesn't have a resource type "aigateways" 2026-10-31T02:14:21.436240567Z Error collecting aigateways.components.platform.opendatahub.io 2026-10-31T02:14:21.777552632Z error: the server doesn't have a resource type "mcplifecycleoperators" 2026-10-31T02:14:21.784302489Z Error collecting mcplifecycleoperators.components.platform.opendatahub.io 2026-10-31T02:14:21.784530417Z ========================================== 2026-10-31T02:14:21.784569039Z DEBUG: Component=aigateway 2026-10-31T02:14:21.784595930Z ========================================== 2026-10-31T02:14:26.150219879Z error: the server doesn't have a resource type "llmbatchgateways" 2026-10-31T02:14:26.379607270Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:31.394076755Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:36.246796631Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-31T02:14:36.251461345Z Error inspecting namespace/ai-tenants 2026-10-31T02:14:36.399525841Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:37.480534181Z Wrote inspect data to must-gather. 2026-10-31T02:14:38.610927419Z Wrote inspect data to must-gather. 2026-10-31T02:14:39.878848049Z Wrote inspect data to must-gather. 2026-10-31T02:14:41.030741303Z Wrote inspect data to must-gather. 2026-10-31T02:14:41.404591379Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:42.129361956Z Wrote inspect data to must-gather. 2026-10-31T02:14:43.158878889Z Wrote inspect data to must-gather. 2026-10-31T02:14:44.503125084Z Wrote inspect data to must-gather. 2026-10-31T02:14:45.690802996Z Wrote inspect data to must-gather. 2026-10-31T02:14:46.409536953Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:46.883654515Z Wrote inspect data to must-gather. 2026-10-31T02:14:48.151063483Z Wrote inspect data to must-gather. 2026-10-31T02:14:49.474429440Z Wrote inspect data to must-gather. 2026-10-31T02:14:51.414454170Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:14:56.419246763Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:00.667447496Z Wrote inspect data to must-gather. 2026-10-31T02:15:01.424082764Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:01.834105941Z Wrote inspect data to must-gather. 2026-10-31T02:15:03.001508398Z Wrote inspect data to must-gather. 2026-10-31T02:15:04.186201402Z Wrote inspect data to must-gather. 2026-10-31T02:15:05.350034341Z Wrote inspect data to must-gather. 2026-10-31T02:15:06.428991922Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:11.434298658Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:15.764586077Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-31T02:15:15.768137395Z Error inspecting namespace/models-as-a-service 2026-10-31T02:15:16.439584454Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:16.941853100Z Wrote inspect data to must-gather. 2026-10-31T02:15:18.079028930Z Wrote inspect data to must-gather. 2026-10-31T02:15:19.202116353Z Wrote inspect data to must-gather. 2026-10-31T02:15:20.341162617Z Wrote inspect data to must-gather. 2026-10-31T02:15:21.444493830Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:26.449345863Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:31.429880632Z Wrote inspect data to must-gather. 2026-10-31T02:15:31.454720204Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:32.601781444Z Wrote inspect data to must-gather. 2026-10-31T02:15:33.740283250Z Wrote inspect data to must-gather. 2026-10-31T02:15:34.882382618Z Wrote inspect data to must-gather. 2026-10-31T02:15:36.093379523Z Wrote inspect data to must-gather. 2026-10-31T02:15:36.459649379Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:41.464545738Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:46.469382655Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:47.269168337Z Wrote inspect data to must-gather. 2026-10-31T02:15:48.442548764Z Wrote inspect data to must-gather. 2026-10-31T02:15:49.605212940Z Wrote inspect data to must-gather. 2026-10-31T02:15:51.474227839Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:15:56.479286509Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:00.759882832Z Wrote inspect data to must-gather. 2026-10-31T02:16:01.484178178Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:01.950653860Z Wrote inspect data to must-gather. 2026-10-31T02:16:06.489117889Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:11.494002858Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:13.224226393Z Wrote inspect data to must-gather. 2026-10-31T02:16:13.951458256Z Gathering data for ns/models-as-a-service... 2026-10-31T02:16:14.844942709Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:16:15.576238000Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:16:16.504289828Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:16.750692618Z Wrote inspect data to must-gather. 2026-10-31T02:16:18.000546972Z Wrote inspect data to must-gather. 2026-10-31T02:16:19.173415691Z Wrote inspect data to must-gather. 2026-10-31T02:16:20.330661378Z Wrote inspect data to must-gather. 2026-10-31T02:16:21.466602823Z Wrote inspect data to must-gather. 2026-10-31T02:16:21.509219918Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:22.469597830Z Wrote inspect data to must-gather. 2026-10-31T02:16:23.493368142Z Wrote inspect data to must-gather. 2026-10-31T02:16:26.514062206Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:31.519082633Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:34.633514110Z Wrote inspect data to must-gather. 2026-10-31T02:16:35.775353994Z Wrote inspect data to must-gather. 2026-10-31T02:16:36.523962890Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:36.905300800Z Wrote inspect data to must-gather. 2026-10-31T02:16:38.063478610Z Wrote inspect data to must-gather. 2026-10-31T02:16:39.275991083Z Wrote inspect data to must-gather. 2026-10-31T02:16:40.488377244Z Wrote inspect data to must-gather. 2026-10-31T02:16:41.528773370Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:41.682915347Z Wrote inspect data to must-gather. 2026-10-31T02:16:42.838699008Z Wrote inspect data to must-gather. 2026-10-31T02:16:43.997573547Z Wrote inspect data to must-gather. 2026-10-31T02:16:46.533670226Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:51.538520545Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:55.187295664Z Wrote inspect data to must-gather. 2026-10-31T02:16:55.912549700Z Gathering data for ns/e2e-models-e2e-worker-w1-baacee... 2026-10-31T02:16:56.543435582Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:16:56.787997824Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:16:57.333448512Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:16:58.380276036Z Wrote inspect data to must-gather. 2026-10-31T02:16:59.564392992Z Wrote inspect data to must-gather. 2026-10-31T02:17:00.705865699Z Wrote inspect data to must-gather. 2026-10-31T02:17:01.548285782Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:01.855541321Z Wrote inspect data to must-gather. 2026-10-31T02:17:02.997841514Z Wrote inspect data to must-gather. 2026-10-31T02:17:04.008600316Z Wrote inspect data to must-gather. 2026-10-31T02:17:05.035513224Z Wrote inspect data to must-gather. 2026-10-31T02:17:06.175878108Z Wrote inspect data to must-gather. 2026-10-31T02:17:06.553170304Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:07.327133276Z Wrote inspect data to must-gather. 2026-10-31T02:17:08.467438270Z Wrote inspect data to must-gather. 2026-10-31T02:17:09.587710591Z Wrote inspect data to must-gather. 2026-10-31T02:17:10.734628094Z Wrote inspect data to must-gather. 2026-10-31T02:17:11.558021675Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:11.868168735Z Wrote inspect data to must-gather. 2026-10-31T02:17:13.006963896Z Wrote inspect data to must-gather. 2026-10-31T02:17:14.152449000Z Wrote inspect data to must-gather. 2026-10-31T02:17:15.273703707Z Wrote inspect data to must-gather. 2026-10-31T02:17:16.562846565Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:21.567697276Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:26.398703373Z Wrote inspect data to must-gather. 2026-10-31T02:17:26.572583806Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:27.113434223Z Gathering data for ns/e2e-models-e2e-worker-w1-baacee... 2026-10-31T02:17:27.984531145Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:17:28.507285042Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:17:29.538254528Z Wrote inspect data to must-gather. 2026-10-31T02:17:30.708413239Z Wrote inspect data to must-gather. 2026-10-31T02:17:31.578190955Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:31.849291456Z Wrote inspect data to must-gather. 2026-10-31T02:17:32.990916076Z Wrote inspect data to must-gather. 2026-10-31T02:17:36.583113357Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:41.588174457Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:44.143998826Z Wrote inspect data to must-gather. 2026-10-31T02:17:45.163376928Z Wrote inspect data to must-gather. 2026-10-31T02:17:46.169479652Z Wrote inspect data to must-gather. 2026-10-31T02:17:46.593237071Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:47.304155994Z Wrote inspect data to must-gather. 2026-10-31T02:17:51.598095982Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:17:56.603191353Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:01.608102596Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:06.613011267Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:11.618919745Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:16.623923320Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:18.812643592Z Wrote inspect data to must-gather. 2026-10-31T02:18:19.934025510Z Wrote inspect data to must-gather. 2026-10-31T02:18:21.056049242Z Wrote inspect data to must-gather. 2026-10-31T02:18:21.629294515Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:22.181241345Z Wrote inspect data to must-gather. 2026-10-31T02:18:23.304575139Z Wrote inspect data to must-gather. 2026-10-31T02:18:24.425843118Z Wrote inspect data to must-gather. 2026-10-31T02:18:25.534932410Z Wrote inspect data to must-gather. 2026-10-31T02:18:26.634547851Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:26.648496284Z Wrote inspect data to must-gather. 2026-10-31T02:18:27.371163579Z Gathering data for ns/e2e-models-e2e-worker-w1-baacee... 2026-10-31T02:18:28.239949535Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:18:28.765758321Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:18:29.791009824Z Wrote inspect data to must-gather. 2026-10-31T02:18:30.965537737Z Wrote inspect data to must-gather. 2026-10-31T02:18:31.639443155Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:32.075952564Z Wrote inspect data to must-gather. 2026-10-31T02:18:33.192501920Z Wrote inspect data to must-gather. 2026-10-31T02:18:36.644299157Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:41.649113695Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:44.311343994Z Wrote inspect data to must-gather. 2026-10-31T02:18:45.306756235Z Wrote inspect data to must-gather. 2026-10-31T02:18:46.294181510Z Wrote inspect data to must-gather. 2026-10-31T02:18:46.653955377Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:47.409346017Z Wrote inspect data to must-gather. 2026-10-31T02:18:48.523309129Z Wrote inspect data to must-gather. 2026-10-31T02:18:49.645902464Z Wrote inspect data to must-gather. 2026-10-31T02:18:50.765547063Z Wrote inspect data to must-gather. 2026-10-31T02:18:51.658892861Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:18:51.897855609Z Wrote inspect data to must-gather. 2026-10-31T02:18:53.028814881Z Wrote inspect data to must-gather. 2026-10-31T02:18:56.663665184Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:01.668254317Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:04.163691162Z Wrote inspect data to must-gather. 2026-10-31T02:19:05.294783415Z Wrote inspect data to must-gather. 2026-10-31T02:19:06.410634693Z Wrote inspect data to must-gather. 2026-10-31T02:19:06.672969168Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:07.534438008Z Wrote inspect data to must-gather. 2026-10-31T02:19:08.245874283Z Gathering data for ns/e2e-models-e2e-worker-w1-baacee... 2026-10-31T02:19:09.120973637Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:19:09.647767268Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:19:10.680021704Z Wrote inspect data to must-gather. 2026-10-31T02:19:11.677647716Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:11.854307558Z Wrote inspect data to must-gather. 2026-10-31T02:19:12.971167362Z Wrote inspect data to must-gather. 2026-10-31T02:19:14.106293742Z Wrote inspect data to must-gather. 2026-10-31T02:19:15.222113196Z Wrote inspect data to must-gather. 2026-10-31T02:19:16.205232698Z Wrote inspect data to must-gather. 2026-10-31T02:19:16.682433087Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:17.199997270Z Wrote inspect data to must-gather. 2026-10-31T02:19:18.319285607Z Wrote inspect data to must-gather. 2026-10-31T02:19:19.443892275Z Wrote inspect data to must-gather. 2026-10-31T02:19:20.560977730Z Wrote inspect data to must-gather. 2026-10-31T02:19:21.678464227Z Wrote inspect data to must-gather. 2026-10-31T02:19:21.687902942Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:22.816287612Z Wrote inspect data to must-gather. 2026-10-31T02:19:23.944999803Z Wrote inspect data to must-gather. 2026-10-31T02:19:26.692823872Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:31.697742939Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:35.093421952Z Wrote inspect data to must-gather. 2026-10-31T02:19:36.242061926Z Wrote inspect data to must-gather. 2026-10-31T02:19:36.703039319Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:37.370469424Z Wrote inspect data to must-gather. 2026-10-31T02:19:38.512202089Z Wrote inspect data to must-gather. 2026-10-31T02:19:39.230947249Z Gathering data for ns/e2e-models-e2e-worker-w2-00e840... 2026-10-31T02:19:40.100614681Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:19:40.625277389Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:19:41.683729281Z Wrote inspect data to must-gather. 2026-10-31T02:19:41.708095376Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:42.875202244Z Wrote inspect data to must-gather. 2026-10-31T02:19:44.013665644Z Wrote inspect data to must-gather. 2026-10-31T02:19:45.148391328Z Wrote inspect data to must-gather. 2026-10-31T02:19:46.279662383Z Wrote inspect data to must-gather. 2026-10-31T02:19:46.713564977Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:47.289258922Z Wrote inspect data to must-gather. 2026-10-31T02:19:51.718348674Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:56.723460000Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:19:58.517411698Z Wrote inspect data to must-gather. 2026-10-31T02:19:59.655112942Z Wrote inspect data to must-gather. 2026-10-31T02:20:00.786776930Z Wrote inspect data to must-gather. 2026-10-31T02:20:01.728378086Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:01.931475261Z Wrote inspect data to must-gather. 2026-10-31T02:20:03.216817682Z Wrote inspect data to must-gather. 2026-10-31T02:20:04.357051357Z Wrote inspect data to must-gather. 2026-10-31T02:20:05.487250382Z Wrote inspect data to must-gather. 2026-10-31T02:20:06.622951516Z Wrote inspect data to must-gather. 2026-10-31T02:20:06.733258461Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:07.758971839Z Wrote inspect data to must-gather. 2026-10-31T02:20:08.889424601Z Wrote inspect data to must-gather. 2026-10-31T02:20:09.604977028Z Gathering data for ns/e2e-models-e2e-worker-w2-00e840... 2026-10-31T02:20:10.477161890Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:20:11.000748332Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:20:11.738150360Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:12.041360120Z Wrote inspect data to must-gather. 2026-10-31T02:20:16.743162530Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:21.748097267Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:23.172356964Z Wrote inspect data to must-gather. 2026-10-31T02:20:24.315226118Z Wrote inspect data to must-gather. 2026-10-31T02:20:25.453803066Z Wrote inspect data to must-gather. 2026-10-31T02:20:26.593280877Z Wrote inspect data to must-gather. 2026-10-31T02:20:26.753108525Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:27.591900208Z Wrote inspect data to must-gather. 2026-10-31T02:20:28.594131661Z Wrote inspect data to must-gather. 2026-10-31T02:20:29.784006608Z Wrote inspect data to must-gather. 2026-10-31T02:20:30.904635441Z Wrote inspect data to must-gather. 2026-10-31T02:20:31.757899402Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:32.051651722Z Wrote inspect data to must-gather. 2026-10-31T02:20:33.198786730Z Wrote inspect data to must-gather. 2026-10-31T02:20:34.349011002Z Wrote inspect data to must-gather. 2026-10-31T02:20:35.473896079Z Wrote inspect data to must-gather. 2026-10-31T02:20:36.605291470Z Wrote inspect data to must-gather. 2026-10-31T02:20:36.762670374Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:37.727499852Z Wrote inspect data to must-gather. 2026-10-31T02:20:38.847925274Z Wrote inspect data to must-gather. 2026-10-31T02:20:39.976118885Z Wrote inspect data to must-gather. 2026-10-31T02:20:40.698781338Z Gathering data for ns/e2e-models-e2e-worker-w2-00e840... 2026-10-31T02:20:41.572459640Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:20:41.767509256Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:42.100166619Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:20:43.150978551Z Wrote inspect data to must-gather. 2026-10-31T02:20:44.331689511Z Wrote inspect data to must-gather. 2026-10-31T02:20:45.464993093Z Wrote inspect data to must-gather. 2026-10-31T02:20:46.600622480Z Wrote inspect data to must-gather. 2026-10-31T02:20:46.772356084Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:47.738704650Z Wrote inspect data to must-gather. 2026-10-31T02:20:51.777348483Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:56.782281863Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:20:58.835141907Z Wrote inspect data to must-gather. 2026-10-31T02:20:59.975166253Z Wrote inspect data to must-gather. 2026-10-31T02:21:01.102534728Z Wrote inspect data to must-gather. 2026-10-31T02:21:01.787089300Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:02.239445238Z Wrote inspect data to must-gather. 2026-10-31T02:21:03.369931468Z Wrote inspect data to must-gather. 2026-10-31T02:21:04.511127979Z Wrote inspect data to must-gather. 2026-10-31T02:21:05.638072119Z Wrote inspect data to must-gather. 2026-10-31T02:21:06.766391590Z Wrote inspect data to must-gather. 2026-10-31T02:21:06.792048598Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:07.895629220Z Wrote inspect data to must-gather. 2026-10-31T02:21:09.033275079Z Wrote inspect data to must-gather. 2026-10-31T02:21:10.167472085Z Wrote inspect data to must-gather. 2026-10-31T02:21:10.889111039Z Gathering data for ns/e2e-models-e2e-worker-w2-00e840... 2026-10-31T02:21:11.759579725Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:21:11.796915942Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:12.286221482Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:21:13.321025071Z Wrote inspect data to must-gather. 2026-10-31T02:21:14.501232705Z Wrote inspect data to must-gather. 2026-10-31T02:21:15.644458752Z Wrote inspect data to must-gather. 2026-10-31T02:21:16.801778538Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:21.806673806Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:26.773151897Z Wrote inspect data to must-gather. 2026-10-31T02:21:26.812105108Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:27.903863713Z Wrote inspect data to must-gather. 2026-10-31T02:21:28.905662605Z Wrote inspect data to must-gather. 2026-10-31T02:21:29.932791586Z Wrote inspect data to must-gather. 2026-10-31T02:21:31.817153385Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:36.822116995Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:41.083346824Z Wrote inspect data to must-gather. 2026-10-31T02:21:41.827006500Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:42.218374196Z Wrote inspect data to must-gather. 2026-10-31T02:21:43.347799021Z Wrote inspect data to must-gather. 2026-10-31T02:21:44.484903859Z Wrote inspect data to must-gather. 2026-10-31T02:21:45.619018670Z Wrote inspect data to must-gather. 2026-10-31T02:21:46.757847867Z Wrote inspect data to must-gather. 2026-10-31T02:21:46.832544988Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:47.895266780Z Wrote inspect data to must-gather. 2026-10-31T02:21:51.837541950Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:56.842547686Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:21:59.029502534Z Wrote inspect data to must-gather. 2026-10-31T02:22:00.156881713Z Wrote inspect data to must-gather. 2026-10-31T02:22:01.283959140Z Wrote inspect data to must-gather. 2026-10-31T02:22:01.847330180Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:02.005952268Z Gathering data for ns/llm... 2026-10-31T02:22:04.941750028Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:22:05.662699994Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:22:06.766283562Z Wrote inspect data to must-gather. 2026-10-31T02:22:06.856078635Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:07.976753831Z Wrote inspect data to must-gather. 2026-10-31T02:22:09.205360157Z Wrote inspect data to must-gather. 2026-10-31T02:22:10.363843892Z Wrote inspect data to must-gather. 2026-10-31T02:22:11.525789883Z Wrote inspect data to must-gather. 2026-10-31T02:22:11.862080562Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:12.558689351Z Wrote inspect data to must-gather. 2026-10-31T02:22:13.649841578Z Wrote inspect data to must-gather. 2026-10-31T02:22:14.834924327Z Wrote inspect data to must-gather. 2026-10-31T02:22:15.997297800Z Wrote inspect data to must-gather. 2026-10-31T02:22:16.866960332Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:17.167924026Z Wrote inspect data to must-gather. 2026-10-31T02:22:18.340607132Z Wrote inspect data to must-gather. 2026-10-31T02:22:19.506987014Z Wrote inspect data to must-gather. 2026-10-31T02:22:20.687045575Z Wrote inspect data to must-gather. 2026-10-31T02:22:21.844474599Z Wrote inspect data to must-gather. 2026-10-31T02:22:21.871703193Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:23.005939784Z Wrote inspect data to must-gather. 2026-10-31T02:22:26.877535733Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:31.882348671Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:34.175837911Z Wrote inspect data to must-gather. 2026-10-31T02:22:35.326547497Z Wrote inspect data to must-gather. 2026-10-31T02:22:36.095667230Z Gathering data for ns/llm... 2026-10-31T02:22:36.887155949Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:38.789254654Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:22:39.521817698Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:22:40.617861406Z Wrote inspect data to must-gather. 2026-10-31T02:22:41.830225171Z Wrote inspect data to must-gather. 2026-10-31T02:22:41.893358110Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:43.083607317Z Wrote inspect data to must-gather. 2026-10-31T02:22:44.239249820Z Wrote inspect data to must-gather. 2026-10-31T02:22:45.394417519Z Wrote inspect data to must-gather. 2026-10-31T02:22:46.422770653Z Wrote inspect data to must-gather. 2026-10-31T02:22:46.898549990Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:47.507455489Z Wrote inspect data to must-gather. 2026-10-31T02:22:48.672208178Z Wrote inspect data to must-gather. 2026-10-31T02:22:49.838531357Z Wrote inspect data to must-gather. 2026-10-31T02:22:50.986296375Z Wrote inspect data to must-gather. 2026-10-31T02:22:51.903533090Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:22:52.146470306Z Wrote inspect data to must-gather. 2026-10-31T02:22:53.309767792Z Wrote inspect data to must-gather. 2026-10-31T02:22:56.908474112Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:01.913303422Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:04.464916943Z Wrote inspect data to must-gather. 2026-10-31T02:23:05.626405111Z Wrote inspect data to must-gather. 2026-10-31T02:23:06.780428148Z Wrote inspect data to must-gather. 2026-10-31T02:23:06.918228733Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:07.939728189Z Wrote inspect data to must-gather. 2026-10-31T02:23:09.085563578Z Wrote inspect data to must-gather. 2026-10-31T02:23:09.852547186Z Gathering data for ns/llm... 2026-10-31T02:23:11.925232851Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:12.564221849Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:23:13.343409086Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:23:14.427560499Z Wrote inspect data to must-gather. 2026-10-31T02:23:15.638511370Z Wrote inspect data to must-gather. 2026-10-31T02:23:16.864467262Z Wrote inspect data to must-gather. 2026-10-31T02:23:16.931493206Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:18.026974290Z Wrote inspect data to must-gather. 2026-10-31T02:23:19.185970999Z Wrote inspect data to must-gather. 2026-10-31T02:23:20.226740820Z Wrote inspect data to must-gather. 2026-10-31T02:23:21.316725617Z Wrote inspect data to must-gather. 2026-10-31T02:23:21.937551370Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:22.472959711Z Wrote inspect data to must-gather. 2026-10-31T02:23:26.942522576Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:31.947505557Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:33.618290075Z Wrote inspect data to must-gather. 2026-10-31T02:23:34.781379965Z Wrote inspect data to must-gather. 2026-10-31T02:23:35.939468569Z Wrote inspect data to must-gather. 2026-10-31T02:23:36.952330657Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:37.106849866Z Wrote inspect data to must-gather. 2026-10-31T02:23:38.268727694Z Wrote inspect data to must-gather. 2026-10-31T02:23:39.425683706Z Wrote inspect data to must-gather. 2026-10-31T02:23:40.585970117Z Wrote inspect data to must-gather. 2026-10-31T02:23:41.757683648Z Wrote inspect data to must-gather. 2026-10-31T02:23:41.957235134Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:42.915787127Z Wrote inspect data to must-gather. 2026-10-31T02:23:46.962054934Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:51.966865844Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:53.323039261Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-31T02:23:53.326471133Z Error inspecting namespace/llm 2026-10-31T02:23:54.528171035Z Wrote inspect data to must-gather. 2026-10-31T02:23:55.756608221Z Wrote inspect data to must-gather. 2026-10-31T02:23:56.901978379Z Wrote inspect data to must-gather. 2026-10-31T02:23:56.971634834Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:23:58.059990754Z Wrote inspect data to must-gather. 2026-10-31T02:23:59.090060286Z Wrote inspect data to must-gather. 2026-10-31T02:24:00.169339767Z Wrote inspect data to must-gather. 2026-10-31T02:24:01.327945818Z Wrote inspect data to must-gather. 2026-10-31T02:24:01.976460474Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:02.481695751Z Wrote inspect data to must-gather. 2026-10-31T02:24:06.981285342Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:11.986187280Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:13.644435780Z Wrote inspect data to must-gather. 2026-10-31T02:24:14.804371666Z Wrote inspect data to must-gather. 2026-10-31T02:24:15.975762701Z Wrote inspect data to must-gather. 2026-10-31T02:24:16.991135681Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:17.160973655Z Wrote inspect data to must-gather. 2026-10-31T02:24:18.319379081Z Wrote inspect data to must-gather. 2026-10-31T02:24:19.468064604Z Wrote inspect data to must-gather. 2026-10-31T02:24:20.628139034Z Wrote inspect data to must-gather. 2026-10-31T02:24:21.800660945Z Wrote inspect data to must-gather. 2026-10-31T02:24:21.996059887Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:27.001158735Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:32.006086840Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:32.573074230Z Gathering data for ns/llm... 2026-10-31T02:24:35.270267700Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:24:36.005608174Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:24:37.010986242Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:37.099409550Z Wrote inspect data to must-gather. 2026-10-31T02:24:42.015898030Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:47.020669099Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:48.252085411Z Wrote inspect data to must-gather. 2026-10-31T02:24:52.025560016Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:57.030498947Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:24:59.528892099Z Wrote inspect data to must-gather. 2026-10-31T02:25:00.684021904Z Wrote inspect data to must-gather. 2026-10-31T02:25:01.847475366Z Wrote inspect data to must-gather. 2026-10-31T02:25:02.035293677Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:02.879973937Z Wrote inspect data to must-gather. 2026-10-31T02:25:03.968245559Z Wrote inspect data to must-gather. 2026-10-31T02:25:05.136663625Z Wrote inspect data to must-gather. 2026-10-31T02:25:06.295628461Z Wrote inspect data to must-gather. 2026-10-31T02:25:07.040295073Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:07.445310659Z Wrote inspect data to must-gather. 2026-10-31T02:25:08.595132123Z Wrote inspect data to must-gather. 2026-10-31T02:25:09.765835902Z Wrote inspect data to must-gather. 2026-10-31T02:25:10.927447957Z Wrote inspect data to must-gather. 2026-10-31T02:25:12.045149845Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:12.092367932Z Wrote inspect data to must-gather. 2026-10-31T02:25:13.254264200Z Wrote inspect data to must-gather. 2026-10-31T02:25:14.421947592Z Wrote inspect data to must-gather. 2026-10-31T02:25:17.049993465Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:22.054849117Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:25.580725227Z Wrote inspect data to must-gather. 2026-10-31T02:25:26.348455550Z Gathering data for ns/llm... 2026-10-31T02:25:27.059690132Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:29.138435662Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:25:29.868285945Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:25:30.965738265Z Wrote inspect data to must-gather. 2026-10-31T02:25:32.064729508Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:32.168230250Z Wrote inspect data to must-gather. 2026-10-31T02:25:33.392158483Z Wrote inspect data to must-gather. 2026-10-31T02:25:34.777888492Z Wrote inspect data to must-gather. 2026-10-31T02:25:35.955993735Z Wrote inspect data to must-gather. 2026-10-31T02:25:36.987077679Z Wrote inspect data to must-gather. 2026-10-31T02:25:37.071462840Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:38.061243796Z Wrote inspect data to must-gather. 2026-10-31T02:25:39.214092098Z Wrote inspect data to must-gather. 2026-10-31T02:25:40.371820832Z Wrote inspect data to must-gather. 2026-10-31T02:25:41.524712855Z Wrote inspect data to must-gather. 2026-10-31T02:25:42.076338058Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:42.684640200Z Wrote inspect data to must-gather. 2026-10-31T02:25:43.854255559Z Wrote inspect data to must-gather. 2026-10-31T02:25:45.012008352Z Wrote inspect data to must-gather. 2026-10-31T02:25:46.160080643Z Wrote inspect data to must-gather. 2026-10-31T02:25:47.081199919Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:47.358100178Z Wrote inspect data to must-gather. 2026-10-31T02:25:48.507429761Z Wrote inspect data to must-gather. 2026-10-31T02:25:49.713555330Z Wrote inspect data to must-gather. 2026-10-31T02:25:50.484778148Z Gathering data for ns/llm... 2026-10-31T02:25:52.086041289Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:53.258982201Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:25:53.995311260Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:25:55.121000202Z Wrote inspect data to must-gather. 2026-10-31T02:25:56.319927991Z Wrote inspect data to must-gather. 2026-10-31T02:25:57.092018108Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:25:57.559178560Z Wrote inspect data to must-gather. 2026-10-31T02:25:58.714133470Z Wrote inspect data to must-gather. 2026-10-31T02:25:59.870302950Z Wrote inspect data to must-gather. 2026-10-31T02:26:00.896211284Z Wrote inspect data to must-gather. 2026-10-31T02:26:02.096969131Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:07.101833064Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:12.106706005Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:12.156083813Z Wrote inspect data to must-gather. 2026-10-31T02:26:13.312730091Z Wrote inspect data to must-gather. 2026-10-31T02:26:14.471881301Z Wrote inspect data to must-gather. 2026-10-31T02:26:15.620377525Z Wrote inspect data to must-gather. 2026-10-31T02:26:16.785293510Z Wrote inspect data to must-gather. 2026-10-31T02:26:17.111495053Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:17.962308611Z Wrote inspect data to must-gather. 2026-10-31T02:26:22.116487028Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:27.121380668Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:29.115100324Z Wrote inspect data to must-gather. 2026-10-31T02:26:30.258945203Z Wrote inspect data to must-gather. 2026-10-31T02:26:31.419910816Z Wrote inspect data to must-gather. 2026-10-31T02:26:32.126302955Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:32.577570837Z Wrote inspect data to must-gather. 2026-10-31T02:26:33.298517295Z Gathering data for ns/llm... 2026-10-31T02:26:35.996636014Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:26:36.713626453Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:26:37.131182255Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:37.801556531Z Wrote inspect data to must-gather. 2026-10-31T02:26:39.001139859Z Wrote inspect data to must-gather. 2026-10-31T02:26:40.248972052Z Wrote inspect data to must-gather. 2026-10-31T02:26:41.411065329Z Wrote inspect data to must-gather. 2026-10-31T02:26:42.136199128Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:42.570768129Z Wrote inspect data to must-gather. 2026-10-31T02:26:43.598304310Z Wrote inspect data to must-gather. 2026-10-31T02:26:44.676672480Z Wrote inspect data to must-gather. 2026-10-31T02:26:45.836549036Z Wrote inspect data to must-gather. 2026-10-31T02:26:47.141108194Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:52.146054832Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:57.007690001Z Wrote inspect data to must-gather. 2026-10-31T02:26:57.150871999Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:26:58.167536251Z Wrote inspect data to must-gather. 2026-10-31T02:26:59.329409114Z Wrote inspect data to must-gather. 2026-10-31T02:27:00.486944809Z Wrote inspect data to must-gather. 2026-10-31T02:27:01.638910783Z Wrote inspect data to must-gather. 2026-10-31T02:27:02.155615662Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:02.793520388Z Wrote inspect data to must-gather. 2026-10-31T02:27:03.954061463Z Wrote inspect data to must-gather. 2026-10-31T02:27:05.122034413Z Wrote inspect data to must-gather. 2026-10-31T02:27:07.160596903Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:12.165432985Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:16.277014168Z Wrote inspect data to must-gather. 2026-10-31T02:27:17.007367406Z Gathering data for ns/models-as-a-service... 2026-10-31T02:27:17.170296508Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:17.879114842Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:27:18.610452166Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:27:19.668177281Z Wrote inspect data to must-gather. 2026-10-31T02:27:20.872123001Z Wrote inspect data to must-gather. 2026-10-31T02:27:22.029780800Z Wrote inspect data to must-gather. 2026-10-31T02:27:22.175201127Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:23.187366380Z Wrote inspect data to must-gather. 2026-10-31T02:27:24.353267507Z Wrote inspect data to must-gather. 2026-10-31T02:27:25.391340435Z Wrote inspect data to must-gather. 2026-10-31T02:27:26.407616161Z Wrote inspect data to must-gather. 2026-10-31T02:27:27.180051906Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:27.562649809Z Wrote inspect data to must-gather. 2026-10-31T02:27:28.708009648Z Wrote inspect data to must-gather. 2026-10-31T02:27:29.859009547Z Wrote inspect data to must-gather. 2026-10-31T02:27:31.025192992Z Wrote inspect data to must-gather. 2026-10-31T02:27:32.184061436Z Wrote inspect data to must-gather. 2026-10-31T02:27:32.185080221Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:33.343434098Z Wrote inspect data to must-gather. 2026-10-31T02:27:34.495300255Z Wrote inspect data to must-gather. 2026-10-31T02:27:35.653935009Z Wrote inspect data to must-gather. 2026-10-31T02:27:36.801815973Z Wrote inspect data to must-gather. 2026-10-31T02:27:37.189854749Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:37.955523560Z Wrote inspect data to must-gather. 2026-10-31T02:27:38.720500097Z Gathering data for ns/models-as-a-service... 2026-10-31T02:27:39.596818683Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:27:40.281804967Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:27:41.343000885Z Wrote inspect data to must-gather. 2026-10-31T02:27:42.194686465Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:42.547567792Z Wrote inspect data to must-gather. 2026-10-31T02:27:43.698689447Z Wrote inspect data to must-gather. 2026-10-31T02:27:44.854518937Z Wrote inspect data to must-gather. 2026-10-31T02:27:46.006961610Z Wrote inspect data to must-gather. 2026-10-31T02:27:47.199893016Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:52.204811494Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:27:57.114562175Z Wrote inspect data to must-gather. 2026-10-31T02:27:57.209599498Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:02.214564675Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:07.219424273Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:08.278339890Z Wrote inspect data to must-gather. 2026-10-31T02:28:09.436638786Z Wrote inspect data to must-gather. 2026-10-31T02:28:10.587474764Z Wrote inspect data to must-gather. 2026-10-31T02:28:11.745720590Z Wrote inspect data to must-gather. 2026-10-31T02:28:12.224253588Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:12.941887497Z Wrote inspect data to must-gather. 2026-10-31T02:28:14.107933050Z Wrote inspect data to must-gather. 2026-10-31T02:28:15.455650477Z Wrote inspect data to must-gather. 2026-10-31T02:28:16.595210375Z Wrote inspect data to must-gather. 2026-10-31T02:28:17.229072477Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:22.233861320Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:27.238682568Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:27.736783999Z Wrote inspect data to must-gather. 2026-10-31T02:28:28.879917873Z Wrote inspect data to must-gather. 2026-10-31T02:28:29.640158758Z Gathering data for ns/models-as-a-service... 2026-10-31T02:28:30.513652926Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-31T02:28:31.197241461Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-31T02:28:32.241917403Z Wrote inspect data to must-gather. 2026-10-31T02:28:32.243760397Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:33.431583278Z Wrote inspect data to must-gather. 2026-10-31T02:28:34.583364096Z Wrote inspect data to must-gather. 2026-10-31T02:28:35.731226162Z Wrote inspect data to must-gather. 2026-10-31T02:28:36.867764752Z Wrote inspect data to must-gather. 2026-10-31T02:28:37.248479681Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:37.890005400Z Wrote inspect data to must-gather. 2026-10-31T02:28:38.924729703Z Wrote inspect data to must-gather. 2026-10-31T02:28:40.076101602Z Wrote inspect data to must-gather. 2026-10-31T02:28:41.224856956Z Wrote inspect data to must-gather. 2026-10-31T02:28:42.253491417Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:42.382731558Z Wrote inspect data to must-gather. 2026-10-31T02:28:43.530683049Z Wrote inspect data to must-gather. 2026-10-31T02:28:44.692535236Z Wrote inspect data to must-gather. 2026-10-31T02:28:45.904588928Z Wrote inspect data to must-gather. 2026-10-31T02:28:47.154751187Z Wrote inspect data to must-gather. 2026-10-31T02:28:47.258363283Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-31T02:28:48.313948060Z Wrote inspect data to must-gather. 2026-10-31T02:28:49.467477210Z Wrote inspect data to must-gather. 2026-10-31T02:28:50.651965933Z Wrote inspect data to must-gather. 2026-10-31T02:28:50.993824537Z ========================================== 2026-10-31T02:28:50.993824537Z Must-Gather Collection Summary 2026-10-31T02:28:50.993824537Z ========================================== 2026-10-31T02:28:50.995819559Z Timestamp: 2026-10-31 02:28:50 UTC 2026-10-31T02:28:50.995847600Z Kubernetes Distribution: ocp 2026-10-31T02:28:50.995847600Z Component: aigateway 2026-10-31T02:28:50.995856886Z Destination: must-gather 2026-10-31T02:28:50.995915710Z 2026-10-31T02:28:50.995915710Z Status: SUCCESS 2026-10-31T02:28:50.995928442Z ========================================== 2026-10-31T02:28:50.995935856Z DEBUG: Must-gather collection completed 2026-10-31T02:28:50.995944551Z ========================================== 2026-10-31T02:28:51.000073129Z Caches written to disk