2026-06-14T06:06:11.824628454Z [disk usage checker] Started
2026-06-14T06:06:11.827894392Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-14T06:06:12.011312094Z Gathering data for ns/openshift-cluster-version...
2026-06-14T06:06:12.115604937Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-14T06:06:12.191091726Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-14T06:06:12.260824417Z Gathering data for ns/default...
2026-06-14T06:06:12.515771184Z Gathering data for ns/openshift...
2026-06-14T06:06:12.890576297Z Gathering data for ns/kube-system...
2026-06-14T06:06:13.529498476Z Gathering data for ns/openshift-etcd...
2026-06-14T06:06:13.789750006Z Wrote inspect data to must-gather.
2026-06-14T06:06:13.789781373Z error: inspection completed with the errors occurred while gathering data:
2026-06-14T06:06:13.789781373Z     namespaces "assisted-installer" not found
2026-06-14T06:06:14.276333138Z Waiting on subprocesses to finish execution.
2026-06-14T06:06:14.281247355Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-14T06:06:14.285942197Z INFO: Gathering HAProxy config files
2026-06-14T06:06:14.288516541Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-14T06:06:14.289182750Z INFO: Collecting host service logs for crio
2026-06-14T06:06:14.289781766Z INFO: Collecting host service logs for kubelet
2026-06-14T06:06:14.290153910Z INFO: Collecting host service logs for rpm-ostreed
2026-06-14T06:06:14.290497855Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-14T06:06:14.290824050Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-14T06:06:14.291140546Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-14T06:06:14.291490092Z INFO: Collecting host service logs for NetworkManager
2026-06-14T06:06:14.291835139Z INFO: Collecting host service logs for openvswitch
2026-06-14T06:06:14.292163421Z INFO: Collecting host service logs for ovs-configuration
2026-06-14T06:06:14.292490136Z Executing Istio gather script
2026-06-14T06:06:14.292611263Z INFO: Collecting host service logs for ovsdb-server
2026-06-14T06:06:14.292917586Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-14T06:06:14.293264922Z INFO: Waiting for worker host service log collection to complete ...
2026-06-14T06:06:14.296291128Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-14T06:06:14.307261642Z INFO: Waiting for node performance related collection to complete ...
2026-06-14T06:06:14.980249610Z No resources found
2026-06-14T06:06:15.212120523Z error: the server doesn't have a resource type "performanceprofile"
2026-06-14T06:06:15.228388088Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-14T06:06:15.340493541Z INFO: "metallb-operator" not detected. Skipping.
2026-06-14T06:06:15.406719204Z Wrote inspect data to must-gather.
2026-06-14T06:06:15.509849625Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-14T06:06:15.553118144Z No resources found in openshift-etcd namespace.
2026-06-14T06:06:15.559061399Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-14T06:06:15.559137845Z INFO: on-disk MachineConfig config collection complete.
2026-06-14T06:06:15.758044382Z INFO: Worker host service log collection to complete.
2026-06-14T06:06:15.763240948Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-14T06:06:15.808475004Z INFO: Collecting Insights Archives from insights-operator-5bbd86d6bd-jvnxx
2026-06-14T06:06:15.808523650Z insights-runtime-extractor-4nlk2
2026-06-14T06:06:15.808543473Z insights-runtime-extractor-bwtxh
2026-06-14T06:06:15.808563145Z insights-runtime-extractor-h44zl
2026-06-14T06:06:15.844193423Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-14T06:06:16.151173579Z ERROR: No running kube-apiserver pods found
2026-06-14T06:06:16.230147961Z Wrote inspect data to must-gather.
2026-06-14T06:06:16.326562388Z No resources found
2026-06-14T06:06:16.367660865Z Wrote inspect data to must-gather.
2026-06-14T06:06:16.419134540Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-14T06:06:16.460546578Z Gathering data for ns/openshift-monitoring...
2026-06-14T06:06:16.531628116Z Wrote inspect data to must-gather.
2026-06-14T06:06:16.545945960Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-14T06:06:16.584943170Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-14T06:06:16.660180948Z Wrote inspect data to must-gather.
2026-06-14T06:06:16.673591079Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-14T06:06:16.673591079Z See 'oc rsync -h' for help and examples
2026-06-14T06:06:16.689655035Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-14T06:06:16.727553167Z INFO: 'previous-logs' folder not found on ip-10-0-136-212.ec2.internal, skipping...
2026-06-14T06:06:16.749271315Z Wrote inspect data to must-gather.
2026-06-14T06:06:16.756166789Z Wrote inspect data to must-gather.
2026-06-14T06:06:16.842436826Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-14T06:06:16.885978502Z error: the server doesn't have a resource type "machineconfigs"
2026-06-14T06:06:16.995161845Z tar: Removing leading `/' from member names
2026-06-14T06:06:17.002310650Z INFO: HAProxy config collection complete.
2026-06-14T06:06:17.053332860Z INFO: 'previous-logs' folder not found on ip-10-0-140-206.ec2.internal, skipping...
2026-06-14T06:06:17.070941428Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-14T06:06:17.101903257Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-14T06:06:17.109298742Z Wrote inspect data to must-gather.
2026-06-14T06:06:17.140475580Z INFO: Getting rules from prometheus-k8s-0
2026-06-14T06:06:17.342813040Z INFO: 'previous-logs' folder not found on ip-10-0-140-231.ec2.internal, skipping...
2026-06-14T06:06:17.342850590Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-14T06:06:17.342880563Z INFO: Machine Config Daemon termination log collection complete.
2026-06-14T06:06:17.355806974Z Wrote inspect data to must-gather.
2026-06-14T06:06:17.366834974Z Wrote inspect data to must-gather.
2026-06-14T06:06:17.491176328Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-14T06:06:17.594918020Z INFO: Getting status/config from prometheus-k8s-0
2026-06-14T06:06:17.604631850Z Wrote inspect data to must-gather.
2026-06-14T06:06:17.698502392Z Wrote inspect data to must-gather.
2026-06-14T06:06:17.794539737Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-14T06:06:17.892540848Z INFO: INTERCONNECT MODE
2026-06-14T06:06:17.892579171Z INFO: Gathering ovn-kubernetes DBs
2026-06-14T06:06:17.918483507Z Wrote inspect data to must-gather.
2026-06-14T06:06:17.993250488Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-14T06:06:17.994967602Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:18.018281178Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-14T06:06:18.059686205Z INFO: Gathering OVN_Northbound from ovnkube-node-769f6...
2026-06-14T06:06:18.059933607Z INFO: Gathering OVN_Northbound from ovnkube-node-8mcbl...
2026-06-14T06:06:18.060193433Z INFO: Gathering OVN_Northbound from ovnkube-node-mvgrk...
2026-06-14T06:06:18.060601808Z INFO: Gathering OVN_Southbound from ovnkube-node-769f6...
2026-06-14T06:06:18.060900532Z INFO: Gathering OVN_Southbound from ovnkube-node-8mcbl...
2026-06-14T06:06:18.061182134Z INFO: Gathering OVN_Southbound from ovnkube-node-mvgrk...
2026-06-14T06:06:18.281412911Z Wrote inspect data to must-gather.
2026-06-14T06:06:18.348657282Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:18.355362945Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-14T06:06:18.366013473Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-14T06:06:18.379627933Z tar: Removing leading `/' from member names
2026-06-14T06:06:18.383394160Z tar: Removing leading `/' from member names
2026-06-14T06:06:18.386591521Z tar: Removing leading `/' from member names
2026-06-14T06:06:18.414784161Z tar: Removing leading `/' from member names
2026-06-14T06:06:18.434189807Z tar: Removing leading `/' from member names
2026-06-14T06:06:18.455439744Z tar: Removing leading `/' from member names
2026-06-14T06:06:18.530963957Z Wrote inspect data to must-gather.
2026-06-14T06:06:18.601577897Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:18.631498416Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-14T06:06:18.791679230Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-14T06:06:18.865506587Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:18.867547100Z Wrote inspect data to must-gather.
2026-06-14T06:06:18.869531353Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-14T06:06:18.907723161Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-14T06:06:18.911332585Z INFO: Waiting for network log collection to complete ...
2026-06-14T06:06:18.911391606Z INFO: Waiting for ovnk database copies to complete ...
2026-06-14T06:06:18.911914296Z INFO: Copying ovnk databases complete.
2026-06-14T06:06:18.913747656Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-06-14T06:06:18.916464539Z ovnk_database_store/
2026-06-14T06:06:18.916516865Z ovnk_database_store/ovnkube-node-769f6_nbdb
2026-06-14T06:06:18.924725939Z ovnk_database_store/ovnkube-node-8mcbl_sbdb
2026-06-14T06:06:18.941001312Z ovnk_database_store/ovnkube-node-mvgrk_nbdb
2026-06-14T06:06:18.948876246Z ovnk_database_store/ovnkube-node-8mcbl_nbdb
2026-06-14T06:06:18.956736182Z ovnk_database_store/ovnkube-node-mvgrk_sbdb
2026-06-14T06:06:18.973666439Z ovnk_database_store/ovnkube-node-769f6_sbdb
2026-06-14T06:06:18.998056673Z INFO: Network log collection complete.
2026-06-14T06:06:19.003267436Z Gathering data for ns/openshift-network-console...
2026-06-14T06:06:19.078494517Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:19.150870190Z Wrote inspect data to must-gather.
2026-06-14T06:06:19.292294883Z INFO: Getting status from alertmanager-main-0
2026-06-14T06:06:19.294928871Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:19.298589021Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-14T06:06:19.447699617Z Gathering data for ns/openshift-console-operator...
2026-06-14T06:06:19.454621490Z Wrote inspect data to must-gather.
2026-06-14T06:06:19.545406797Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:19.706572588Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-14T06:06:19.709059111Z INFO: Fallback to identify the container image from release info
2026-06-14T06:06:19.735983658Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:19.738825972Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-14T06:06:19.837163080Z Gathering data for ns/openshift-console...
2026-06-14T06:06:19.893989740Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:20.070777487Z Wrote inspect data to /must-gather/istio.
2026-06-14T06:06:20.280775634Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d66a6b2ec52dede5d83ce04f6abfc519df1fd7dc36248741e03ecb9bf8d1762
2026-06-14T06:06:20.332471824Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-14T06:06:20.414060534Z daemonset.apps/perf-node-gather-daemonset created
2026-06-14T06:06:20.536481607Z Waiting for performance profile collector pods to become ready: 1
2026-06-14T06:06:20.756217073Z Done executing Istio gather script
2026-06-14T06:06:20.839243970Z Gathering data for ns/openshift-dns-operator...
2026-06-14T06:06:21.106416309Z Gathering data for ns/openshift-dns...
2026-06-14T06:06:21.654978133Z Gathering data for ns/openshift-image-registry...
2026-06-14T06:06:21.659625409Z Waiting for performance profile collector pods to become ready: 2
2026-06-14T06:06:21.847370927Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-14T06:06:22.076509745Z Gathering data for ns/openshift-ingress-operator...
2026-06-14T06:06:22.368193479Z Gathering data for ns/openshift-ingress...
2026-06-14T06:06:22.654467968Z Gathering data for ns/openshift-ingress-canary...
2026-06-14T06:06:22.775875376Z Waiting for performance profile collector pods to become ready: 3
2026-06-14T06:06:23.011631381Z Gathering data for ns/openshift-insights...
2026-06-14T06:06:23.875665096Z Waiting for performance profile collector pods to become ready: 4
2026-06-14T06:06:24.749936904Z Gathering data for ns/openshift-config...
2026-06-14T06:06:24.992434166Z Gathering data for ns/openshift-config-managed...
2026-06-14T06:06:24.995721323Z Waiting for performance profile collector pods to become ready: 5
2026-06-14T06:06:25.377915622Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-14T06:06:25.607095551Z Gathering data for ns/openshift-kube-apiserver...
2026-06-14T06:06:25.832847457Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-14T06:06:26.111830340Z Waiting for performance profile collector pods to become ready: 6
2026-06-14T06:06:26.150697113Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-14T06:06:26.399071928Z Gathering data for ns/openshift-kube-scheduler...
2026-06-14T06:06:26.623109451Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-14T06:06:26.851944800Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-14T06:06:26.872712743Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-14T06:06:27.146628721Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-14T06:06:27.240308737Z Waiting for performance profile collector pods to become ready: 7
2026-06-14T06:06:27.437007712Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-14T06:06:27.916044451Z Gathering data for ns/openshift-multus...
2026-06-14T06:06:28.336830824Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-14T06:06:28.547520576Z Collecting performance related data for node ip-10-0-140-206.ec2.internal
2026-06-14T06:06:28.554927145Z Collecting performance related data for node ip-10-0-140-231.ec2.internal
2026-06-14T06:06:28.562243295Z Collecting performance related data for node ip-10-0-136-212.ec2.internal
2026-06-14T06:06:29.319217614Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-14T06:06:30.467871660Z Gathering data for ns/openshift-host-network...
2026-06-14T06:06:30.755602013Z Gathering data for ns/openshift-network-diagnostics...
2026-06-14T06:06:31.305811622Z Gathering data for ns/openshift-network-node-identity...
2026-06-14T06:06:31.683034903Z Gathering data for ns/openshift-network-operator...
2026-06-14T06:06:31.856374662Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-14T06:06:32.025545030Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-14T06:06:32.307848469Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-14T06:06:32.754496504Z Gathering data for ns/openshift-apiserver-operator...
2026-06-14T06:06:33.021484777Z Gathering data for ns/openshift-apiserver...
2026-06-14T06:06:33.413329842Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-14T06:06:33.650983655Z Gathering data for ns/openshift-controller-manager...
2026-06-14T06:06:33.887152007Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-14T06:06:34.484192961Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-14T06:06:34.737721667Z Gathering data for ns/openshift-service-ca-operator...
2026-06-14T06:06:35.005012036Z Gathering data for ns/openshift-service-ca...
2026-06-14T06:06:35.325684047Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-14T06:06:36.173646000Z Wrote inspect data to must-gather.
2026-06-14T06:06:36.173685494Z error: inspection completed with the errors occurred while gathering data:
2026-06-14T06:06:36.173685494Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-14T06:06:36.438195132Z Collecting kubelet logs for node ip-10-0-140-206.ec2.internal
2026-06-14T06:06:36.439899955Z Collecting kubelet logs for node ip-10-0-140-231.ec2.internal
2026-06-14T06:06:36.442040083Z Collecting kubelet logs for node ip-10-0-136-212.ec2.internal
2026-06-14T06:06:36.728906044Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-mcbtv namespace
2026-06-14T06:06:36.733763416Z INFO: Node performance data collection complete.
2026-06-14T06:06:36.856515150Z error: the server doesn't have a resource type "clusters"
2026-06-14T06:06:36.861062272Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-14T06:06:36.986045811Z Caches written to disk