2026-07-06T16:59:08.415609361Z [disk usage checker] Started
2026-07-06T16:59:08.423953546Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-06T16:59:08.640223427Z Gathering data for ns/openshift-cluster-version...
2026-07-06T16:59:08.789567989Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-06T16:59:08.889880519Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-06T16:59:08.976743997Z Gathering data for ns/default...
2026-07-06T16:59:09.311934121Z Gathering data for ns/openshift...
2026-07-06T16:59:09.764538781Z Gathering data for ns/kube-system...
2026-07-06T16:59:10.517329776Z Gathering data for ns/openshift-etcd...
2026-07-06T16:59:10.869245834Z Wrote inspect data to must-gather.
2026-07-06T16:59:10.869281298Z error: inspection completed with the errors occurred while gathering data:
2026-07-06T16:59:10.869281298Z     namespaces "assisted-installer" not found
2026-07-06T16:59:11.350196360Z Waiting on subprocesses to finish execution.
2026-07-06T16:59:11.357454204Z INFO: Gathering HAProxy config files
2026-07-06T16:59:11.360139029Z Executing Istio gather script
2026-07-06T16:59:11.361102321Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-07-06T16:59:11.362399972Z INFO: Gathering machine config daemon's old logs from all nodes
2026-07-06T16:59:11.374215955Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-07-06T16:59:11.403024138Z INFO: Collecting host service logs for crio
2026-07-06T16:59:11.403491026Z INFO: Collecting host service logs for kubelet
2026-07-06T16:59:11.403892438Z INFO: Collecting host service logs for rpm-ostreed
2026-07-06T16:59:11.404249640Z INFO: Collecting host service logs for ostree-finalize-staged
2026-07-06T16:59:11.404609695Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-07-06T16:59:11.404978433Z INFO: Collecting host service logs for machine-config-daemon-host
2026-07-06T16:59:11.405327931Z INFO: Collecting host service logs for NetworkManager
2026-07-06T16:59:11.405687704Z INFO: Collecting host service logs for openvswitch
2026-07-06T16:59:11.408397079Z INFO: Collecting host service logs for ovs-configuration
2026-07-06T16:59:11.408885094Z INFO: Collecting host service logs for ovsdb-server
2026-07-06T16:59:11.409297738Z INFO: Collecting host service logs for ovs-vswitchd
2026-07-06T16:59:11.409725818Z INFO: Waiting for worker host service log collection to complete ...
2026-07-06T16:59:11.468373471Z INFO: Waiting for node performance related collection to complete ...
2026-07-06T16:59:11.716229116Z INFO: "sriov-network-operator" not detected. Skipping.
2026-07-06T16:59:12.228512584Z No resources found
2026-07-06T16:59:12.276202402Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-07-06T16:59:12.295045488Z INFO: Found 1 replicas - prometheus-k8s-0
2026-07-06T16:59:12.323876955Z error: the server doesn't have a resource type "performanceprofile"
2026-07-06T16:59:12.437341682Z INFO: Collecting Insights Archives from insights-operator-5c847dcfc4-qlp2b
2026-07-06T16:59:12.437341682Z insights-runtime-extractor-4294w
2026-07-06T16:59:12.437341682Z insights-runtime-extractor-n2fpc
2026-07-06T16:59:12.437341682Z insights-runtime-extractor-nhjnc
2026-07-06T16:59:12.520823193Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-07-06T16:59:12.521074047Z INFO: on-disk MachineConfig config collection complete.
2026-07-06T16:59:12.600345798Z No resources found in openshift-etcd namespace.
2026-07-06T16:59:12.697988304Z INFO: "metallb-operator" not detected. Skipping.
2026-07-06T16:59:12.801063257Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-07-06T16:59:13.064273317Z INFO: Worker host service log collection to complete.
2026-07-06T16:59:13.086471659Z Wrote inspect data to must-gather.
2026-07-06T16:59:13.126962966Z INFO: Waiting for HAProxy config collection to complete ...
2026-07-06T16:59:13.280976002Z Wrote inspect data to must-gather.
2026-07-06T16:59:13.346817670Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-07-06T16:59:13.496555175Z Wrote inspect data to must-gather.
2026-07-06T16:59:13.546620844Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-07-06T16:59:13.546620844Z See 'oc rsync -h' for help and examples
2026-07-06T16:59:13.557734172Z No resources found
2026-07-06T16:59:13.581155211Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-06T16:59:13.594411479Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-06T16:59:13.610320475Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-07-06T16:59:13.653890634Z INFO: 'previous-logs' folder not found on ip-10-0-128-105.ec2.internal, skipping...
2026-07-06T16:59:13.684491264Z Wrote inspect data to must-gather.
2026-07-06T16:59:13.782243480Z Gathering data for ns/openshift-monitoring...
2026-07-06T16:59:13.988733385Z tar: Removing leading `/' from member names
2026-07-06T16:59:13.996862343Z INFO: HAProxy config collection complete.
2026-07-06T16:59:14.006606929Z ERROR: No running kube-apiserver pods found
2026-07-06T16:59:14.048752793Z Wrote inspect data to must-gather.
2026-07-06T16:59:14.079167075Z Wrote inspect data to must-gather.
2026-07-06T16:59:14.098921604Z Wrote inspect data to must-gather.
2026-07-06T16:59:14.105435278Z error: the server doesn't have a resource type "machineconfigs"
2026-07-06T16:59:14.218410582Z INFO: 'previous-logs' folder not found on ip-10-0-130-189.ec2.internal, skipping...
2026-07-06T16:59:14.267725913Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-07-06T16:59:14.332969256Z error: the server doesn't have a resource type "machineconfigpools"
2026-07-06T16:59:14.357474236Z Wrote inspect data to must-gather.
2026-07-06T16:59:14.396344741Z INFO: Getting rules from prometheus-k8s-0
2026-07-06T16:59:14.529264427Z INFO: 'previous-logs' folder not found on ip-10-0-143-171.ec2.internal, skipping...
2026-07-06T16:59:14.529401061Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-07-06T16:59:14.529461528Z INFO: Machine Config Daemon termination log collection complete.
2026-07-06T16:59:14.592177811Z Wrote inspect data to must-gather.
2026-07-06T16:59:14.635980110Z Wrote inspect data to must-gather.
2026-07-06T16:59:14.771606311Z error: the server doesn't have a resource type "kubeletconfigs"
2026-07-06T16:59:14.874355275Z INFO: Getting status/config from prometheus-k8s-0
2026-07-06T16:59:14.912132488Z Wrote inspect data to must-gather.
2026-07-06T16:59:15.035443775Z Wrote inspect data to must-gather.
2026-07-06T16:59:15.186809518Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-07-06T16:59:15.242655041Z INFO: INTERCONNECT MODE
2026-07-06T16:59:15.242655041Z INFO: Gathering ovn-kubernetes DBs
2026-07-06T16:59:15.278607016Z Wrote inspect data to must-gather.
2026-07-06T16:59:15.345025079Z INFO: Getting status/flags from prometheus-k8s-0
2026-07-06T16:59:15.399587845Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:15.436926075Z INFO: Gathering OVN_Northbound from ovnkube-node-l48f5...
2026-07-06T16:59:15.437209129Z INFO: Gathering OVN_Northbound from ovnkube-node-t9xvd...
2026-07-06T16:59:15.437491684Z INFO: Gathering OVN_Northbound from ovnkube-node-z586v...
2026-07-06T16:59:15.437752726Z INFO: Gathering OVN_Southbound from ovnkube-node-l48f5...
2026-07-06T16:59:15.438030367Z INFO: Gathering OVN_Southbound from ovnkube-node-t9xvd...
2026-07-06T16:59:15.438336842Z INFO: Gathering OVN_Southbound from ovnkube-node-z586v...
2026-07-06T16:59:15.590594156Z Wrote inspect data to must-gather.
2026-07-06T16:59:15.661529921Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-07-06T16:59:15.762994104Z tar: Removing leading `/' from member names
2026-07-06T16:59:15.788575454Z tar: Removing leading `/' from member names
2026-07-06T16:59:15.812959049Z tar: Removing leading `/' from member names
2026-07-06T16:59:15.813203201Z tar: Removing leading `/' from member names
2026-07-06T16:59:15.821200734Z tar: Removing leading `/' from member names
2026-07-06T16:59:15.833893128Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:15.839213996Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-07-06T16:59:15.874591651Z tar: Removing leading `/' from member names
2026-07-06T16:59:15.938237390Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-06T16:59:15.976114108Z Wrote inspect data to must-gather.
2026-07-06T16:59:15.994295546Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-07-06T16:59:16.102057403Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:16.246486651Z Wrote inspect data to must-gather.
2026-07-06T16:59:16.305653527Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-07-06T16:59:16.377265154Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:16.380128483Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-07-06T16:59:16.380128483Z INFO: Waiting for network log collection to complete ...
2026-07-06T16:59:16.380202958Z INFO: Waiting for ovnk database copies to complete ...
2026-07-06T16:59:16.381705809Z INFO: Copying ovnk databases complete.
2026-07-06T16:59:16.383954358Z 2.6M	must-gather/network_logs/ovnk_database_store
2026-07-06T16:59:16.387545057Z ovnk_database_store/
2026-07-06T16:59:16.387615770Z ovnk_database_store/ovnkube-node-l48f5_nbdb
2026-07-06T16:59:16.397184692Z ovnk_database_store/ovnkube-node-t9xvd_nbdb
2026-07-06T16:59:16.405690594Z ovnk_database_store/ovnkube-node-l48f5_sbdb
2026-07-06T16:59:16.420140449Z ovnk_database_store/ovnkube-node-t9xvd_sbdb
2026-07-06T16:59:16.437969152Z ovnk_database_store/ovnkube-node-z586v_nbdb
2026-07-06T16:59:16.444969083Z ovnk_database_store/ovnkube-node-z586v_sbdb
2026-07-06T16:59:16.465682500Z INFO: Network log collection complete.
2026-07-06T16:59:16.505669016Z Wrote inspect data to must-gather.
2026-07-06T16:59:16.603685915Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:16.658726852Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-06T16:59:16.777388112Z INFO: Getting status from alertmanager-main-0
2026-07-06T16:59:16.840710593Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:16.841230231Z Wrote inspect data to must-gather.
2026-07-06T16:59:16.844613241Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-07-06T16:59:16.878662919Z Gathering data for ns/openshift-network-console...
2026-07-06T16:59:17.093269870Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:17.146750758Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-07-06T16:59:17.149970574Z INFO: Fallback to identify the container image from release info
2026-07-06T16:59:17.319287102Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:17.322173500Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-07-06T16:59:17.413201581Z Gathering data for ns/openshift-console-operator...
2026-07-06T16:59:17.507954454Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:17.710134669Z Wrote inspect data to /must-gather/istio.
2026-07-06T16:59:17.824688845Z Gathering data for ns/openshift-console...
2026-07-06T16:59:17.936338448Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5be8cdcf34f35a89a70b6bfa49e66897641871237570b3e09766f83a0a473e6a
2026-07-06T16:59:18.080270709Z daemonset.apps/perf-node-gather-daemonset created
2026-07-06T16:59:18.235481402Z Waiting for performance profile collector pods to become ready: 1
2026-07-06T16:59:18.459177450Z Gathering data for ns/openshift-cluster-storage-operator...
2026-07-06T16:59:18.480820037Z Done executing Istio gather script
2026-07-06T16:59:18.636238230Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-06T16:59:18.991669494Z Gathering data for ns/openshift-dns-operator...
2026-07-06T16:59:19.302852591Z Gathering data for ns/openshift-dns...
2026-07-06T16:59:19.362467440Z Waiting for performance profile collector pods to become ready: 2
2026-07-06T16:59:20.022455487Z Gathering data for ns/openshift-image-registry...
2026-07-06T16:59:20.487568407Z Waiting for performance profile collector pods to become ready: 3
2026-07-06T16:59:20.534604880Z Gathering data for ns/openshift-ingress-operator...
2026-07-06T16:59:20.874446098Z Gathering data for ns/openshift-ingress...
2026-07-06T16:59:21.239196810Z Gathering data for ns/openshift-ingress-canary...
2026-07-06T16:59:21.625900789Z Waiting for performance profile collector pods to become ready: 4
2026-07-06T16:59:21.677224886Z Gathering data for ns/openshift-insights...
2026-07-06T16:59:22.749867162Z Waiting for performance profile collector pods to become ready: 5
2026-07-06T16:59:23.641209435Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-06T16:59:23.662228878Z Gathering data for ns/openshift-config...
2026-07-06T16:59:23.864062517Z Waiting for performance profile collector pods to become ready: 6
2026-07-06T16:59:24.018271083Z Gathering data for ns/openshift-config-managed...
2026-07-06T16:59:24.436422605Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-07-06T16:59:24.734397566Z Gathering data for ns/openshift-kube-apiserver...
2026-07-06T16:59:25.002647121Z Waiting for performance profile collector pods to become ready: 7
2026-07-06T16:59:25.028432917Z Gathering data for ns/openshift-kube-controller-manager...
2026-07-06T16:59:25.383322235Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-07-06T16:59:25.691436805Z Gathering data for ns/openshift-kube-scheduler...
2026-07-06T16:59:25.974150674Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-07-06T16:59:26.128747263Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-07-06T16:59:26.321819427Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-07-06T16:59:26.427256376Z Collecting performance related data for node ip-10-0-128-105.ec2.internal
2026-07-06T16:59:26.439302846Z Collecting performance related data for node ip-10-0-130-189.ec2.internal
2026-07-06T16:59:26.451443670Z Collecting performance related data for node ip-10-0-143-171.ec2.internal
2026-07-06T16:59:26.746512861Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-07-06T16:59:27.151753257Z Gathering data for ns/openshift-user-workload-monitoring...
2026-07-06T16:59:27.838419006Z Gathering data for ns/openshift-multus...
2026-07-06T16:59:28.646436432Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-06T16:59:29.583753876Z Gathering data for ns/openshift-ovn-kubernetes...
2026-07-06T16:59:30.975183623Z Gathering data for ns/openshift-host-network...
2026-07-06T16:59:31.340133843Z Gathering data for ns/openshift-network-diagnostics...
2026-07-06T16:59:31.932090408Z Gathering data for ns/openshift-network-node-identity...
2026-07-06T16:59:32.428942380Z Gathering data for ns/openshift-network-operator...
2026-07-06T16:59:32.874897204Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-07-06T16:59:33.163826974Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-07-06T16:59:33.652357722Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-06T16:59:33.797367659Z Gathering data for ns/openshift-apiserver-operator...
2026-07-06T16:59:34.214366765Z Gathering data for ns/openshift-apiserver...
2026-07-06T16:59:34.640292453Z Gathering data for ns/openshift-controller-manager-operator...
2026-07-06T16:59:34.947360612Z Gathering data for ns/openshift-controller-manager...
2026-07-06T16:59:35.243048733Z Gathering data for ns/openshift-cluster-samples-operator...
2026-07-06T16:59:35.450845425Z Collecting kubelet logs for node ip-10-0-128-105.ec2.internal
2026-07-06T16:59:35.453588185Z Collecting kubelet logs for node ip-10-0-130-189.ec2.internal
2026-07-06T16:59:35.455994122Z Collecting kubelet logs for node ip-10-0-143-171.ec2.internal
2026-07-06T16:59:35.813465706Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-sxwq5 namespace
2026-07-06T16:59:35.819229182Z INFO: Node performance data collection complete.
2026-07-06T16:59:35.995194120Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-07-06T16:59:36.310300070Z Gathering data for ns/openshift-service-ca-operator...
2026-07-06T16:59:36.699946968Z Gathering data for ns/openshift-service-ca...
2026-07-06T16:59:37.102318232Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-07-06T16:59:38.027431631Z Wrote inspect data to must-gather.
2026-07-06T16:59:38.027484065Z error: inspection completed with the errors occurred while gathering data:
2026-07-06T16:59:38.027484065Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-07-06T16:59:38.178376670Z error: the server doesn't have a resource type "clusters"
2026-07-06T16:59:38.357715657Z Caches written to disk