2026-07-02T15:06:03.613967505Z [disk usage checker] Started
2026-07-02T15:06:03.617461202Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-02T15:06:03.812192228Z Gathering data for ns/openshift-cluster-version...
2026-07-02T15:06:03.960817606Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-02T15:06:04.070563897Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-02T15:06:04.174067715Z Gathering data for ns/default...
2026-07-02T15:06:04.521318926Z Gathering data for ns/openshift...
2026-07-02T15:06:05.038028356Z Gathering data for ns/kube-system...
2026-07-02T15:06:06.056677362Z Gathering data for ns/openshift-etcd...
2026-07-02T15:06:06.440690734Z Waiting on subprocesses to finish execution.
2026-07-02T15:06:06.447441076Z INFO: Gathering machine config daemon's old logs from all nodes
2026-07-02T15:06:06.448090785Z Executing Istio gather script
2026-07-02T15:06:06.448683805Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-07-02T15:06:06.468860109Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-07-02T15:06:06.469817905Z INFO: Collecting host service logs for crio
2026-07-02T15:06:06.470177903Z INFO: Collecting host service logs for kubelet
2026-07-02T15:06:06.470516675Z INFO: Collecting host service logs for rpm-ostreed
2026-07-02T15:06:06.470858446Z INFO: Collecting host service logs for ostree-finalize-staged
2026-07-02T15:06:06.471202530Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-07-02T15:06:06.471529955Z INFO: Collecting host service logs for machine-config-daemon-host
2026-07-02T15:06:06.471869465Z INFO: Collecting host service logs for NetworkManager
2026-07-02T15:06:06.472199315Z INFO: Collecting host service logs for openvswitch
2026-07-02T15:06:06.472516861Z INFO: Collecting host service logs for ovs-configuration
2026-07-02T15:06:06.472876713Z INFO: Collecting host service logs for ovsdb-server
2026-07-02T15:06:06.473233225Z INFO: Collecting host service logs for ovs-vswitchd
2026-07-02T15:06:06.473614666Z INFO: Waiting for worker host service log collection to complete ...
2026-07-02T15:06:06.555790200Z INFO: Gathering HAProxy config files
2026-07-02T15:06:06.629111662Z INFO: Waiting for node performance related collection to complete ...
2026-07-02T15:06:06.650984888Z Wrote inspect data to must-gather.
2026-07-02T15:06:06.651023501Z error: inspection completed with the errors occurred while gathering data:
2026-07-02T15:06:06.651023501Z     namespaces "assisted-installer" not found
2026-07-02T15:06:06.906869431Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-07-02T15:06:06.912038949Z INFO: "sriov-network-operator" not detected. Skipping.
2026-07-02T15:06:07.420469070Z INFO: "metallb-operator" not detected. Skipping.
2026-07-02T15:06:07.527463474Z INFO: Collecting Insights Archives from insights-operator-5f67b55555-fsmx9
2026-07-02T15:06:07.527527940Z insights-runtime-extractor-bmcqq
2026-07-02T15:06:07.527549834Z insights-runtime-extractor-h4l85
2026-07-02T15:06:07.527570151Z insights-runtime-extractor-sh7pn
2026-07-02T15:06:07.786250401Z No resources found
2026-07-02T15:06:07.793551601Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-07-02T15:06:07.827865177Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-07-02T15:06:07.827901676Z INFO: on-disk MachineConfig config collection complete.
2026-07-02T15:06:07.954228186Z INFO: 'previous-logs' folder not found on ip-10-0-134-54.ec2.internal, skipping...
2026-07-02T15:06:07.966286387Z No resources found in openshift-etcd namespace.
2026-07-02T15:06:07.999768755Z error: the server doesn't have a resource type "performanceprofile"
2026-07-02T15:06:08.040914113Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-07-02T15:06:08.040914113Z See 'oc rsync -h' for help and examples
2026-07-02T15:06:08.053324935Z Wrote inspect data to must-gather.
2026-07-02T15:06:08.066280278Z Wrote inspect data to must-gather.
2026-07-02T15:06:08.069320779Z INFO: Found 1 replicas - prometheus-k8s-0
2026-07-02T15:06:08.168164584Z ERROR: No running kube-apiserver pods found
2026-07-02T15:06:08.171852362Z INFO: Worker host service log collection to complete.
2026-07-02T15:06:08.653097179Z INFO: Waiting for HAProxy config collection to complete ...
2026-07-02T15:06:08.703214500Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-02T15:06:08.713571043Z Wrote inspect data to must-gather.
2026-07-02T15:06:08.745163315Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-07-02T15:06:08.842448063Z INFO: 'previous-logs' folder not found on ip-10-0-143-132.ec2.internal, skipping...
2026-07-02T15:06:08.881885124Z Gathering data for ns/openshift-monitoring...
2026-07-02T15:06:08.901883339Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-07-02T15:06:08.921681110Z Wrote inspect data to must-gather.
2026-07-02T15:06:09.098174677Z Wrote inspect data to must-gather.
2026-07-02T15:06:09.117945351Z No resources found
2026-07-02T15:06:09.168504135Z Wrote inspect data to must-gather.
2026-07-02T15:06:09.260886900Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-02T15:06:09.377335972Z tar: Removing leading `/' from member names
2026-07-02T15:06:09.381138165Z Wrote inspect data to must-gather.
2026-07-02T15:06:09.386721360Z INFO: HAProxy config collection complete.
2026-07-02T15:06:09.443370368Z INFO: 'previous-logs' folder not found on ip-10-0-143-249.ec2.internal, skipping...
2026-07-02T15:06:09.443408119Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-07-02T15:06:09.443452704Z INFO: Machine Config Daemon termination log collection complete.
2026-07-02T15:06:09.450810373Z error: the server doesn't have a resource type "machineconfigs"
2026-07-02T15:06:09.626670801Z error: the server doesn't have a resource type "machineconfigpools"
2026-07-02T15:06:09.653848289Z Wrote inspect data to must-gather.
2026-07-02T15:06:09.661090507Z INFO: Getting rules from prometheus-k8s-0
2026-07-02T15:06:09.719444672Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-07-02T15:06:09.880065829Z Wrote inspect data to must-gather.
2026-07-02T15:06:09.920786841Z Wrote inspect data to must-gather.
2026-07-02T15:06:10.042607012Z error: the server doesn't have a resource type "kubeletconfigs"
2026-07-02T15:06:10.149793377Z INFO: Getting status/config from prometheus-k8s-0
2026-07-02T15:06:10.183530101Z Wrote inspect data to must-gather.
2026-07-02T15:06:10.289902367Z Wrote inspect data to must-gather.
2026-07-02T15:06:10.528795769Z INFO: INTERCONNECT MODE
2026-07-02T15:06:10.528839981Z INFO: Gathering ovn-kubernetes DBs
2026-07-02T15:06:10.550364899Z Wrote inspect data to must-gather.
2026-07-02T15:06:10.566207721Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-02T15:06:10.595838030Z INFO: Getting status/flags from prometheus-k8s-0
2026-07-02T15:06:10.709841375Z INFO: Gathering OVN_Northbound from ovnkube-node-6krdm...
2026-07-02T15:06:10.710141762Z INFO: Gathering OVN_Northbound from ovnkube-node-m7grd...
2026-07-02T15:06:10.710422557Z INFO: Gathering OVN_Northbound from ovnkube-node-zphb6...
2026-07-02T15:06:10.710746852Z INFO: Gathering OVN_Southbound from ovnkube-node-6krdm...
2026-07-02T15:06:10.711039362Z INFO: Gathering OVN_Southbound from ovnkube-node-m7grd...
2026-07-02T15:06:10.711311514Z INFO: Gathering OVN_Southbound from ovnkube-node-zphb6...
2026-07-02T15:06:10.835504491Z Wrote inspect data to must-gather.
2026-07-02T15:06:10.955875987Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-07-02T15:06:11.045112429Z tar: Removing leading `/' from member names
2026-07-02T15:06:11.051640972Z tar: Removing leading `/' from member names
2026-07-02T15:06:11.103027686Z tar: Removing leading `/' from member names
2026-07-02T15:06:11.112317629Z tar: Removing leading `/' from member names
2026-07-02T15:06:11.126516409Z tar: Removing leading `/' from member names
2026-07-02T15:06:11.127586662Z tar: Removing leading `/' from member names
2026-07-02T15:06:11.195283986Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-07-02T15:06:11.195840894Z Wrote inspect data to must-gather.
2026-07-02T15:06:11.335317424Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-07-02T15:06:11.441046324Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-02T15:06:11.448475945Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:11.570009986Z Wrote inspect data to must-gather.
2026-07-02T15:06:11.631849942Z INFO: Waiting for network log collection to complete ...
2026-07-02T15:06:11.631901336Z INFO: Waiting for ovnk database copies to complete ...
2026-07-02T15:06:11.632365108Z INFO: Copying ovnk databases complete.
2026-07-02T15:06:11.633606959Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-07-02T15:06:11.636729474Z 4.1M	must-gather/network_logs/ovnk_database_store
2026-07-02T15:06:11.646209546Z ovnk_database_store/
2026-07-02T15:06:11.646271522Z ovnk_database_store/ovnkube-node-m7grd_sbdb
2026-07-02T15:06:11.689013125Z ovnk_database_store/ovnkube-node-6krdm_nbdb
2026-07-02T15:06:11.701722750Z ovnk_database_store/ovnkube-node-zphb6_sbdb
2026-07-02T15:06:11.716838933Z Gathering data for ns/openshift-network-console...
2026-07-02T15:06:11.729226734Z ovnk_database_store/ovnkube-node-zphb6_nbdb
2026-07-02T15:06:11.737597831Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:11.740641133Z ovnk_database_store/ovnkube-node-6krdm_sbdb
2026-07-02T15:06:11.742096689Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-07-02T15:06:11.768432877Z ovnk_database_store/ovnkube-node-m7grd_nbdb
2026-07-02T15:06:11.784096016Z INFO: Network log collection complete.
2026-07-02T15:06:11.940194339Z Wrote inspect data to must-gather.
2026-07-02T15:06:11.975256588Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:12.108745820Z INFO: Getting status from alertmanager-main-0
2026-07-02T15:06:12.233151378Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:12.235502949Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-07-02T15:06:12.281541573Z Wrote inspect data to must-gather.
2026-07-02T15:06:12.308840159Z Gathering data for ns/openshift-console-operator...
2026-07-02T15:06:12.455688505Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:12.557841705Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-07-02T15:06:12.560821748Z INFO: Fallback to identify the container image from release info
2026-07-02T15:06:12.647790066Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:12.651197441Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-07-02T15:06:12.765453321Z Gathering data for ns/openshift-console...
2026-07-02T15:06:12.861449081Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:13.045124483Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:13.047461569Z Inspecting resource crd/inferencemodelrewrites.inference.networking.x-k8s.io
2026-07-02T15:06:13.212475806Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:13.377698714Z Gathering data for ns/openshift-cluster-storage-operator...
2026-07-02T15:06:13.415908190Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:13.419090534Z Inspecting resource crd/inferenceobjectives.inference.networking.x-k8s.io
2026-07-02T15:06:13.591384031Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:13.698973900Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2c4f9949a07a5338dd10a5abcb8d6d3f5eebe93333139869f9eec8802800162f
2026-07-02T15:06:13.760966547Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-02T15:06:13.822297999Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:13.825041748Z Inspecting resource crd/inferencepoolimports.inference.networking.x-k8s.io
2026-07-02T15:06:13.848773611Z daemonset.apps/perf-node-gather-daemonset created
2026-07-02T15:06:13.982824817Z Gathering data for ns/openshift-dns-operator...
2026-07-02T15:06:14.017871071Z Waiting for performance profile collector pods to become ready: 1
2026-07-02T15:06:14.031628573Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:14.235490877Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:14.238279642Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-07-02T15:06:14.447886527Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:14.455496396Z Gathering data for ns/openshift-dns...
2026-07-02T15:06:14.616176777Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:14.618549696Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-07-02T15:06:14.786296648Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:14.962905124Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:14.965461044Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-07-02T15:06:15.153367936Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:15.163120391Z Waiting for performance profile collector pods to become ready: 2
2026-07-02T15:06:15.168563271Z Gathering data for ns/openshift-image-registry...
2026-07-02T15:06:15.333896202Z Wrote inspect data to /must-gather/istio.
2026-07-02T15:06:15.696486222Z Gathering data for ns/openshift-ingress-operator...
2026-07-02T15:06:16.017290206Z Done executing Istio gather script
2026-07-02T15:06:16.065893254Z Gathering data for ns/openshift-ingress...
2026-07-02T15:06:16.279587720Z Waiting for performance profile collector pods to become ready: 3
2026-07-02T15:06:16.414694046Z Gathering data for ns/openshift-ingress-canary...
2026-07-02T15:06:16.823388451Z Gathering data for ns/openshift-insights...
2026-07-02T15:06:17.422475189Z Waiting for performance profile collector pods to become ready: 4
2026-07-02T15:06:18.548785163Z Waiting for performance profile collector pods to become ready: 5
2026-07-02T15:06:18.768414957Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-02T15:06:19.061234033Z Gathering data for ns/kserve...
2026-07-02T15:06:19.673402840Z Waiting for performance profile collector pods to become ready: 6
2026-07-02T15:06:20.644389238Z Gathering data for ns/openshift-config...
2026-07-02T15:06:20.786869500Z Waiting for performance profile collector pods to become ready: 7
2026-07-02T15:06:20.961959758Z Gathering data for ns/openshift-config-managed...
2026-07-02T15:06:21.377608134Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-07-02T15:06:21.689528675Z Gathering data for ns/openshift-kube-apiserver...
2026-07-02T15:06:21.900839151Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-07-02T15:06:22.015765931Z Gathering data for ns/openshift-kube-controller-manager...
2026-07-02T15:06:22.174209743Z Collecting performance related data for node ip-10-0-143-249.ec2.internal
2026-07-02T15:06:22.180676009Z Collecting performance related data for node ip-10-0-143-132.ec2.internal
2026-07-02T15:06:22.189643366Z Collecting performance related data for node ip-10-0-134-54.ec2.internal
2026-07-02T15:06:22.375543137Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-07-02T15:06:22.778174717Z Gathering data for ns/openshift-kube-scheduler...
2026-07-02T15:06:23.126440977Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-07-02T15:06:23.533092328Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-07-02T15:06:23.773585948Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-02T15:06:23.940039242Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-07-02T15:06:24.251106359Z Gathering data for ns/openshift-user-workload-monitoring...
2026-07-02T15:06:24.825527073Z Gathering data for ns/openshift-multus...
2026-07-02T15:06:26.293111161Z Gathering data for ns/openshift-ovn-kubernetes...
2026-07-02T15:06:27.715061236Z Gathering data for ns/openshift-host-network...
2026-07-02T15:06:28.069421961Z Gathering data for ns/openshift-network-diagnostics...
2026-07-02T15:06:28.642098140Z Gathering data for ns/openshift-network-node-identity...
2026-07-02T15:06:28.778179714Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-02T15:06:29.162295317Z Gathering data for ns/openshift-network-operator...
2026-07-02T15:06:29.568811116Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-07-02T15:06:29.875474390Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-07-02T15:06:30.247805424Z Collecting kubelet logs for node ip-10-0-143-249.ec2.internal
2026-07-02T15:06:30.249741270Z Collecting kubelet logs for node ip-10-0-143-132.ec2.internal
2026-07-02T15:06:30.251385946Z Collecting kubelet logs for node ip-10-0-134-54.ec2.internal
2026-07-02T15:06:30.496459658Z Gathering data for ns/openshift-apiserver-operator...
2026-07-02T15:06:30.635754489Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-rvcf4 namespace
2026-07-02T15:06:30.644400613Z INFO: Node performance data collection complete.
2026-07-02T15:06:30.899469390Z Gathering data for ns/openshift-apiserver...
2026-07-02T15:06:31.299426224Z Gathering data for ns/openshift-controller-manager-operator...
2026-07-02T15:06:31.572848809Z Gathering data for ns/openshift-controller-manager...
2026-07-02T15:06:31.855821956Z Gathering data for ns/openshift-cluster-samples-operator...
2026-07-02T15:06:32.515970642Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-07-02T15:06:32.804275144Z Gathering data for ns/openshift-service-ca-operator...
2026-07-02T15:06:33.126353637Z Gathering data for ns/openshift-service-ca...
2026-07-02T15:06:33.505665430Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-07-02T15:06:33.783672376Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-07-02T15:06:34.429875772Z Wrote inspect data to must-gather.
2026-07-02T15:06:34.429921685Z error: inspection completed with the errors occurred while gathering data:
2026-07-02T15:06:34.429921685Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-07-02T15:06:34.557411615Z error: the server doesn't have a resource type "clusters"
2026-07-02T15:06:34.697945781Z Caches written to disk