2026-09-15T07:32:00.971093116Z [disk usage checker] Started
2026-09-15T07:32:00.974509314Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-15T07:32:01.161126094Z Gathering data for ns/openshift-cluster-version...
2026-09-15T07:32:01.281942929Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-15T07:32:01.363987486Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-15T07:32:01.437269121Z Gathering data for ns/default...
2026-09-15T07:32:01.735731190Z Gathering data for ns/openshift...
2026-09-15T07:32:02.106574067Z Gathering data for ns/kube-system...
2026-09-15T07:32:02.824535608Z Gathering data for ns/openshift-etcd...
2026-09-15T07:32:03.091387835Z Wrote inspect data to must-gather.
2026-09-15T07:32:03.091425209Z error: inspection completed with the errors occurred while gathering data:
2026-09-15T07:32:03.091425209Z     namespaces "assisted-installer" not found
2026-09-15T07:32:03.534588395Z Waiting on subprocesses to finish execution.
2026-09-15T07:32:03.543552838Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-15T07:32:03.550408470Z Executing Istio gather script
2026-09-15T07:32:03.557448857Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-15T07:32:03.557872611Z INFO: Gathering HAProxy config files
2026-09-15T07:32:03.561121703Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-15T07:32:03.572095606Z INFO: Collecting host service logs for crio
2026-09-15T07:32:03.572519703Z INFO: Collecting host service logs for kubelet
2026-09-15T07:32:03.572867665Z INFO: Collecting host service logs for rpm-ostreed
2026-09-15T07:32:03.573203473Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-15T07:32:03.573582024Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-15T07:32:03.573933528Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-15T07:32:03.574256256Z INFO: Collecting host service logs for NetworkManager
2026-09-15T07:32:03.574643944Z INFO: Collecting host service logs for openvswitch
2026-09-15T07:32:03.574996572Z INFO: Collecting host service logs for ovs-configuration
2026-09-15T07:32:03.575339011Z INFO: Collecting host service logs for ovsdb-server
2026-09-15T07:32:03.576283715Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-15T07:32:03.576734272Z INFO: Waiting for worker host service log collection to complete ...
2026-09-15T07:32:03.602546189Z INFO: Waiting for node performance related collection to complete ...
2026-09-15T07:32:04.060864894Z No resources found
2026-09-15T07:32:04.423537631Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-15T07:32:04.435293683Z Wrote inspect data to must-gather.
2026-09-15T07:32:04.774734802Z No resources found in openshift-etcd namespace.
2026-09-15T07:32:05.199031341Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-15T07:32:05.199130100Z INFO: on-disk MachineConfig config collection complete.
2026-09-15T07:32:05.346476829Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-15T07:32:05.424170213Z Wrote inspect data to must-gather.
2026-09-15T07:32:05.453983696Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-15T07:32:05.519956086Z INFO: Collecting Insights Archives from insights-operator-5844b856db-x9hvx
2026-09-15T07:32:05.519956086Z insights-runtime-extractor-5qlcb
2026-09-15T07:32:05.519956086Z insights-runtime-extractor-jmb6d
2026-09-15T07:32:05.519956086Z insights-runtime-extractor-rpmx4
2026-09-15T07:32:05.536906199Z INFO: "metallb-operator" not detected. Skipping.
2026-09-15T07:32:05.688479227Z No resources found
2026-09-15T07:32:05.692980598Z error: the server doesn't have a resource type "performanceprofile"
2026-09-15T07:32:05.713738177Z Wrote inspect data to must-gather.
2026-09-15T07:32:05.821776478Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-15T07:32:05.836292820Z INFO: 'previous-logs' folder not found on ip-10-0-129-10.ec2.internal, skipping...
2026-09-15T07:32:05.846194926Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-15T07:32:05.854660885Z Wrote inspect data to must-gather.
2026-09-15T07:32:05.855531976Z Gathering data for ns/openshift-monitoring...
2026-09-15T07:32:05.867727785Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-15T07:32:05.867727785Z See 'oc rsync -h' for help and examples
2026-09-15T07:32:05.870994230Z INFO: Worker host service log collection to complete.
2026-09-15T07:32:05.913467336Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-15T07:32:05.932073629Z Wrote inspect data to must-gather.
2026-09-15T07:32:06.000801180Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-15T07:32:06.030941469Z Wrote inspect data to must-gather.
2026-09-15T07:32:06.053852226Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-15T07:32:06.138096980Z ERROR: No running kube-apiserver pods found
2026-09-15T07:32:06.148958687Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-15T07:32:06.175390309Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-15T07:32:06.264517874Z Wrote inspect data to must-gather.
2026-09-15T07:32:06.309627734Z INFO: 'previous-logs' folder not found on ip-10-0-129-9.ec2.internal, skipping...
2026-09-15T07:32:06.357914267Z Wrote inspect data to must-gather.
2026-09-15T07:32:06.417198179Z INFO: HAProxy config collection complete.
2026-09-15T07:32:06.457744662Z error: the server doesn't have a resource type "machineconfigs"
2026-09-15T07:32:06.520756416Z INFO: Getting rules from prometheus-k8s-0
2026-09-15T07:32:06.596317711Z INFO: 'previous-logs' folder not found on ip-10-0-130-101.ec2.internal, skipping...
2026-09-15T07:32:06.596450806Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-15T07:32:06.596510810Z INFO: Machine Config Daemon termination log collection complete.
2026-09-15T07:32:06.633132909Z Wrote inspect data to must-gather.
2026-09-15T07:32:06.633164935Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-15T07:32:06.844498451Z Wrote inspect data to must-gather.
2026-09-15T07:32:06.868314085Z Wrote inspect data to must-gather.
2026-09-15T07:32:06.915722807Z INFO: Getting status/config from prometheus-k8s-0
2026-09-15T07:32:07.001491947Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-15T07:32:07.151241453Z INFO: INTERCONNECT MODE
2026-09-15T07:32:07.151340338Z INFO: Gathering ovn-kubernetes DBs
2026-09-15T07:32:07.208733810Z Wrote inspect data to must-gather.
2026-09-15T07:32:07.317283466Z INFO: Gathering OVN_Northbound from ovnkube-node-h7zjx...
2026-09-15T07:32:07.317589580Z INFO: Gathering OVN_Northbound from ovnkube-node-n92hd...
2026-09-15T07:32:07.317913794Z INFO: Gathering OVN_Northbound from ovnkube-node-qhqp6...
2026-09-15T07:32:07.318244228Z INFO: Gathering OVN_Southbound from ovnkube-node-h7zjx...
2026-09-15T07:32:07.318552005Z INFO: Gathering OVN_Southbound from ovnkube-node-n92hd...
2026-09-15T07:32:07.318821484Z INFO: Gathering OVN_Southbound from ovnkube-node-qhqp6...
2026-09-15T07:32:07.321880105Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-15T07:32:07.329766037Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-15T07:32:07.606994298Z Wrote inspect data to must-gather.
2026-09-15T07:32:07.640128592Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-15T07:32:07.661967521Z tar: Removing leading `/' from member names
2026-09-15T07:32:07.694830469Z tar: Removing leading `/' from member names
2026-09-15T07:32:07.704075208Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:07.714584711Z tar: Removing leading `/' from member names
2026-09-15T07:32:07.720592448Z tar: Removing leading `/' from member names
2026-09-15T07:32:07.745145268Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-15T07:32:07.745916891Z tar: Removing leading `/' from member names
2026-09-15T07:32:07.759406241Z tar: Removing leading `/' from member names
2026-09-15T07:32:07.884288941Z Wrote inspect data to must-gather.
2026-09-15T07:32:07.951496045Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:07.953866165Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-15T07:32:08.014301887Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-15T07:32:08.130558166Z Wrote inspect data to must-gather.
2026-09-15T07:32:08.193600938Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:08.243942789Z INFO: Waiting for network log collection to complete ...
2026-09-15T07:32:08.243985910Z INFO: Waiting for ovnk database copies to complete ...
2026-09-15T07:32:08.244474547Z INFO: Copying ovnk databases complete.
2026-09-15T07:32:08.246130825Z 3.4M	must-gather/network_logs/ovnk_database_store
2026-09-15T07:32:08.248386809Z ovnk_database_store/
2026-09-15T07:32:08.248413467Z ovnk_database_store/ovnkube-node-qhqp6_nbdb
2026-09-15T07:32:08.256442825Z ovnk_database_store/ovnkube-node-qhqp6_sbdb
2026-09-15T07:32:08.270090728Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-15T07:32:08.278166369Z ovnk_database_store/ovnkube-node-n92hd_nbdb
2026-09-15T07:32:08.287855411Z ovnk_database_store/ovnkube-node-h7zjx_nbdb
2026-09-15T07:32:08.294584028Z ovnk_database_store/ovnkube-node-n92hd_sbdb
2026-09-15T07:32:08.321713574Z ovnk_database_store/ovnkube-node-h7zjx_sbdb
2026-09-15T07:32:08.349919060Z INFO: Network log collection complete.
2026-09-15T07:32:08.389941354Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-15T07:32:08.441045895Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:08.444221746Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-15T07:32:08.484190481Z Wrote inspect data to must-gather.
2026-09-15T07:32:08.569921495Z Gathering data for ns/openshift-network-console...
2026-09-15T07:32:08.652165878Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:08.701269003Z INFO: Getting status from alertmanager-main-0
2026-09-15T07:32:08.773267265Z Wrote inspect data to must-gather.
2026-09-15T07:32:08.872155780Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:08.875453061Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-15T07:32:09.052131317Z Gathering data for ns/openshift-console-operator...
2026-09-15T07:32:09.068751071Z Wrote inspect data to must-gather.
2026-09-15T07:32:09.106014579Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:09.309142820Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:09.313197369Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-15T07:32:09.324656971Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-15T07:32:09.326822721Z INFO: Fallback to identify the container image from release info
2026-09-15T07:32:09.486693097Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:09.528475937Z Gathering data for ns/openshift-console...
2026-09-15T07:32:09.680944296Z Wrote inspect data to /must-gather/istio.
2026-09-15T07:32:10.034792123Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-15T07:32:10.038128573Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-15T07:32:10.171325322Z daemonset.apps/perf-node-gather-daemonset created
2026-09-15T07:32:10.294178434Z Waiting for performance profile collector pods to become ready: 1
2026-09-15T07:32:10.365969487Z Done executing Istio gather script
2026-09-15T07:32:10.581700593Z Gathering data for ns/openshift-dns-operator...
2026-09-15T07:32:10.852215449Z Gathering data for ns/openshift-dns...
2026-09-15T07:32:11.028861573Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-15T07:32:11.420016716Z Waiting for performance profile collector pods to become ready: 2
2026-09-15T07:32:11.430317455Z Gathering data for ns/openshift-image-registry...
2026-09-15T07:32:11.851874878Z Gathering data for ns/openshift-ingress-operator...
2026-09-15T07:32:12.153101497Z Gathering data for ns/openshift-ingress...
2026-09-15T07:32:12.449947869Z Gathering data for ns/openshift-ingress-canary...
2026-09-15T07:32:12.526855017Z Waiting for performance profile collector pods to become ready: 3
2026-09-15T07:32:12.800155006Z Gathering data for ns/openshift-insights...
2026-09-15T07:32:13.626302676Z Waiting for performance profile collector pods to become ready: 4
2026-09-15T07:32:14.733774069Z Gathering data for ns/openshift-config...
2026-09-15T07:32:14.737420393Z Waiting for performance profile collector pods to become ready: 5
2026-09-15T07:32:14.963820239Z Gathering data for ns/openshift-config-managed...
2026-09-15T07:32:15.351924510Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-15T07:32:15.627226729Z Gathering data for ns/openshift-kube-apiserver...
2026-09-15T07:32:15.865458926Z Waiting for performance profile collector pods to become ready: 6
2026-09-15T07:32:15.872692679Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-15T07:32:16.033387867Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-15T07:32:16.131542471Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-15T07:32:16.381410662Z Gathering data for ns/openshift-kube-scheduler...
2026-09-15T07:32:16.604509366Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-15T07:32:16.858060957Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-15T07:32:16.987385979Z Waiting for performance profile collector pods to become ready: 7
2026-09-15T07:32:17.157731616Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-15T07:32:17.432525724Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-15T07:32:17.949708477Z Gathering data for ns/openshift-multus...
2026-09-15T07:32:18.093161212Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-15T07:32:18.314447882Z Collecting performance related data for node ip-10-0-129-10.ec2.internal
2026-09-15T07:32:18.322264841Z Collecting performance related data for node ip-10-0-130-101.ec2.internal
2026-09-15T07:32:18.329827335Z Collecting performance related data for node ip-10-0-129-9.ec2.internal
2026-09-15T07:32:19.416904493Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-15T07:32:20.715838653Z Gathering data for ns/openshift-host-network...
2026-09-15T07:32:21.041680970Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-15T07:32:21.044059182Z Gathering data for ns/openshift-network-diagnostics...
2026-09-15T07:32:21.580943408Z Gathering data for ns/openshift-network-node-identity...
2026-09-15T07:32:21.959346504Z Gathering data for ns/openshift-network-operator...
2026-09-15T07:32:22.394172921Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-15T07:32:22.689482143Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-15T07:32:23.148808855Z Gathering data for ns/openshift-apiserver-operator...
2026-09-15T07:32:23.419506157Z Gathering data for ns/openshift-apiserver...
2026-09-15T07:32:23.788288577Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-15T07:32:24.030628265Z Gathering data for ns/openshift-controller-manager...
2026-09-15T07:32:24.284748725Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-15T07:32:24.891640012Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-15T07:32:25.167743292Z Gathering data for ns/openshift-service-ca-operator...
2026-09-15T07:32:25.456906787Z Gathering data for ns/openshift-service-ca...
2026-09-15T07:32:25.800389358Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-15T07:32:26.049014792Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-15T07:32:26.243702606Z Collecting kubelet logs for node ip-10-0-129-10.ec2.internal
2026-09-15T07:32:26.246752534Z Collecting kubelet logs for node ip-10-0-130-101.ec2.internal
2026-09-15T07:32:26.248637201Z Collecting kubelet logs for node ip-10-0-129-9.ec2.internal
2026-09-15T07:32:26.592515921Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-vt6rc namespace
2026-09-15T07:32:26.597080468Z INFO: Node performance data collection complete.
2026-09-15T07:32:26.702383314Z Wrote inspect data to must-gather.
2026-09-15T07:32:26.702432215Z error: inspection completed with the errors occurred while gathering data:
2026-09-15T07:32:26.702432215Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-15T07:32:26.838708158Z error: the server doesn't have a resource type "clusters"
2026-09-15T07:32:26.978270218Z Caches written to disk