2026-09-17T07:45:53.271537218Z [disk usage checker] Started
2026-09-17T07:45:53.274881806Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-09-17T07:45:53.489451712Z Gathering data for ns/openshift-cluster-version...
2026-09-17T07:45:53.652948486Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T07:45:53.783339050Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T07:45:53.884215783Z Gathering data for ns/default...
2026-09-17T07:45:54.323877090Z Gathering data for ns/openshift...
2026-09-17T07:45:54.810392003Z Gathering data for ns/kube-system...
2026-09-17T07:45:55.650707371Z Gathering data for ns/openshift-etcd...
2026-09-17T07:45:55.928286034Z Waiting on subprocesses to finish execution.
2026-09-17T07:45:55.934292241Z INFO: Gathering HAProxy config files
2026-09-17T07:45:55.935459282Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T07:45:55.936124482Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T07:45:55.943507564Z INFO: Collecting host service logs for crio
2026-09-17T07:45:55.943754473Z INFO: Collecting host service logs for kubelet
2026-09-17T07:45:55.944122596Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T07:45:55.944303464Z Executing Istio gather script
2026-09-17T07:45:55.944531739Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T07:45:55.944874137Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T07:45:55.945208923Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T07:45:55.945576215Z INFO: Collecting host service logs for NetworkManager
2026-09-17T07:45:55.945910865Z INFO: Collecting host service logs for openvswitch
2026-09-17T07:45:55.946295996Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T07:45:55.946808244Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T07:45:55.947148760Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T07:45:55.947580115Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T07:45:55.960014799Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T07:45:56.083321153Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T07:45:56.207830869Z Wrote inspect data to must-gather.
2026-09-17T07:45:56.207880109Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T07:45:56.207880109Z     namespaces "assisted-installer" not found
2026-09-17T07:45:56.362345469Z No resources found in openshift-etcd namespace.
2026-09-17T07:45:56.713070752Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T07:45:56.750356520Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T07:45:57.033841235Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T07:45:57.033873352Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T07:45:57.039281937Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T07:45:57.115129409Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T07:45:57.204283048Z No resources found
2026-09-17T07:45:57.259064055Z INFO: Collecting Insights Archives from insights-operator-5844b856db-vf5kk
2026-09-17T07:45:57.259111937Z insights-runtime-extractor-kh647
2026-09-17T07:45:57.259145432Z insights-runtime-extractor-pjqj6
2026-09-17T07:45:57.259164904Z insights-runtime-extractor-vwjtl
2026-09-17T07:45:57.276407588Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T07:45:57.358187028Z Wrote inspect data to must-gather.
2026-09-17T07:45:57.433842191Z INFO: Worker host service log collection to complete.
2026-09-17T07:45:57.519028201Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T07:45:57.838587794Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T07:45:57.937608062Z Wrote inspect data to must-gather.
2026-09-17T07:45:58.019305635Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T07:45:58.019305635Z See 'oc rsync -h' for help and examples
2026-09-17T07:45:58.080439313Z ERROR: No running kube-apiserver pods found
2026-09-17T07:45:58.157678762Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T07:45:58.204211257Z Wrote inspect data to must-gather.
2026-09-17T07:45:58.251547802Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T07:45:58.387160934Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-09-17T07:45:58.436544052Z Wrote inspect data to must-gather.
2026-09-17T07:45:58.444653842Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T07:45:58.460336825Z INFO: 'previous-logs' folder not found on ip-10-0-129-176.ec2.internal, skipping...
2026-09-17T07:45:58.503625006Z Gathering data for ns/openshift-monitoring...
2026-09-17T07:45:58.531180601Z No resources found
2026-09-17T07:45:58.543664499Z Wrote inspect data to must-gather.
2026-09-17T07:45:58.553679553Z Wrote inspect data to must-gather.
2026-09-17T07:45:58.608370537Z tar: Removing leading `/' from member names
2026-09-17T07:45:58.616666957Z INFO: HAProxy config collection complete.
2026-09-17T07:45:58.699028106Z Wrote inspect data to must-gather.
2026-09-17T07:45:58.765615329Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T07:45:58.811030614Z INFO: 'previous-logs' folder not found on ip-10-0-135-125.ec2.internal, skipping...
2026-09-17T07:45:58.840635357Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T07:45:58.949181889Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T07:45:59.017546306Z Wrote inspect data to must-gather.
2026-09-17T07:45:59.082985691Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T07:45:59.103729971Z INFO: 'previous-logs' folder not found on ip-10-0-136-118.ec2.internal, skipping...
2026-09-17T07:45:59.103763507Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T07:45:59.103763507Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T07:45:59.188478685Z Wrote inspect data to must-gather.
2026-09-17T07:45:59.276062688Z Wrote inspect data to must-gather.
2026-09-17T07:45:59.285503579Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T07:45:59.363262007Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T07:45:59.525876195Z Wrote inspect data to must-gather.
2026-09-17T07:45:59.577292228Z Wrote inspect data to must-gather.
2026-09-17T07:45:59.706805870Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T07:45:59.794047127Z Wrote inspect data to must-gather.
2026-09-17T07:45:59.811785336Z INFO: INTERCONNECT MODE
2026-09-17T07:45:59.811822127Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T07:45:59.956838554Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T07:45:59.957757177Z INFO: Gathering OVN_Northbound from ovnkube-node-qfqrw...
2026-09-17T07:45:59.958037495Z INFO: Gathering OVN_Northbound from ovnkube-node-rf22p...
2026-09-17T07:45:59.958286060Z INFO: Gathering OVN_Northbound from ovnkube-node-tlczx...
2026-09-17T07:45:59.958637034Z INFO: Gathering OVN_Southbound from ovnkube-node-qfqrw...
2026-09-17T07:45:59.958883737Z INFO: Gathering OVN_Southbound from ovnkube-node-rf22p...
2026-09-17T07:45:59.959158512Z INFO: Gathering OVN_Southbound from ovnkube-node-tlczx...
2026-09-17T07:46:00.040303378Z Wrote inspect data to must-gather.
2026-09-17T07:46:00.128259317Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T07:46:00.280048825Z tar: Removing leading `/' from member names
2026-09-17T07:46:00.285580657Z tar: Removing leading `/' from member names
2026-09-17T07:46:00.298019011Z tar: Removing leading `/' from member names
2026-09-17T07:46:00.318115430Z tar: Removing leading `/' from member names
2026-09-17T07:46:00.324813058Z tar: Removing leading `/' from member names
2026-09-17T07:46:00.324928822Z tar: Removing leading `/' from member names
2026-09-17T07:46:00.326884654Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T07:46:00.401287317Z Wrote inspect data to must-gather.
2026-09-17T07:46:00.410391113Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:00.491949951Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T07:46:00.598346377Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T07:46:00.659260425Z Wrote inspect data to must-gather.
2026-09-17T07:46:00.674686737Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:00.677425876Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T07:46:00.844172146Z INFO: Waiting for network log collection to complete ...
2026-09-17T07:46:00.844321079Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T07:46:00.844835926Z INFO: Copying ovnk databases complete.
2026-09-17T07:46:00.846663075Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-09-17T07:46:00.849002896Z ovnk_database_store/
2026-09-17T07:46:00.849067740Z ovnk_database_store/ovnkube-node-qfqrw_sbdb
2026-09-17T07:46:00.868334344Z ovnk_database_store/ovnkube-node-qfqrw_nbdb
2026-09-17T07:46:00.875711422Z ovnk_database_store/ovnkube-node-rf22p_sbdb
2026-09-17T07:46:00.893430024Z ovnk_database_store/ovnkube-node-tlczx_nbdb
2026-09-17T07:46:00.899415420Z ovnk_database_store/ovnkube-node-tlczx_sbdb
2026-09-17T07:46:00.906300194Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:00.910208289Z Wrote inspect data to must-gather.
2026-09-17T07:46:00.914755590Z ovnk_database_store/ovnkube-node-rf22p_nbdb
2026-09-17T07:46:00.924963683Z INFO: Network log collection complete.
2026-09-17T07:46:01.031372727Z INFO: Getting status from alertmanager-main-0
2026-09-17T07:46:01.130693099Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:01.133826999Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T07:46:01.139554480Z W0917 07:46:01.139512    1516 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-17T07:46:01.148378768Z Wrote inspect data to must-gather.
2026-09-17T07:46:01.174690690Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T07:46:01.340254973Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:01.387178708Z Gathering data for ns/openshift-network-console...
2026-09-17T07:46:01.414947487Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T07:46:01.417269574Z INFO: Fallback to identify the container image from release info
2026-09-17T07:46:01.541392481Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:01.543933696Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T07:46:01.737290104Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:01.939198943Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:01.942026999Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T07:46:01.945904057Z Gathering data for ns/openshift-console-operator...
2026-09-17T07:46:02.077310248Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-17T07:46:02.122476341Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:02.193336029Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T07:46:02.319661007Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:46:02.332777361Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T07:46:02.441870376Z Gathering data for ns/openshift-console...
2026-09-17T07:46:02.993367325Z Done executing Istio gather script
2026-09-17T07:46:03.067672598Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T07:46:03.414685438Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-09-17T07:46:03.454271217Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T07:46:03.748324495Z Gathering data for ns/openshift-dns-operator...
2026-09-17T07:46:04.231345960Z Gathering data for ns/openshift-dns...
2026-09-17T07:46:04.560442913Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T07:46:05.085629049Z Gathering data for ns/openshift-image-registry...
2026-09-17T07:46:05.671474467Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T07:46:05.768271718Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T07:46:06.148924408Z Gathering data for ns/openshift-ingress...
2026-09-17T07:46:06.551698242Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T07:46:06.785522425Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T07:46:07.007180195Z Gathering data for ns/openshift-insights...
2026-09-17T07:46:07.898905952Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T07:46:08.419424189Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-09-17T07:46:09.013809665Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T07:46:09.041515154Z Gathering data for ns/openshift-jobset-operator...
2026-09-17T07:46:10.018897258Z Gathering data for ns/openshift-config...
2026-09-17T07:46:10.136943720Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T07:46:10.375306949Z Collecting performance related data for node ip-10-0-136-118.ec2.internal
2026-09-17T07:46:10.382677756Z Collecting performance related data for node ip-10-0-129-176.ec2.internal
2026-09-17T07:46:10.392658000Z Collecting performance related data for node ip-10-0-135-125.ec2.internal
2026-09-17T07:46:10.435502385Z Gathering data for ns/openshift-config-managed...
2026-09-17T07:46:11.156165653Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T07:46:11.608777480Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T07:46:12.033204253Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T07:46:12.470824856Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T07:46:12.934486960Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T07:46:13.297378819Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T07:46:13.424124692Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-09-17T07:46:13.711896532Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T07:46:14.149964456Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T07:46:14.547821447Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T07:46:15.235338961Z Gathering data for ns/openshift-multus...
2026-09-17T07:46:16.920354977Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T07:46:18.429869472Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-09-17T07:46:18.461544144Z Collecting kubelet logs for node ip-10-0-136-118.ec2.internal
2026-09-17T07:46:18.462557272Z Gathering data for ns/openshift-host-network...
2026-09-17T07:46:18.463555291Z Collecting kubelet logs for node ip-10-0-129-176.ec2.internal
2026-09-17T07:46:18.465669948Z Collecting kubelet logs for node ip-10-0-135-125.ec2.internal
2026-09-17T07:46:18.847049073Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-n588s namespace
2026-09-17T07:46:18.854899814Z INFO: Node performance data collection complete.
2026-09-17T07:46:18.867810647Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T07:46:19.495296303Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T07:46:20.011153444Z Gathering data for ns/openshift-network-operator...
2026-09-17T07:46:20.521984193Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T07:46:20.879723319Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T07:46:21.463752704Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T07:46:21.873876220Z Gathering data for ns/openshift-apiserver...
2026-09-17T07:46:22.400357958Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T07:46:22.792990482Z Gathering data for ns/openshift-controller-manager...
2026-09-17T07:46:23.196095216Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T07:46:23.436974452Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-09-17T07:46:23.933722504Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T07:46:24.283060811Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T07:46:24.686781393Z Gathering data for ns/openshift-service-ca...
2026-09-17T07:46:25.149104640Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T07:46:26.199670093Z Wrote inspect data to must-gather.
2026-09-17T07:46:26.199720780Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T07:46:26.199720780Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T07:46:26.326462999Z error: the server doesn't have a resource type "clusters"
2026-09-17T07:46:26.459503896Z Caches written to disk