2026-09-17T19:21:35.537673454Z [disk usage checker] Started
2026-09-17T19:21:35.541069610Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T19:21:35.749183637Z Gathering data for ns/openshift-cluster-version...
2026-09-17T19:21:35.966903531Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T19:21:36.133023165Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:21:36.236143314Z Gathering data for ns/default...
2026-09-17T19:21:36.833388123Z Gathering data for ns/openshift...
2026-09-17T19:21:37.367603666Z Gathering data for ns/kube-system...
2026-09-17T19:21:38.443489061Z Gathering data for ns/openshift-etcd...
2026-09-17T19:21:38.465706772Z Waiting on subprocesses to finish execution.
2026-09-17T19:21:38.473131605Z INFO: Collecting host service logs for crio
2026-09-17T19:21:38.473467612Z INFO: Collecting host service logs for kubelet
2026-09-17T19:21:38.473794305Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T19:21:38.474238948Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T19:21:38.474575008Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T19:21:38.474898888Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T19:21:38.475239500Z INFO: Collecting host service logs for NetworkManager
2026-09-17T19:21:38.475580356Z INFO: Collecting host service logs for openvswitch
2026-09-17T19:21:38.475918078Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T19:21:38.476291062Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T19:21:38.476637479Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T19:21:38.477039188Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T19:21:38.478270498Z Executing Istio gather script
2026-09-17T19:21:38.481517525Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T19:21:38.482727278Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T19:21:38.486271476Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T19:21:38.501299588Z INFO: Gathering HAProxy config files
2026-09-17T19:21:38.756927955Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T19:21:39.115022930Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T19:21:39.115140258Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T19:21:39.304544133Z No resources found in openshift-etcd namespace.
2026-09-17T19:21:39.475563754Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-8kmsh
2026-09-17T19:21:39.475628885Z insights-runtime-extractor-5dzcf
2026-09-17T19:21:39.475652358Z insights-runtime-extractor-9rvsm
2026-09-17T19:21:39.475673175Z insights-runtime-extractor-tlbhh
2026-09-17T19:21:39.739519609Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T19:21:39.755119396Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T19:21:39.776208549Z Wrote inspect data to must-gather.
2026-09-17T19:21:39.776292579Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T19:21:39.776292579Z     namespaces "assisted-installer" not found
2026-09-17T19:21:39.857546811Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T19:21:39.898559494Z No resources found
2026-09-17T19:21:39.945370549Z INFO: Worker host service log collection to complete.
2026-09-17T19:21:39.959379098Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T19:21:40.049683300Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T19:21:40.127028439Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T19:21:40.127028439Z See 'oc rsync -h' for help and examples
2026-09-17T19:21:40.131394924Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T19:21:40.317948469Z Wrote inspect data to must-gather.
2026-09-17T19:21:40.321615108Z ERROR: No running kube-apiserver pods found
2026-09-17T19:21:40.328464362Z Wrote inspect data to must-gather.
2026-09-17T19:21:40.331567721Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T19:21:40.640280802Z Gathering data for ns/openshift-monitoring...
2026-09-17T19:21:40.719760760Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T19:21:40.853842826Z No resources found
2026-09-17T19:21:40.917455591Z Wrote inspect data to must-gather.
2026-09-17T19:21:40.980530688Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T19:21:40.984187745Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T19:21:41.134833914Z INFO: 'previous-logs' folder not found on ip-10-0-131-128.ec2.internal, skipping...
2026-09-17T19:21:41.226685041Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:21:41.406916149Z Wrote inspect data to must-gather.
2026-09-17T19:21:41.426107276Z Wrote inspect data to must-gather.
2026-09-17T19:21:41.437772367Z Wrote inspect data to must-gather.
2026-09-17T19:21:41.450270114Z Wrote inspect data to must-gather.
2026-09-17T19:21:41.526387385Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T19:21:41.527409882Z tar: Removing leading `/' from member names
2026-09-17T19:21:41.538008644Z INFO: HAProxy config collection complete.
2026-09-17T19:21:41.634006659Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T19:21:41.701029440Z INFO: 'previous-logs' folder not found on ip-10-0-132-9.ec2.internal, skipping...
2026-09-17T19:21:41.729013843Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T19:21:41.748317703Z Wrote inspect data to must-gather.
2026-09-17T19:21:41.970014139Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T19:21:41.996911647Z INFO: 'previous-logs' folder not found on ip-10-0-143-106.ec2.internal, skipping...
2026-09-17T19:21:41.996953715Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T19:21:41.996983412Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T19:21:42.009778083Z Wrote inspect data to must-gather.
2026-09-17T19:21:42.056844056Z Wrote inspect data to must-gather.
2026-09-17T19:21:42.110795049Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T19:21:42.173555707Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T19:21:42.336102407Z Wrote inspect data to must-gather.
2026-09-17T19:21:42.443535733Z Wrote inspect data to must-gather.
2026-09-17T19:21:42.489755753Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T19:21:42.567905598Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T19:21:42.702504682Z Wrote inspect data to must-gather.
2026-09-17T19:21:42.709650242Z INFO: INTERCONNECT MODE
2026-09-17T19:21:42.709782043Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T19:21:42.840963743Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T19:21:42.882517197Z INFO: Gathering OVN_Northbound from ovnkube-node-d5bqq...
2026-09-17T19:21:42.882822855Z INFO: Gathering OVN_Northbound from ovnkube-node-gbgqb...
2026-09-17T19:21:42.883139347Z INFO: Gathering OVN_Northbound from ovnkube-node-pfr6v...
2026-09-17T19:21:42.883466820Z INFO: Gathering OVN_Southbound from ovnkube-node-d5bqq...
2026-09-17T19:21:42.883761773Z INFO: Gathering OVN_Southbound from ovnkube-node-gbgqb...
2026-09-17T19:21:42.884068941Z INFO: Gathering OVN_Southbound from ovnkube-node-pfr6v...
2026-09-17T19:21:42.955285263Z Wrote inspect data to must-gather.
2026-09-17T19:21:43.170535984Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T19:21:43.186558705Z tar: Removing leading `/' from member names
2026-09-17T19:21:43.229383419Z tar: Removing leading `/' from member names
2026-09-17T19:21:43.233813226Z tar: Removing leading `/' from member names
2026-09-17T19:21:43.251111896Z tar: Removing leading `/' from member names
2026-09-17T19:21:43.261130990Z tar: Removing leading `/' from member names
2026-09-17T19:21:43.287304771Z tar: Removing leading `/' from member names
2026-09-17T19:21:43.323764663Z W0917 19:21:43.323721    1365 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-17T19:21:43.331470416Z Wrote inspect data to must-gather.
2026-09-17T19:21:43.354145903Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:21:43.364713499Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T19:21:43.510834007Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T19:21:43.596773801Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:43.608710107Z Gathering data for ns/openshift-network-console...
2026-09-17T19:21:43.716155353Z Wrote inspect data to must-gather.
2026-09-17T19:21:43.836958470Z INFO: Waiting for network log collection to complete ...
2026-09-17T19:21:43.837003606Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T19:21:43.837380713Z INFO: Copying ovnk databases complete.
2026-09-17T19:21:43.838931116Z 4.7M	must-gather/network_logs/ovnk_database_store
2026-09-17T19:21:43.841354028Z ovnk_database_store/
2026-09-17T19:21:43.841354028Z ovnk_database_store/ovnkube-node-gbgqb_sbdb
2026-09-17T19:21:43.854577130Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:43.857272220Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T19:21:43.877295932Z ovnk_database_store/ovnkube-node-d5bqq_sbdb
2026-09-17T19:21:43.911357735Z ovnk_database_store/ovnkube-node-d5bqq_nbdb
2026-09-17T19:21:43.926810682Z ovnk_database_store/ovnkube-node-pfr6v_nbdb
2026-09-17T19:21:43.936587871Z ovnk_database_store/ovnkube-node-gbgqb_nbdb
2026-09-17T19:21:43.951046387Z ovnk_database_store/ovnkube-node-pfr6v_sbdb
2026-09-17T19:21:43.981799875Z INFO: Network log collection complete.
2026-09-17T19:21:44.000650803Z INFO: Getting status from alertmanager-main-0
2026-09-17T19:21:44.079330405Z Wrote inspect data to must-gather.
2026-09-17T19:21:44.107873352Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:44.176631158Z Gathering data for ns/openshift-console-operator...
2026-09-17T19:21:44.336271714Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:44.338582351Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T19:21:44.401718676Z Wrote inspect data to must-gather.
2026-09-17T19:21:44.528470058Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:44.624636655Z Gathering data for ns/openshift-console...
2026-09-17T19:21:44.685122269Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T19:21:44.687130224Z INFO: Fallback to identify the container image from release info
2026-09-17T19:21:44.752660742Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:44.756138544Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T19:21:44.971442470Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:45.178849800Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:45.182153882Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-17T19:21:45.194347577Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T19:21:45.286600374Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-17T19:21:45.369329060Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:45.425060761Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T19:21:45.580159466Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T19:21:45.590102790Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:45.592393742Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-17T19:21:45.771889189Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:45.786703438Z Gathering data for ns/openshift-dns-operator...
2026-09-17T19:21:45.824461208Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T19:21:45.984632305Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:45.987029924Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T19:21:46.163336841Z Gathering data for ns/openshift-dns...
2026-09-17T19:21:46.171937150Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:46.345979045Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:21:46.730281619Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T19:21:46.853191111Z Gathering data for ns/openshift-image-registry...
2026-09-17T19:21:47.057615612Z Done executing Istio gather script
2026-09-17T19:21:47.467799447Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T19:21:47.861978210Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T19:21:47.904068583Z Gathering data for ns/openshift-ingress...
2026-09-17T19:21:48.242276170Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T19:21:48.635241276Z Gathering data for ns/openshift-insights...
2026-09-17T19:21:48.999725466Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T19:21:50.118861400Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T19:21:50.829906733Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T19:21:51.058814106Z Gathering data for ns/kserve...
2026-09-17T19:21:51.271307427Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T19:21:52.404433761Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T19:21:53.455272226Z Gathering data for ns/openshift-config...
2026-09-17T19:21:53.886445493Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T19:21:54.879194296Z Collecting performance related data for node ip-10-0-132-9.ec2.internal
2026-09-17T19:21:54.885781473Z Collecting performance related data for node ip-10-0-131-128.ec2.internal
2026-09-17T19:21:54.892719224Z Collecting performance related data for node ip-10-0-143-106.ec2.internal
2026-09-17T19:21:55.113109126Z Gathering data for ns/openshift-config-managed...
2026-09-17T19:21:55.745222018Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T19:21:55.836659870Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T19:21:56.131821397Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T19:21:56.507288246Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T19:21:56.824809585Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T19:21:57.166758466Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T19:21:57.452151995Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T19:21:57.827093781Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T19:21:58.304777496Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T19:21:58.635978466Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T19:21:59.152339442Z Gathering data for ns/openshift-multus...
2026-09-17T19:22:00.709298415Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T19:22:00.841638179Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T19:22:02.181238329Z Gathering data for ns/openshift-host-network...
2026-09-17T19:22:02.520401332Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T19:22:03.129113555Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T19:22:03.159515063Z Collecting kubelet logs for node ip-10-0-132-9.ec2.internal
2026-09-17T19:22:03.162728020Z Collecting kubelet logs for node ip-10-0-131-128.ec2.internal
2026-09-17T19:22:03.165385559Z Collecting kubelet logs for node ip-10-0-143-106.ec2.internal
2026-09-17T19:22:03.596864780Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-hmqj2 namespace
2026-09-17T19:22:03.602772133Z INFO: Node performance data collection complete.
2026-09-17T19:22:03.643858883Z Gathering data for ns/openshift-network-operator...
2026-09-17T19:22:04.067151450Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T19:22:04.368382347Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T19:22:04.947136658Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T19:22:05.314638552Z Gathering data for ns/openshift-apiserver...
2026-09-17T19:22:05.808877052Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T19:22:05.846769941Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T19:22:06.176842207Z Gathering data for ns/openshift-controller-manager...
2026-09-17T19:22:06.526503630Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T19:22:07.313269999Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T19:22:07.707128539Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T19:22:08.161525413Z Gathering data for ns/openshift-service-ca...
2026-09-17T19:22:08.743650482Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T19:22:09.925165022Z Wrote inspect data to must-gather.
2026-09-17T19:22:09.925205006Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T19:22:09.925205006Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T19:22:10.057199219Z error: the server doesn't have a resource type "clusters"
2026-09-17T19:22:10.207529118Z Caches written to disk