2026-09-17T14:14:10.752651073Z [disk usage checker] Started
2026-09-17T14:14:10.755757599Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T14:14:10.957737012Z Gathering data for ns/openshift-cluster-version...
2026-09-17T14:14:11.101128987Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T14:14:11.190585381Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T14:14:11.268996440Z Gathering data for ns/default...
2026-09-17T14:14:11.592828480Z Gathering data for ns/openshift...
2026-09-17T14:14:11.991115594Z Gathering data for ns/kube-system...
2026-09-17T14:14:12.665444597Z Gathering data for ns/openshift-etcd...
2026-09-17T14:14:13.002780938Z Wrote inspect data to must-gather.
2026-09-17T14:14:13.002822363Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T14:14:13.002822363Z     namespaces "assisted-installer" not found
2026-09-17T14:14:13.275870770Z Waiting on subprocesses to finish execution.
2026-09-17T14:14:13.291734639Z Executing Istio gather script
2026-09-17T14:14:13.292737247Z INFO: Gathering HAProxy config files
2026-09-17T14:14:13.294581345Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T14:14:13.300782982Z INFO: Collecting host service logs for crio
2026-09-17T14:14:13.301109776Z INFO: Collecting host service logs for kubelet
2026-09-17T14:14:13.301426862Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T14:14:13.301741640Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T14:14:13.302107665Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T14:14:13.302446011Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T14:14:13.302781535Z INFO: Collecting host service logs for NetworkManager
2026-09-17T14:14:13.303118608Z INFO: Collecting host service logs for openvswitch
2026-09-17T14:14:13.303452832Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T14:14:13.303565656Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T14:14:13.303928878Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T14:14:13.304333793Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T14:14:13.304705209Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T14:14:13.310703555Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T14:14:13.338388425Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T14:14:13.970171778Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T14:14:13.970207707Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T14:14:14.066321482Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T14:14:14.265420649Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T14:14:14.280672635Z No resources found
2026-09-17T14:14:14.291720651Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T14:14:14.374894292Z INFO: Collecting Insights Archives from insights-operator-5844b856db-c5bsz
2026-09-17T14:14:14.374894292Z insights-runtime-extractor-2tp6r
2026-09-17T14:14:14.374894292Z insights-runtime-extractor-k7c9d
2026-09-17T14:14:14.374894292Z insights-runtime-extractor-vz5tm
2026-09-17T14:14:14.381001526Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T14:14:14.425822505Z No resources found in openshift-etcd namespace.
2026-09-17T14:14:14.453850527Z Wrote inspect data to must-gather.
2026-09-17T14:14:14.459611594Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T14:14:14.484972160Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T14:14:14.656412152Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T14:14:14.656412152Z See 'oc rsync -h' for help and examples
2026-09-17T14:14:14.710739068Z INFO: Worker host service log collection to complete.
2026-09-17T14:14:14.999152137Z ERROR: No running kube-apiserver pods found
2026-09-17T14:14:15.028579110Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T14:14:15.304689614Z Wrote inspect data to must-gather.
2026-09-17T14:14:15.323911994Z Wrote inspect data to must-gather.
2026-09-17T14:14:15.333137386Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T14:14:15.481677148Z INFO: 'previous-logs' folder not found on ip-10-0-135-18.ec2.internal, skipping...
2026-09-17T14:14:15.519571805Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T14:14:15.537703141Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T14:14:15.589561879Z Wrote inspect data to must-gather.
2026-09-17T14:14:15.656884605Z Wrote inspect data to must-gather.
2026-09-17T14:14:15.708231127Z Wrote inspect data to must-gather.
2026-09-17T14:14:15.751638955Z No resources found
2026-09-17T14:14:15.786740935Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T14:14:15.821393473Z tar: Removing leading `/' from member names
2026-09-17T14:14:15.827993886Z INFO: HAProxy config collection complete.
2026-09-17T14:14:15.841280668Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T14:14:15.852284463Z Wrote inspect data to must-gather.
2026-09-17T14:14:15.887873847Z Gathering data for ns/openshift-monitoring...
2026-09-17T14:14:15.971382151Z INFO: 'previous-logs' folder not found on ip-10-0-140-12.ec2.internal, skipping...
2026-09-17T14:14:15.984456133Z Wrote inspect data to must-gather.
2026-09-17T14:14:16.056340926Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T14:14:16.103132431Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T14:14:16.125300918Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T14:14:16.275588513Z INFO: 'previous-logs' folder not found on ip-10-0-141-162.ec2.internal, skipping...
2026-09-17T14:14:16.275635017Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T14:14:16.275649093Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T14:14:16.282277046Z Wrote inspect data to must-gather.
2026-09-17T14:14:16.323284635Z Wrote inspect data to must-gather.
2026-09-17T14:14:16.487662543Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T14:14:16.497787017Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T14:14:16.530824266Z Wrote inspect data to must-gather.
2026-09-17T14:14:16.701508972Z Wrote inspect data to must-gather.
2026-09-17T14:14:16.794016105Z INFO: INTERCONNECT MODE
2026-09-17T14:14:16.794075014Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T14:14:16.895718251Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T14:14:16.913493860Z Wrote inspect data to must-gather.
2026-09-17T14:14:16.962131123Z INFO: Gathering OVN_Northbound from ovnkube-node-42s6d...
2026-09-17T14:14:16.962342945Z INFO: Gathering OVN_Northbound from ovnkube-node-lclzj...
2026-09-17T14:14:16.962614352Z INFO: Gathering OVN_Northbound from ovnkube-node-zhzqq...
2026-09-17T14:14:16.962883139Z INFO: Gathering OVN_Southbound from ovnkube-node-42s6d...
2026-09-17T14:14:16.963184948Z INFO: Gathering OVN_Southbound from ovnkube-node-lclzj...
2026-09-17T14:14:16.963467806Z INFO: Gathering OVN_Southbound from ovnkube-node-zhzqq...
2026-09-17T14:14:17.219943654Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T14:14:17.262305593Z Wrote inspect data to must-gather.
2026-09-17T14:14:17.282265694Z tar: Removing leading `/' from member names
2026-09-17T14:14:17.295003227Z tar: Removing leading `/' from member names
2026-09-17T14:14:17.303214788Z tar: Removing leading `/' from member names
2026-09-17T14:14:17.310399523Z tar: Removing leading `/' from member names
2026-09-17T14:14:17.315062279Z tar: Removing leading `/' from member names
2026-09-17T14:14:17.356055533Z tar: Removing leading `/' from member names
2026-09-17T14:14:17.488203736Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T14:14:17.493961877Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T14:14:17.510254529Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T14:14:17.513319053Z Wrote inspect data to must-gather.
2026-09-17T14:14:17.719750997Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:17.749984402Z Wrote inspect data to must-gather.
2026-09-17T14:14:17.794913991Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T14:14:17.797607994Z INFO: Waiting for network log collection to complete ...
2026-09-17T14:14:17.797646437Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T14:14:17.798101777Z INFO: Copying ovnk databases complete.
2026-09-17T14:14:17.799705534Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-09-17T14:14:17.802074663Z ovnk_database_store/
2026-09-17T14:14:17.802139829Z ovnk_database_store/ovnkube-node-lclzj_sbdb
2026-09-17T14:14:17.823127889Z ovnk_database_store/ovnkube-node-42s6d_nbdb
2026-09-17T14:14:17.830705538Z ovnk_database_store/ovnkube-node-42s6d_sbdb
2026-09-17T14:14:17.850568272Z ovnk_database_store/ovnkube-node-lclzj_nbdb
2026-09-17T14:14:17.857562510Z ovnk_database_store/ovnkube-node-zhzqq_sbdb
2026-09-17T14:14:17.875596918Z ovnk_database_store/ovnkube-node-zhzqq_nbdb
2026-09-17T14:14:17.886470452Z INFO: Network log collection complete.
2026-09-17T14:14:17.943487833Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:17.948262000Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T14:14:17.979520302Z Wrote inspect data to must-gather.
2026-09-17T14:14:18.166775801Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T14:14:18.167107378Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:18.195665390Z INFO: Getting status from alertmanager-main-0
2026-09-17T14:14:18.269732039Z Wrote inspect data to must-gather.
2026-09-17T14:14:18.363134838Z Gathering data for ns/openshift-network-console...
2026-09-17T14:14:18.373003500Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:18.375422153Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T14:14:18.532762188Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T14:14:18.534856653Z INFO: Fallback to identify the container image from release info
2026-09-17T14:14:18.569398622Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:18.772445689Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:18.774696104Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T14:14:18.789406180Z Gathering data for ns/openshift-console-operator...
2026-09-17T14:14:18.972500246Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:19.168219246Z Gathering data for ns/openshift-console...
2026-09-17T14:14:19.169843561Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:19.172230782Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T14:14:19.233240860Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-17T14:14:19.347760658Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:19.367272391Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T14:14:19.488854695Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T14:14:19.558987605Z Wrote inspect data to /must-gather/istio.
2026-09-17T14:14:19.705965841Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T14:14:20.242015965Z Gathering data for ns/openshift-dns-operator...
2026-09-17T14:14:20.250697536Z Done executing Istio gather script
2026-09-17T14:14:20.506906413Z Gathering data for ns/openshift-dns...
2026-09-17T14:14:20.592151072Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T14:14:20.793238280Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T14:14:21.067303160Z Gathering data for ns/openshift-image-registry...
2026-09-17T14:14:21.506320533Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T14:14:21.689091931Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T14:14:21.856036456Z Gathering data for ns/openshift-ingress...
2026-09-17T14:14:22.177666454Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T14:14:22.536846891Z Gathering data for ns/openshift-insights...
2026-09-17T14:14:22.793701679Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T14:14:23.907101149Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T14:14:24.341520895Z Gathering data for ns/openshift-jobset-operator...
2026-09-17T14:14:25.012129973Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T14:14:25.121651932Z Gathering data for ns/openshift-config...
2026-09-17T14:14:25.416222201Z Gathering data for ns/openshift-config-managed...
2026-09-17T14:14:25.797758163Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T14:14:25.863105801Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T14:14:26.135956219Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T14:14:26.138386629Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T14:14:26.438590942Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T14:14:26.754233982Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T14:14:27.033780459Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T14:14:27.249399564Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T14:14:27.302657611Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T14:14:27.500340714Z Collecting performance related data for node ip-10-0-135-18.ec2.internal
2026-09-17T14:14:27.509519369Z Collecting performance related data for node ip-10-0-140-12.ec2.internal
2026-09-17T14:14:27.522251781Z Collecting performance related data for node ip-10-0-141-162.ec2.internal
2026-09-17T14:14:27.633780299Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T14:14:28.007444117Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T14:14:28.379138657Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T14:14:28.979305216Z Gathering data for ns/openshift-multus...
2026-09-17T14:14:30.375575260Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T14:14:30.802570368Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T14:14:31.551085101Z Gathering data for ns/openshift-host-network...
2026-09-17T14:14:31.859355987Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T14:14:32.376516044Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T14:14:32.764151600Z Gathering data for ns/openshift-network-operator...
2026-09-17T14:14:33.130275724Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T14:14:33.437753954Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T14:14:33.901004302Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T14:14:34.225455198Z Gathering data for ns/openshift-apiserver...
2026-09-17T14:14:34.594844702Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T14:14:34.859558030Z Gathering data for ns/openshift-controller-manager...
2026-09-17T14:14:35.116067586Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T14:14:35.496770400Z Collecting kubelet logs for node ip-10-0-135-18.ec2.internal
2026-09-17T14:14:35.498521028Z Collecting kubelet logs for node ip-10-0-140-12.ec2.internal
2026-09-17T14:14:35.500422607Z Collecting kubelet logs for node ip-10-0-141-162.ec2.internal
2026-09-17T14:14:35.807174932Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T14:14:35.835256986Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-mj95w namespace
2026-09-17T14:14:35.840013302Z INFO: Node performance data collection complete.
2026-09-17T14:14:35.841145820Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T14:14:36.163229962Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T14:14:36.449407923Z Gathering data for ns/openshift-service-ca...
2026-09-17T14:14:36.867318149Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T14:14:37.721486375Z Wrote inspect data to must-gather.
2026-09-17T14:14:37.721528244Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T14:14:37.721528244Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T14:14:37.842513286Z error: the server doesn't have a resource type "clusters"
2026-09-17T14:14:38.007744733Z Caches written to disk