2026-09-18T08:34:03.562114187Z [disk usage checker] Started
2026-09-18T08:34:03.566110690Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-18T08:34:03.758384451Z Gathering data for ns/openshift-cluster-version...
2026-09-18T08:34:03.892339765Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T08:34:03.969587600Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T08:34:04.055239745Z Gathering data for ns/default...
2026-09-18T08:34:04.336606034Z Gathering data for ns/openshift...
2026-09-18T08:34:04.766868639Z Gathering data for ns/kube-system...
2026-09-18T08:34:05.398912613Z Gathering data for ns/openshift-etcd...
2026-09-18T08:34:05.711067683Z Wrote inspect data to must-gather.
2026-09-18T08:34:05.711093059Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T08:34:05.711093059Z     namespaces "assisted-installer" not found
2026-09-18T08:34:06.055891238Z Waiting on subprocesses to finish execution.
2026-09-18T08:34:06.060430981Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-18T08:34:06.067378566Z INFO: Collecting host service logs for crio
2026-09-18T08:34:06.067656609Z INFO: Collecting host service logs for kubelet
2026-09-18T08:34:06.067962050Z INFO: Collecting host service logs for rpm-ostreed
2026-09-18T08:34:06.068287219Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-18T08:34:06.068570530Z Executing Istio gather script
2026-09-18T08:34:06.068629691Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-18T08:34:06.068959258Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-18T08:34:06.069319366Z INFO: Collecting host service logs for NetworkManager
2026-09-18T08:34:06.069649121Z INFO: Collecting host service logs for openvswitch
2026-09-18T08:34:06.069998466Z INFO: Collecting host service logs for ovs-configuration
2026-09-18T08:34:06.070411153Z INFO: Collecting host service logs for ovsdb-server
2026-09-18T08:34:06.070759422Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-18T08:34:06.071230760Z INFO: Waiting for worker host service log collection to complete ...
2026-09-18T08:34:06.073129122Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-18T08:34:06.076255777Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-18T08:34:06.079128470Z INFO: Gathering HAProxy config files
2026-09-18T08:34:06.131478626Z INFO: Waiting for node performance related collection to complete ...
2026-09-18T08:34:06.505400413Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-18T08:34:06.966899950Z error: the server doesn't have a resource type "performanceprofile"
2026-09-18T08:34:07.102798089Z No resources found in openshift-etcd namespace.
2026-09-18T08:34:07.144877964Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-18T08:34:07.144957265Z INFO: on-disk MachineConfig config collection complete.
2026-09-18T08:34:07.182580252Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-18T08:34:07.263226179Z No resources found
2026-09-18T08:34:07.317763249Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-18T08:34:07.358088417Z INFO: "metallb-operator" not detected. Skipping.
2026-09-18T08:34:07.371929840Z INFO: Worker host service log collection to complete.
2026-09-18T08:34:07.382331774Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-7v2h7
2026-09-18T08:34:07.382390878Z insights-runtime-extractor-4r2cs
2026-09-18T08:34:07.382414708Z insights-runtime-extractor-tcxhv
2026-09-18T08:34:07.382437005Z insights-runtime-extractor-w8bw6
2026-09-18T08:34:07.589947306Z Wrote inspect data to must-gather.
2026-09-18T08:34:07.833533518Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-18T08:34:07.833533518Z See 'oc rsync -h' for help and examples
2026-09-18T08:34:07.845760808Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-18T08:34:07.884798789Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-18T08:34:07.893867578Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-18T08:34:08.173232791Z Wrote inspect data to must-gather.
2026-09-18T08:34:08.187321494Z Gathering data for ns/openshift-monitoring...
2026-09-18T08:34:08.279839962Z Wrote inspect data to must-gather.
2026-09-18T08:34:08.281512337Z Wrote inspect data to must-gather.
2026-09-18T08:34:08.345428333Z Wrote inspect data to must-gather.
2026-09-18T08:34:08.388588660Z Wrote inspect data to must-gather.
2026-09-18T08:34:08.483560716Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T08:34:08.485883957Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-18T08:34:08.533837224Z No resources found
2026-09-18T08:34:08.562015944Z ERROR: No running kube-apiserver pods found
2026-09-18T08:34:08.582816516Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-18T08:34:08.599102079Z Wrote inspect data to must-gather.
2026-09-18T08:34:08.650773482Z error: the server doesn't have a resource type "machineconfigs"
2026-09-18T08:34:08.663724894Z INFO: 'previous-logs' folder not found on ip-10-0-134-84.ec2.internal, skipping...
2026-09-18T08:34:08.699281832Z tar: Removing leading `/' from member names
2026-09-18T08:34:08.713921488Z INFO: HAProxy config collection complete.
2026-09-18T08:34:08.851082027Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-18T08:34:08.906338942Z Wrote inspect data to must-gather.
2026-09-18T08:34:08.926613953Z INFO: Getting rules from prometheus-k8s-0
2026-09-18T08:34:08.986213890Z INFO: 'previous-logs' folder not found on ip-10-0-138-235.ec2.internal, skipping...
2026-09-18T08:34:09.126402226Z Wrote inspect data to must-gather.
2026-09-18T08:34:09.132448493Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-18T08:34:09.196988089Z Wrote inspect data to must-gather.
2026-09-18T08:34:09.270498565Z INFO: 'previous-logs' folder not found on ip-10-0-143-197.ec2.internal, skipping...
2026-09-18T08:34:09.270534888Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-18T08:34:09.270567047Z INFO: Machine Config Daemon termination log collection complete.
2026-09-18T08:34:09.297937837Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-18T08:34:09.351328047Z INFO: Getting status/config from prometheus-k8s-0
2026-09-18T08:34:09.468761179Z Wrote inspect data to must-gather.
2026-09-18T08:34:09.524328137Z Wrote inspect data to must-gather.
2026-09-18T08:34:09.757119971Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-18T08:34:09.779741351Z INFO: INTERCONNECT MODE
2026-09-18T08:34:09.779781466Z INFO: Gathering ovn-kubernetes DBs
2026-09-18T08:34:09.783203655Z Wrote inspect data to must-gather.
2026-09-18T08:34:09.865801864Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T08:34:09.938505812Z INFO: Gathering OVN_Northbound from ovnkube-node-5xjvt...
2026-09-18T08:34:09.938725720Z INFO: Gathering OVN_Northbound from ovnkube-node-6c4c5...
2026-09-18T08:34:09.938968920Z INFO: Gathering OVN_Northbound from ovnkube-node-79m8t...
2026-09-18T08:34:09.939267564Z INFO: Gathering OVN_Southbound from ovnkube-node-5xjvt...
2026-09-18T08:34:09.939549985Z INFO: Gathering OVN_Southbound from ovnkube-node-6c4c5...
2026-09-18T08:34:09.939835010Z INFO: Gathering OVN_Southbound from ovnkube-node-79m8t...
2026-09-18T08:34:10.003132379Z Wrote inspect data to must-gather.
2026-09-18T08:34:10.007396327Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-18T08:34:10.233126334Z tar: Removing leading `/' from member names
2026-09-18T08:34:10.268034227Z tar: Removing leading `/' from member names
2026-09-18T08:34:10.303316732Z tar: Removing leading `/' from member names
2026-09-18T08:34:10.305637703Z tar: Removing leading `/' from member names
2026-09-18T08:34:10.320023909Z tar: Removing leading `/' from member names
2026-09-18T08:34:10.329667355Z tar: Removing leading `/' from member names
2026-09-18T08:34:10.337190852Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-18T08:34:10.368965765Z Wrote inspect data to must-gather.
2026-09-18T08:34:10.407903399Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-18T08:34:10.559158738Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:10.627053691Z W0918 08:34:10.627007    1406 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-18T08:34:10.634562087Z Wrote inspect data to must-gather.
2026-09-18T08:34:10.671862124Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-18T08:34:10.725650196Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T08:34:10.813274998Z INFO: Waiting for network log collection to complete ...
2026-09-18T08:34:10.813400238Z INFO: Waiting for ovnk database copies to complete ...
2026-09-18T08:34:10.813930247Z INFO: Copying ovnk databases complete.
2026-09-18T08:34:10.817599614Z 3.0M	must-gather/network_logs/ovnk_database_store
2026-09-18T08:34:10.820055100Z ovnk_database_store/
2026-09-18T08:34:10.820103308Z ovnk_database_store/ovnkube-node-79m8t_nbdb
2026-09-18T08:34:10.825016931Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:10.827578713Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-18T08:34:10.830815086Z ovnk_database_store/ovnkube-node-5xjvt_sbdb
2026-09-18T08:34:10.851486837Z ovnk_database_store/ovnkube-node-6c4c5_nbdb
2026-09-18T08:34:10.859127624Z ovnk_database_store/ovnkube-node-79m8t_sbdb
2026-09-18T08:34:10.876669104Z ovnk_database_store/ovnkube-node-6c4c5_sbdb
2026-09-18T08:34:10.895813114Z ovnk_database_store/ovnkube-node-5xjvt_nbdb
2026-09-18T08:34:10.906041362Z INFO: Network log collection complete.
2026-09-18T08:34:10.945927664Z Gathering data for ns/openshift-network-console...
2026-09-18T08:34:10.992520579Z Wrote inspect data to must-gather.
2026-09-18T08:34:11.045378753Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:11.088023038Z INFO: Getting status from alertmanager-main-0
2026-09-18T08:34:11.277044403Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:11.280544047Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-18T08:34:11.310852336Z Wrote inspect data to must-gather.
2026-09-18T08:34:11.400586738Z Gathering data for ns/openshift-console-operator...
2026-09-18T08:34:11.486264149Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:11.568210726Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-18T08:34:11.570671378Z INFO: Fallback to identify the container image from release info
2026-09-18T08:34:11.678412950Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:11.681471708Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-18T08:34:11.781004876Z Gathering data for ns/openshift-console...
2026-09-18T08:34:11.902052563Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:12.086001317Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:12.088458098Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-18T08:34:12.134741184Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-18T08:34:12.264888183Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:12.265608021Z daemonset.apps/perf-node-gather-daemonset created
2026-09-18T08:34:12.289079501Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-18T08:34:12.392860648Z Waiting for performance profile collector pods to become ready: 1
2026-09-18T08:34:12.455047788Z Wrote inspect data to /must-gather/istio.
2026-09-18T08:34:12.835779590Z Gathering data for ns/openshift-dns-operator...
2026-09-18T08:34:13.139172248Z Gathering data for ns/openshift-dns...
2026-09-18T08:34:13.142430848Z Done executing Istio gather script
2026-09-18T08:34:13.506229709Z Waiting for performance profile collector pods to become ready: 2
2026-09-18T08:34:13.588334903Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-18T08:34:13.655975503Z Gathering data for ns/openshift-image-registry...
2026-09-18T08:34:14.069379604Z Gathering data for ns/openshift-ingress-operator...
2026-09-18T08:34:14.362245794Z Gathering data for ns/openshift-ingress...
2026-09-18T08:34:14.629225139Z Waiting for performance profile collector pods to become ready: 3
2026-09-18T08:34:14.675486598Z Gathering data for ns/openshift-ingress-canary...
2026-09-18T08:34:15.011164914Z Gathering data for ns/openshift-insights...
2026-09-18T08:34:15.740947904Z Waiting for performance profile collector pods to become ready: 4
2026-09-18T08:34:16.701621074Z Gathering data for ns/openshift-jobset-operator...
2026-09-18T08:34:16.854695738Z Waiting for performance profile collector pods to become ready: 5
2026-09-18T08:34:17.485540652Z Gathering data for ns/openshift-config...
2026-09-18T08:34:17.755615677Z Gathering data for ns/openshift-config-managed...
2026-09-18T08:34:17.982253986Z Waiting for performance profile collector pods to become ready: 6
2026-09-18T08:34:18.163196896Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-18T08:34:18.383038186Z Gathering data for ns/openshift-kube-apiserver...
2026-09-18T08:34:18.592805811Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-18T08:34:18.607324292Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-18T08:34:18.853413697Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-18T08:34:19.101100915Z Waiting for performance profile collector pods to become ready: 7
2026-09-18T08:34:19.109913061Z Gathering data for ns/openshift-kube-scheduler...
2026-09-18T08:34:19.337325486Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-18T08:34:19.635102560Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-18T08:34:19.904893453Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-18T08:34:20.194998076Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-18T08:34:20.223056263Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-18T08:34:20.467720373Z Collecting performance related data for node ip-10-0-138-235.ec2.internal
2026-09-18T08:34:20.474229987Z Collecting performance related data for node ip-10-0-143-197.ec2.internal
2026-09-18T08:34:20.484650832Z Collecting performance related data for node ip-10-0-134-84.ec2.internal
2026-09-18T08:34:20.708041599Z Gathering data for ns/openshift-multus...
2026-09-18T08:34:22.081233313Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-18T08:34:23.225775434Z Gathering data for ns/openshift-host-network...
2026-09-18T08:34:23.503046586Z Gathering data for ns/openshift-network-diagnostics...
2026-09-18T08:34:23.597276510Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-18T08:34:23.993083441Z Gathering data for ns/openshift-network-node-identity...
2026-09-18T08:34:24.373395328Z Gathering data for ns/openshift-network-operator...
2026-09-18T08:34:24.740850532Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-18T08:34:24.983127343Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-18T08:34:25.433239903Z Gathering data for ns/openshift-apiserver-operator...
2026-09-18T08:34:25.713438559Z Gathering data for ns/openshift-apiserver...
2026-09-18T08:34:26.073616940Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-18T08:34:26.302793853Z Gathering data for ns/openshift-controller-manager...
2026-09-18T08:34:26.543662964Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-18T08:34:27.139757762Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-18T08:34:27.428904626Z Gathering data for ns/openshift-service-ca-operator...
2026-09-18T08:34:27.711686687Z Gathering data for ns/openshift-service-ca...
2026-09-18T08:34:28.051633085Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-18T08:34:28.251625442Z Collecting kubelet logs for node ip-10-0-138-235.ec2.internal
2026-09-18T08:34:28.253800031Z Collecting kubelet logs for node ip-10-0-143-197.ec2.internal
2026-09-18T08:34:28.256341240Z Collecting kubelet logs for node ip-10-0-134-84.ec2.internal
2026-09-18T08:34:28.601768102Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-18T08:34:28.608564239Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-fnn4x namespace
2026-09-18T08:34:28.613041297Z INFO: Node performance data collection complete.
2026-09-18T08:34:28.937324509Z Wrote inspect data to must-gather.
2026-09-18T08:34:28.937362776Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T08:34:28.937362776Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-18T08:34:29.055030681Z error: the server doesn't have a resource type "clusters"
2026-09-18T08:34:29.187575908Z Caches written to disk