2026-06-03T15:40:44.006853910Z [disk usage checker] Started
2026-06-03T15:40:44.010380489Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-03T15:40:44.198357477Z Gathering data for ns/openshift-cluster-version...
2026-06-03T15:40:44.324205579Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-03T15:40:44.418034007Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T15:40:44.506231735Z Gathering data for ns/default...
2026-06-03T15:40:44.795631239Z Gathering data for ns/openshift...
2026-06-03T15:40:45.183916668Z Gathering data for ns/kube-system...
2026-06-03T15:40:45.920068429Z Gathering data for ns/openshift-etcd...
2026-06-03T15:40:46.220455279Z Wrote inspect data to must-gather.
2026-06-03T15:40:46.220488452Z error: inspection completed with the errors occurred while gathering data:
2026-06-03T15:40:46.220488452Z     namespaces "assisted-installer" not found
2026-06-03T15:40:46.249914599Z Waiting on subprocesses to finish execution.
2026-06-03T15:40:46.255626155Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-03T15:40:46.263728146Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-03T15:40:46.264070769Z INFO: Collecting host service logs for crio
2026-06-03T15:40:46.264395548Z INFO: Collecting host service logs for kubelet
2026-06-03T15:40:46.264697847Z INFO: Collecting host service logs for rpm-ostreed
2026-06-03T15:40:46.265011642Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-03T15:40:46.265296848Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-03T15:40:46.265578105Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-03T15:40:46.265864906Z INFO: Collecting host service logs for NetworkManager
2026-06-03T15:40:46.266237369Z INFO: Collecting host service logs for openvswitch
2026-06-03T15:40:46.266521367Z INFO: Collecting host service logs for ovs-configuration
2026-06-03T15:40:46.266810409Z INFO: Collecting host service logs for ovsdb-server
2026-06-03T15:40:46.267128474Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-03T15:40:46.267467422Z INFO: Waiting for worker host service log collection to complete ...
2026-06-03T15:40:46.275501470Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-03T15:40:46.299827119Z INFO: Gathering HAProxy config files
2026-06-03T15:40:46.313861231Z INFO: Waiting for node performance related collection to complete ...
2026-06-03T15:40:46.908090829Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-m2tts
2026-06-03T15:40:46.908161175Z insights-runtime-extractor-2dkwq
2026-06-03T15:40:46.908183327Z insights-runtime-extractor-2nwwt
2026-06-03T15:40:46.908204409Z insights-runtime-extractor-p8ljc
2026-06-03T15:40:46.961163437Z INFO: "metallb-operator" not detected. Skipping.
2026-06-03T15:40:46.997934594Z No resources found in openshift-etcd namespace.
2026-06-03T15:40:47.251799720Z error: the server doesn't have a resource type "performanceprofile"
2026-06-03T15:40:47.342212907Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-03T15:40:47.442446479Z Wrote inspect data to must-gather.
2026-06-03T15:40:47.449651606Z No resources found
2026-06-03T15:40:47.492011488Z INFO: Worker host service log collection to complete.
2026-06-03T15:40:47.492174971Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-03T15:40:47.526162736Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-03T15:40:47.532696189Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-03T15:40:47.712317760Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-03T15:40:47.712361902Z INFO: on-disk MachineConfig config collection complete.
2026-06-03T15:40:47.776448085Z No resources found
2026-06-03T15:40:47.863258549Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T15:40:47.972330024Z Wrote inspect data to must-gather.
2026-06-03T15:40:48.018779791Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-03T15:40:48.021142414Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-03T15:40:48.021142414Z See 'oc rsync -h' for help and examples
2026-06-03T15:40:48.034299283Z Wrote inspect data to must-gather.
2026-06-03T15:40:48.088075358Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-03T15:40:48.294122128Z Wrote inspect data to must-gather.
2026-06-03T15:40:48.325561664Z ERROR: No running kube-apiserver pods found
2026-06-03T15:40:48.335391946Z Wrote inspect data to must-gather.
2026-06-03T15:40:48.352145245Z INFO: 'previous-logs' folder not found on ip-10-0-129-205.ec2.internal, skipping...
2026-06-03T15:40:48.360794223Z Wrote inspect data to must-gather.
2026-06-03T15:40:48.371650573Z Wrote inspect data to must-gather.
2026-06-03T15:40:48.411963593Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-03T15:40:48.430179798Z error: the server doesn't have a resource type "machineconfigs"
2026-06-03T15:40:48.526381782Z tar: Removing leading `/' from member names
2026-06-03T15:40:48.534111647Z INFO: HAProxy config collection complete.
2026-06-03T15:40:48.630710038Z Wrote inspect data to must-gather.
2026-06-03T15:40:48.642793440Z INFO: 'previous-logs' folder not found on ip-10-0-130-37.ec2.internal, skipping...
2026-06-03T15:40:48.651044986Z Wrote inspect data to must-gather.
2026-06-03T15:40:48.697397123Z Gathering data for ns/openshift-monitoring...
2026-06-03T15:40:48.838076355Z INFO: Getting rules from prometheus-k8s-0
2026-06-03T15:40:48.895422836Z Wrote inspect data to must-gather.
2026-06-03T15:40:48.900958550Z INFO: 'previous-logs' folder not found on ip-10-0-132-215.ec2.internal, skipping...
2026-06-03T15:40:48.900988795Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-03T15:40:48.900988795Z INFO: Machine Config Daemon termination log collection complete.
2026-06-03T15:40:48.904459531Z Wrote inspect data to must-gather.
2026-06-03T15:40:49.016343823Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-03T15:40:49.041661800Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-03T15:40:49.110402615Z Wrote inspect data to must-gather.
2026-06-03T15:40:49.207720724Z INFO: Getting status/config from prometheus-k8s-0
2026-06-03T15:40:49.242267100Z Wrote inspect data to must-gather.
2026-06-03T15:40:49.371774839Z INFO: INTERCONNECT MODE
2026-06-03T15:40:49.371821699Z INFO: Gathering ovn-kubernetes DBs
2026-06-03T15:40:49.432673741Z Wrote inspect data to must-gather.
2026-06-03T15:40:49.522205960Z INFO: Gathering OVN_Northbound from ovnkube-node-d5rqb...
2026-06-03T15:40:49.522429154Z INFO: Gathering OVN_Northbound from ovnkube-node-vn54r...
2026-06-03T15:40:49.522623701Z INFO: Gathering OVN_Northbound from ovnkube-node-x44sn...
2026-06-03T15:40:49.522868017Z INFO: Gathering OVN_Southbound from ovnkube-node-d5rqb...
2026-06-03T15:40:49.523162992Z INFO: Gathering OVN_Southbound from ovnkube-node-vn54r...
2026-06-03T15:40:49.523397194Z INFO: Gathering OVN_Southbound from ovnkube-node-x44sn...
2026-06-03T15:40:49.710916046Z Wrote inspect data to must-gather.
2026-06-03T15:40:49.793582632Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-03T15:40:49.812676977Z tar: Removing leading `/' from member names
2026-06-03T15:40:49.828190559Z tar: Removing leading `/' from member names
2026-06-03T15:40:49.840107640Z tar: Removing leading `/' from member names
2026-06-03T15:40:49.841622278Z tar: Removing leading `/' from member names
2026-06-03T15:40:49.853396095Z tar: Removing leading `/' from member names
2026-06-03T15:40:49.868694868Z tar: Removing leading `/' from member names
2026-06-03T15:40:49.966268189Z Wrote inspect data to must-gather.
2026-06-03T15:40:50.041039683Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-03T15:40:50.181562533Z Wrote inspect data to must-gather.
2026-06-03T15:40:50.263676639Z INFO: Waiting for network log collection to complete ...
2026-06-03T15:40:50.263706937Z INFO: Waiting for ovnk database copies to complete ...
2026-06-03T15:40:50.264108468Z INFO: Copying ovnk databases complete.
2026-06-03T15:40:50.265662229Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-06-03T15:40:50.268031013Z ovnk_database_store/
2026-06-03T15:40:50.268031013Z ovnk_database_store/ovnkube-node-vn54r_sbdb
2026-06-03T15:40:50.271016409Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-03T15:40:50.285502540Z ovnk_database_store/ovnkube-node-d5rqb_sbdb
2026-06-03T15:40:50.302906280Z ovnk_database_store/ovnkube-node-d5rqb_nbdb
2026-06-03T15:40:50.311151865Z ovnk_database_store/ovnkube-node-x44sn_sbdb
2026-06-03T15:40:50.328694747Z ovnk_database_store/ovnkube-node-vn54r_nbdb
2026-06-03T15:40:50.334402541Z ovnk_database_store/ovnkube-node-x44sn_nbdb
2026-06-03T15:40:50.343924653Z INFO: Network log collection complete.
2026-06-03T15:40:50.378086319Z Wrote inspect data to must-gather.
2026-06-03T15:40:50.501913868Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-03T15:40:50.522678615Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-03T15:40:50.558582373Z Wrote inspect data to must-gather.
2026-06-03T15:40:50.819120326Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-03T15:40:50.821340304Z INFO: Fallback to identify the container image from release info
2026-06-03T15:40:50.882159660Z INFO: Getting status from alertmanager-main-0
2026-06-03T15:40:51.063700908Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T15:40:51.213450661Z Gathering data for ns/openshift-network-console...
2026-06-03T15:40:51.600426510Z Gathering data for ns/openshift-console-operator...
2026-06-03T15:40:51.625312593Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-03T15:40:51.749404712Z daemonset.apps/perf-node-gather-daemonset created
2026-06-03T15:40:51.874998438Z Waiting for performance profile collector pods to become ready: 1
2026-06-03T15:40:51.975393368Z Gathering data for ns/openshift-console...
2026-06-03T15:40:52.431696271Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-03T15:40:52.791656550Z Gathering data for ns/openshift-dns-operator...
2026-06-03T15:40:52.984879427Z Waiting for performance profile collector pods to become ready: 2
2026-06-03T15:40:53.139652550Z Gathering data for ns/openshift-dns...
2026-06-03T15:40:53.811184520Z Gathering data for ns/openshift-image-registry...
2026-06-03T15:40:54.021520173Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-03T15:40:54.091873938Z Waiting for performance profile collector pods to become ready: 3
2026-06-03T15:40:54.326343540Z Gathering data for ns/openshift-ingress-operator...
2026-06-03T15:40:54.651169328Z Gathering data for ns/openshift-ingress...
2026-06-03T15:40:54.972471437Z Gathering data for ns/openshift-ingress-canary...
2026-06-03T15:40:55.209627460Z Waiting for performance profile collector pods to become ready: 4
2026-06-03T15:40:55.402573860Z Gathering data for ns/openshift-insights...
2026-06-03T15:40:56.315997783Z Waiting for performance profile collector pods to become ready: 5
2026-06-03T15:40:57.335108602Z Gathering data for ns/openshift-config...
2026-06-03T15:40:57.435223977Z Waiting for performance profile collector pods to become ready: 6
2026-06-03T15:40:57.595625203Z Gathering data for ns/openshift-config-managed...
2026-06-03T15:40:57.977594426Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-03T15:40:58.236495516Z Gathering data for ns/openshift-kube-apiserver...
2026-06-03T15:40:58.490654840Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-03T15:40:58.561042147Z Waiting for performance profile collector pods to become ready: 7
2026-06-03T15:40:58.808363070Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-03T15:40:59.026715922Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-03T15:40:59.124553634Z Gathering data for ns/openshift-kube-scheduler...
2026-06-03T15:40:59.373832068Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-03T15:40:59.656947049Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-03T15:40:59.683190117Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-03T15:40:59.927740624Z Collecting performance related data for node ip-10-0-130-37.ec2.internal
2026-06-03T15:40:59.934818765Z Collecting performance related data for node ip-10-0-132-215.ec2.internal
2026-06-03T15:40:59.944455396Z Collecting performance related data for node ip-10-0-129-205.ec2.internal
2026-06-03T15:41:00.007527485Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-03T15:41:00.385484562Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-03T15:41:01.015415779Z Gathering data for ns/openshift-multus...
2026-06-03T15:41:02.513968944Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-03T15:41:04.031171075Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-03T15:41:04.076489262Z Gathering data for ns/openshift-host-network...
2026-06-03T15:41:04.421168585Z Gathering data for ns/openshift-network-diagnostics...
2026-06-03T15:41:04.985805626Z Gathering data for ns/openshift-network-node-identity...
2026-06-03T15:41:05.377300306Z Gathering data for ns/openshift-network-operator...
2026-06-03T15:41:05.747455352Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-03T15:41:06.007178320Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-03T15:41:06.444254674Z Gathering data for ns/openshift-apiserver-operator...
2026-06-03T15:41:06.745349750Z Gathering data for ns/openshift-apiserver...
2026-06-03T15:41:07.151711449Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-03T15:41:07.469661307Z Gathering data for ns/openshift-controller-manager...
2026-06-03T15:41:07.733180391Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-03T15:41:07.866628213Z Collecting kubelet logs for node ip-10-0-130-37.ec2.internal
2026-06-03T15:41:07.868376851Z Collecting kubelet logs for node ip-10-0-132-215.ec2.internal
2026-06-03T15:41:07.870142312Z Collecting kubelet logs for node ip-10-0-129-205.ec2.internal
2026-06-03T15:41:08.189040278Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-03T15:41:08.194583885Z INFO: Node performance data collection complete.
2026-06-03T15:41:08.431015156Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-03T15:41:08.723121958Z Gathering data for ns/openshift-service-ca-operator...
2026-06-03T15:41:09.021715349Z Gathering data for ns/openshift-service-ca...
2026-06-03T15:41:09.035612421Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-03T15:41:09.357590840Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-03T15:41:10.202148267Z Wrote inspect data to must-gather.
2026-06-03T15:41:10.202194470Z error: inspection completed with the errors occurred while gathering data:
2026-06-03T15:41:10.202194470Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-03T15:41:10.323778828Z error: the server doesn't have a resource type "clusters"
2026-06-03T15:41:10.457717905Z Caches written to disk