2026-06-02T12:51:52.919626278Z [disk usage checker] Started
2026-06-02T12:51:52.923944408Z [disk usage checker] Volume usage percentage: current = 30 ; allowed = 70
2026-06-02T12:51:53.214720176Z Gathering data for ns/openshift-cluster-version...
2026-06-02T12:51:53.365759190Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T12:51:53.454447072Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T12:51:53.544083588Z Gathering data for ns/default...
2026-06-02T12:51:53.831451152Z Gathering data for ns/openshift...
2026-06-02T12:51:54.235715309Z Gathering data for ns/kube-system...
2026-06-02T12:51:54.850939767Z Gathering data for ns/openshift-etcd...
2026-06-02T12:51:55.187611496Z Wrote inspect data to must-gather.
2026-06-02T12:51:55.187643123Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T12:51:55.187643123Z     namespaces "assisted-installer" not found
2026-06-02T12:51:55.293238354Z Waiting on subprocesses to finish execution.
2026-06-02T12:51:55.300825235Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T12:51:55.301315130Z INFO: Gathering HAProxy config files
2026-06-02T12:51:55.309355116Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T12:51:55.312964461Z INFO: Collecting host service logs for crio
2026-06-02T12:51:55.313307168Z INFO: Collecting host service logs for kubelet
2026-06-02T12:51:55.313640003Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T12:51:55.313984303Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T12:51:55.314313730Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T12:51:55.314636135Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T12:51:55.314991387Z INFO: Collecting host service logs for NetworkManager
2026-06-02T12:51:55.315328718Z INFO: Collecting host service logs for openvswitch
2026-06-02T12:51:55.315646940Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T12:51:55.315994736Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T12:51:55.316324220Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T12:51:55.316711275Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T12:51:55.321791669Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T12:51:55.660134405Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T12:51:56.154344015Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T12:51:56.184146484Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-wz7sd
2026-06-02T12:51:56.184191581Z insights-runtime-extractor-55z7h
2026-06-02T12:51:56.184211573Z insights-runtime-extractor-96cfv
2026-06-02T12:51:56.184231060Z insights-runtime-extractor-tj8kx
2026-06-02T12:51:56.253585510Z No resources found
2026-06-02T12:51:56.269762495Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T12:51:56.341231334Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T12:51:56.363205049Z No resources found in openshift-etcd namespace.
2026-06-02T12:51:56.451535848Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T12:51:56.503803107Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T12:51:56.560028190Z INFO: Worker host service log collection to complete.
2026-06-02T12:51:56.583612187Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T12:51:56.583697706Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T12:51:56.683753884Z ERROR: No running kube-apiserver pods found
2026-06-02T12:51:56.729316986Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T12:51:56.929573533Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T12:51:57.041442275Z No resources found
2026-06-02T12:51:57.093949398Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T12:51:57.143758425Z Wrote inspect data to must-gather.
2026-06-02T12:51:57.162199879Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T12:51:57.162199879Z See 'oc rsync -h' for help and examples
2026-06-02T12:51:57.199747234Z Wrote inspect data to must-gather.
2026-06-02T12:51:57.306542352Z INFO: 'previous-logs' folder not found on ip-10-0-128-229.ec2.internal, skipping...
2026-06-02T12:51:57.338165715Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T12:51:57.358414183Z Wrote inspect data to must-gather.
2026-06-02T12:51:57.400116811Z Wrote inspect data to must-gather.
2026-06-02T12:51:57.425785110Z Wrote inspect data to must-gather.
2026-06-02T12:51:57.462830071Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T12:51:57.471629652Z Wrote inspect data to must-gather.
2026-06-02T12:51:57.505753362Z Wrote inspect data to must-gather.
2026-06-02T12:51:57.532414387Z Gathering data for ns/openshift-monitoring...
2026-06-02T12:51:57.608807435Z tar: Removing leading `/' from member names
2026-06-02T12:51:57.612545903Z INFO: HAProxy config collection complete.
2026-06-02T12:51:57.646263154Z INFO: 'previous-logs' folder not found on ip-10-0-137-239.ec2.internal, skipping...
2026-06-02T12:51:57.666667550Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T12:51:57.700229103Z Wrote inspect data to must-gather.
2026-06-02T12:51:57.882791869Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T12:51:57.913149697Z INFO: 'previous-logs' folder not found on ip-10-0-143-139.ec2.internal, skipping...
2026-06-02T12:51:57.913194100Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T12:51:57.913230991Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T12:51:57.913552998Z Wrote inspect data to must-gather.
2026-06-02T12:51:57.929831213Z [disk usage checker] Volume usage percentage: current = 30 ; allowed = 70
2026-06-02T12:51:57.974702329Z Wrote inspect data to must-gather.
2026-06-02T12:51:58.120500712Z Wrote inspect data to must-gather.
2026-06-02T12:51:58.198923694Z Wrote inspect data to must-gather.
2026-06-02T12:51:58.262921775Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T12:51:58.276828240Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T12:51:58.480532349Z INFO: INTERCONNECT MODE
2026-06-02T12:51:58.480570479Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T12:51:58.492385448Z Wrote inspect data to must-gather.
2026-06-02T12:51:58.635771278Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T12:51:58.638185990Z INFO: Gathering OVN_Northbound from ovnkube-node-lhpqg...
2026-06-02T12:51:58.638467414Z INFO: Gathering OVN_Northbound from ovnkube-node-mb7lb...
2026-06-02T12:51:58.638734722Z INFO: Gathering OVN_Northbound from ovnkube-node-rb4sp...
2026-06-02T12:51:58.639043622Z INFO: Gathering OVN_Southbound from ovnkube-node-lhpqg...
2026-06-02T12:51:58.639329068Z INFO: Gathering OVN_Southbound from ovnkube-node-mb7lb...
2026-06-02T12:51:58.639648138Z INFO: Gathering OVN_Southbound from ovnkube-node-rb4sp...
2026-06-02T12:51:58.761168742Z Wrote inspect data to must-gather.
2026-06-02T12:51:58.952788474Z tar: Removing leading `/' from member names
2026-06-02T12:51:58.963329148Z tar: Removing leading `/' from member names
2026-06-02T12:51:58.980472429Z tar: Removing leading `/' from member names
2026-06-02T12:51:59.000093767Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T12:51:59.005295726Z tar: Removing leading `/' from member names
2026-06-02T12:51:59.031217385Z tar: Removing leading `/' from member names
2026-06-02T12:51:59.033142194Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T12:51:59.038215478Z tar: Removing leading `/' from member names
2026-06-02T12:51:59.108409925Z Wrote inspect data to must-gather.
2026-06-02T12:51:59.288544253Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T12:51:59.346690068Z Wrote inspect data to must-gather.
2026-06-02T12:51:59.464316002Z INFO: Waiting for network log collection to complete ...
2026-06-02T12:51:59.464341530Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T12:51:59.464720113Z INFO: Copying ovnk databases complete.
2026-06-02T12:51:59.466326758Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-06-02T12:51:59.468459354Z ovnk_database_store/
2026-06-02T12:51:59.468459354Z ovnk_database_store/ovnkube-node-mb7lb_sbdb
2026-06-02T12:51:59.486953567Z ovnk_database_store/ovnkube-node-lhpqg_nbdb
2026-06-02T12:51:59.495462665Z ovnk_database_store/ovnkube-node-mb7lb_nbdb
2026-06-02T12:51:59.503541684Z ovnk_database_store/ovnkube-node-rb4sp_sbdb
2026-06-02T12:51:59.521411339Z ovnk_database_store/ovnkube-node-rb4sp_nbdb
2026-06-02T12:51:59.529678946Z ovnk_database_store/ovnkube-node-lhpqg_sbdb
2026-06-02T12:51:59.529967711Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T12:51:59.548974898Z INFO: Network log collection complete.
2026-06-02T12:51:59.552926898Z Wrote inspect data to must-gather.
2026-06-02T12:51:59.691345950Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T12:51:59.835343672Z Wrote inspect data to must-gather.
2026-06-02T12:51:59.873151993Z Gathering data for ns/openshift-network-console...
2026-06-02T12:51:59.892998147Z INFO: Getting status from alertmanager-main-0
2026-06-02T12:52:00.111970192Z Wrote inspect data to must-gather.
2026-06-02T12:52:00.285090577Z Gathering data for ns/openshift-console-operator...
2026-06-02T12:52:00.363630800Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T12:52:00.367255301Z INFO: Fallback to identify the container image from release info
2026-06-02T12:52:00.641975181Z Gathering data for ns/openshift-console...
2026-06-02T12:52:01.031852991Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T12:52:01.071360730Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T12:52:01.149485898Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T12:52:01.261001334Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T12:52:01.426633956Z Gathering data for ns/openshift-dns-operator...
2026-06-02T12:52:01.712670394Z Gathering data for ns/openshift-dns...
2026-06-02T12:52:02.272485112Z Gathering data for ns/openshift-image-registry...
2026-06-02T12:52:02.370543788Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T12:52:02.735368340Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T12:52:02.937225059Z [disk usage checker] Volume usage percentage: current = 30 ; allowed = 70
2026-06-02T12:52:03.046935925Z Gathering data for ns/openshift-ingress...
2026-06-02T12:52:03.376168690Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T12:52:03.487813398Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T12:52:03.753824057Z Gathering data for ns/openshift-insights...
2026-06-02T12:52:04.601022186Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T12:52:05.486398078Z Gathering data for ns/openshift-jobset-operator...
2026-06-02T12:52:05.704343981Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T12:52:06.251657518Z Gathering data for ns/openshift-config...
2026-06-02T12:52:06.513130483Z Gathering data for ns/openshift-config-managed...
2026-06-02T12:52:06.829960483Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T12:52:06.953242674Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T12:52:07.202351759Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T12:52:07.453329715Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T12:52:07.719392885Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T12:52:07.942114077Z [disk usage checker] Volume usage percentage: current = 30 ; allowed = 70
2026-06-02T12:52:07.950400811Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T12:52:08.005275567Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T12:52:08.296644459Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T12:52:08.614692578Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T12:52:08.915788032Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T12:52:09.068702817Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T12:52:09.255052813Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T12:52:09.330987049Z Collecting performance related data for node ip-10-0-143-139.ec2.internal
2026-06-02T12:52:09.337639847Z Collecting performance related data for node ip-10-0-137-239.ec2.internal
2026-06-02T12:52:09.344749825Z Collecting performance related data for node ip-10-0-128-229.ec2.internal
2026-06-02T12:52:09.818415336Z Gathering data for ns/openshift-multus...
2026-06-02T12:52:11.219662376Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T12:52:12.684907206Z Gathering data for ns/openshift-host-network...
2026-06-02T12:52:12.947530971Z [disk usage checker] Volume usage percentage: current = 30 ; allowed = 70
2026-06-02T12:52:12.987849871Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T12:52:13.492496983Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T12:52:13.931608698Z Gathering data for ns/openshift-network-operator...
2026-06-02T12:52:14.315672201Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T12:52:14.568386871Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T12:52:15.102208709Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T12:52:15.429165748Z Gathering data for ns/openshift-apiserver...
2026-06-02T12:52:15.807374513Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T12:52:16.065820406Z Gathering data for ns/openshift-controller-manager...
2026-06-02T12:52:16.411397835Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T12:52:17.034586421Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T12:52:17.334748050Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T12:52:17.587003783Z Collecting kubelet logs for node ip-10-0-143-139.ec2.internal
2026-06-02T12:52:17.588907548Z Collecting kubelet logs for node ip-10-0-137-239.ec2.internal
2026-06-02T12:52:17.590533007Z Collecting kubelet logs for node ip-10-0-128-229.ec2.internal
2026-06-02T12:52:17.645408026Z Gathering data for ns/openshift-service-ca...
2026-06-02T12:52:17.935426917Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T12:52:17.940951322Z INFO: Node performance data collection complete.
2026-06-02T12:52:17.952783212Z [disk usage checker] Volume usage percentage: current = 30 ; allowed = 70
2026-06-02T12:52:18.048356490Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T12:52:18.906859322Z Wrote inspect data to must-gather.
2026-06-02T12:52:18.906907179Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T12:52:18.906907179Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T12:52:19.032113496Z error: the server doesn't have a resource type "clusters"
2026-06-02T12:52:19.159706810Z Caches written to disk