2026-04-16T18:24:26.755380796Z [disk usage checker] Started
2026-04-16T18:24:26.759055705Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-16T18:24:26.965994899Z Gathering data for ns/openshift-cluster-version...
2026-04-16T18:24:27.102396723Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T18:24:27.201074747Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T18:24:27.288008998Z Gathering data for ns/default...
2026-04-16T18:24:27.592727819Z Gathering data for ns/openshift...
2026-04-16T18:24:28.016160149Z Gathering data for ns/kube-system...
2026-04-16T18:24:28.753207952Z Gathering data for ns/openshift-etcd...
2026-04-16T18:24:29.079814146Z Wrote inspect data to must-gather.
2026-04-16T18:24:29.079845896Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T18:24:29.079845896Z     namespaces "assisted-installer" not found
2026-04-16T18:24:29.198588087Z Waiting on subprocesses to finish execution.
2026-04-16T18:24:29.208002920Z INFO: Gathering HAProxy config files
2026-04-16T18:24:29.208720410Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-16T18:24:29.212952165Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-16T18:24:29.225594349Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-16T18:24:29.234920357Z INFO: Waiting for node performance related collection to complete ...
2026-04-16T18:24:29.243996685Z INFO: Collecting host service logs for crio
2026-04-16T18:24:29.244404162Z INFO: Collecting host service logs for kubelet
2026-04-16T18:24:29.244719989Z INFO: Collecting host service logs for rpm-ostreed
2026-04-16T18:24:29.245015884Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-16T18:24:29.245340159Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-16T18:24:29.245708792Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-16T18:24:29.246057395Z INFO: Collecting host service logs for NetworkManager
2026-04-16T18:24:29.246400322Z INFO: Collecting host service logs for openvswitch
2026-04-16T18:24:29.250624115Z INFO: Collecting host service logs for ovs-configuration
2026-04-16T18:24:29.250991899Z INFO: Collecting host service logs for ovsdb-server
2026-04-16T18:24:29.251362962Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-16T18:24:29.251855389Z INFO: Waiting for worker host service log collection to complete ...
2026-04-16T18:24:29.990027648Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-16T18:24:29.994029230Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-16T18:24:30.069668480Z Wrote inspect data to must-gather.
2026-04-16T18:24:30.106399945Z No resources found in openshift-etcd namespace.
2026-04-16T18:24:30.173580615Z error: the server doesn't have a resource type "performanceprofile"
2026-04-16T18:24:30.260575904Z INFO: "metallb-operator" not detected. Skipping.
2026-04-16T18:24:30.317103357Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-16T18:24:30.317185647Z INFO: on-disk MachineConfig config collection complete.
2026-04-16T18:24:30.342568370Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-16T18:24:30.449052709Z No resources found
2026-04-16T18:24:30.528885563Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-16T18:24:30.539654632Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-16T18:24:30.647782295Z INFO: Worker host service log collection to complete.
2026-04-16T18:24:30.828995085Z INFO: Collecting Insights Archives from insights-operator-5785d4fcdd-qw5wn
2026-04-16T18:24:30.829067205Z insights-runtime-extractor-qwzcn
2026-04-16T18:24:30.829088311Z insights-runtime-extractor-shshw
2026-04-16T18:24:30.829109178Z insights-runtime-extractor-tzzx2
2026-04-16T18:24:30.918838330Z No resources found
2026-04-16T18:24:30.968971243Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-16T18:24:31.038936199Z Wrote inspect data to must-gather.
2026-04-16T18:24:31.100852859Z Wrote inspect data to must-gather.
2026-04-16T18:24:31.297469967Z ERROR: No running kube-apiserver pods found
2026-04-16T18:24:31.343178553Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T18:24:31.377523553Z Wrote inspect data to must-gather.
2026-04-16T18:24:31.381016333Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-16T18:24:31.483664799Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-16T18:24:31.483664799Z See 'oc rsync -h' for help and examples
2026-04-16T18:24:31.508583845Z tar: Removing leading `/' from member names
2026-04-16T18:24:31.517774386Z INFO: HAProxy config collection complete.
2026-04-16T18:24:31.542169083Z INFO: 'previous-logs' folder not found on ip-10-0-128-209.ec2.internal, skipping...
2026-04-16T18:24:31.573646970Z Wrote inspect data to must-gather.
2026-04-16T18:24:31.583726587Z error: the server doesn't have a resource type "machineconfigs"
2026-04-16T18:24:31.586665145Z Wrote inspect data to must-gather.
2026-04-16T18:24:31.647416009Z Wrote inspect data to must-gather.
2026-04-16T18:24:31.767906756Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-16T18:24:31.824185166Z Wrote inspect data to must-gather.
2026-04-16T18:24:31.848671264Z INFO: Getting rules from prometheus-k8s-0
2026-04-16T18:24:31.855911890Z INFO: 'previous-logs' folder not found on ip-10-0-137-213.ec2.internal, skipping...
2026-04-16T18:24:31.922871784Z Wrote inspect data to must-gather.
2026-04-16T18:24:31.945082446Z Gathering data for ns/openshift-monitoring...
2026-04-16T18:24:32.082705091Z Wrote inspect data to must-gather.
2026-04-16T18:24:32.178062022Z INFO: 'previous-logs' folder not found on ip-10-0-138-15.ec2.internal, skipping...
2026-04-16T18:24:32.178097839Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-16T18:24:32.178131049Z INFO: Machine Config Daemon termination log collection complete.
2026-04-16T18:24:32.190407858Z Wrote inspect data to must-gather.
2026-04-16T18:24:32.256810361Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-16T18:24:32.284209914Z INFO: Getting status/config from prometheus-k8s-0
2026-04-16T18:24:32.445368675Z Wrote inspect data to must-gather.
2026-04-16T18:24:32.484848381Z Wrote inspect data to must-gather.
2026-04-16T18:24:32.699120298Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-16T18:24:32.705870208Z Wrote inspect data to must-gather.
2026-04-16T18:24:32.748542872Z INFO: INTERCONNECT MODE
2026-04-16T18:24:32.748571317Z INFO: Gathering ovn-kubernetes DBs
2026-04-16T18:24:32.916008928Z INFO: Gathering OVN_Northbound from ovnkube-node-k7zg2...
2026-04-16T18:24:32.916333840Z INFO: Gathering OVN_Northbound from ovnkube-node-mv8js...
2026-04-16T18:24:32.916589792Z INFO: Gathering OVN_Northbound from ovnkube-node-x27gf...
2026-04-16T18:24:32.916876225Z INFO: Gathering OVN_Southbound from ovnkube-node-k7zg2...
2026-04-16T18:24:32.917152560Z INFO: Gathering OVN_Southbound from ovnkube-node-mv8js...
2026-04-16T18:24:32.917638271Z INFO: Gathering OVN_Southbound from ovnkube-node-x27gf...
2026-04-16T18:24:32.938447181Z Wrote inspect data to must-gather.
2026-04-16T18:24:32.962926622Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-16T18:24:33.210988898Z tar: Removing leading `/' from member names
2026-04-16T18:24:33.231630749Z tar: Removing leading `/' from member names
2026-04-16T18:24:33.245843222Z tar: Removing leading `/' from member names
2026-04-16T18:24:33.246183350Z tar: Removing leading `/' from member names
2026-04-16T18:24:33.252247188Z tar: Removing leading `/' from member names
2026-04-16T18:24:33.257218017Z tar: Removing leading `/' from member names
2026-04-16T18:24:33.292146186Z Wrote inspect data to must-gather.
2026-04-16T18:24:33.311809832Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-16T18:24:33.534577501Z Wrote inspect data to must-gather.
2026-04-16T18:24:33.547221923Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T18:24:33.588422587Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-16T18:24:33.764876329Z Wrote inspect data to must-gather.
2026-04-16T18:24:33.780682121Z INFO: Waiting for network log collection to complete ...
2026-04-16T18:24:33.780862530Z INFO: Waiting for ovnk database copies to complete ...
2026-04-16T18:24:33.781400117Z INFO: Copying ovnk databases complete.
2026-04-16T18:24:33.783115842Z 3.4M	must-gather/network_logs/ovnk_database_store
2026-04-16T18:24:33.785942611Z ovnk_database_store/
2026-04-16T18:24:33.785942611Z ovnk_database_store/ovnkube-node-mv8js_nbdb
2026-04-16T18:24:33.797454096Z ovnk_database_store/ovnkube-node-x27gf_nbdb
2026-04-16T18:24:33.806009187Z ovnk_database_store/ovnkube-node-x27gf_sbdb
2026-04-16T18:24:33.824980844Z ovnk_database_store/ovnkube-node-k7zg2_nbdb
2026-04-16T18:24:33.833137891Z ovnk_database_store/ovnkube-node-mv8js_sbdb
2026-04-16T18:24:33.852658294Z ovnk_database_store/ovnkube-node-k7zg2_sbdb
2026-04-16T18:24:33.876398368Z INFO: Network log collection complete.
2026-04-16T18:24:33.974322554Z Wrote inspect data to must-gather.
2026-04-16T18:24:34.014930760Z INFO: Getting status from alertmanager-main-0
2026-04-16T18:24:34.144388061Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T18:24:34.252094576Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-16T18:24:34.254075284Z INFO: Fallback to identify the container image from release info
2026-04-16T18:24:34.306928910Z Gathering data for ns/openshift-network-console...
2026-04-16T18:24:34.693009332Z Gathering data for ns/openshift-console-operator...
2026-04-16T18:24:34.778046211Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc77fc5f1546189d6b57967ccc684e794bd846ea36c3e3c1e61d83a684f0f9b9
2026-04-16T18:24:34.895470397Z daemonset.apps/perf-node-gather-daemonset created
2026-04-16T18:24:35.031016958Z Waiting for performance profile collector pods to become ready: 1
2026-04-16T18:24:35.078321661Z Gathering data for ns/openshift-console...
2026-04-16T18:24:35.537740084Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-16T18:24:35.880039257Z Gathering data for ns/openshift-dns-operator...
2026-04-16T18:24:36.171447919Z Waiting for performance profile collector pods to become ready: 2
2026-04-16T18:24:36.175050920Z Gathering data for ns/openshift-dns...
2026-04-16T18:24:36.773307109Z Gathering data for ns/openshift-image-registry...
2026-04-16T18:24:36.773307109Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-16T18:24:37.268208346Z Gathering data for ns/openshift-ingress-operator...
2026-04-16T18:24:37.309955677Z Waiting for performance profile collector pods to become ready: 3
2026-04-16T18:24:37.608720142Z Gathering data for ns/openshift-ingress...
2026-04-16T18:24:37.942068995Z Gathering data for ns/openshift-ingress-canary...
2026-04-16T18:24:38.333469854Z Gathering data for ns/openshift-insights...
2026-04-16T18:24:38.433464230Z Waiting for performance profile collector pods to become ready: 4
2026-04-16T18:24:39.558506555Z Waiting for performance profile collector pods to become ready: 5
2026-04-16T18:24:40.471999509Z Gathering data for ns/kserve...
2026-04-16T18:24:40.681561127Z Waiting for performance profile collector pods to become ready: 6
2026-04-16T18:24:41.777982195Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-16T18:24:41.807778865Z Waiting for performance profile collector pods to become ready: 7
2026-04-16T18:24:41.922247231Z Gathering data for ns/openshift-config...
2026-04-16T18:24:42.218981085Z Gathering data for ns/openshift-config-managed...
2026-04-16T18:24:42.728518730Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-16T18:24:42.920554936Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-16T18:24:43.024806902Z Gathering data for ns/openshift-kube-apiserver...
2026-04-16T18:24:43.192085710Z Collecting performance related data for node ip-10-0-137-213.ec2.internal
2026-04-16T18:24:43.199632925Z Collecting performance related data for node ip-10-0-138-15.ec2.internal
2026-04-16T18:24:43.208438726Z Collecting performance related data for node ip-10-0-128-209.ec2.internal
2026-04-16T18:24:43.406130088Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-16T18:24:43.756682681Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-16T18:24:44.165404902Z Gathering data for ns/openshift-kube-scheduler...
2026-04-16T18:24:44.538264403Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-16T18:24:44.955611445Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-16T18:24:45.298033493Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-16T18:24:45.680939926Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-16T18:24:46.247180206Z Gathering data for ns/openshift-multus...
2026-04-16T18:24:46.782804930Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-16T18:24:47.959798948Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-16T18:24:49.672406823Z Gathering data for ns/openshift-host-network...
2026-04-16T18:24:49.969116057Z Gathering data for ns/openshift-network-diagnostics...
2026-04-16T18:24:50.527977718Z Gathering data for ns/openshift-network-node-identity...
2026-04-16T18:24:50.948492585Z Gathering data for ns/openshift-network-operator...
2026-04-16T18:24:51.346949746Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-16T18:24:51.375419848Z Collecting kubelet logs for node ip-10-0-137-213.ec2.internal
2026-04-16T18:24:51.377804414Z Collecting kubelet logs for node ip-10-0-138-15.ec2.internal
2026-04-16T18:24:51.380105016Z Collecting kubelet logs for node ip-10-0-128-209.ec2.internal
2026-04-16T18:24:51.671678113Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-16T18:24:51.760871685Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-16T18:24:51.768286724Z INFO: Node performance data collection complete.
2026-04-16T18:24:51.787699861Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-16T18:24:52.180982174Z Gathering data for ns/openshift-apiserver-operator...
2026-04-16T18:24:52.527615408Z Gathering data for ns/openshift-apiserver...
2026-04-16T18:24:52.930382120Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-16T18:24:53.211169854Z Gathering data for ns/openshift-controller-manager...
2026-04-16T18:24:53.508666668Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-16T18:24:54.180315371Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-16T18:24:54.475198247Z Gathering data for ns/openshift-service-ca-operator...
2026-04-16T18:24:54.803825307Z Gathering data for ns/openshift-service-ca...
2026-04-16T18:24:55.216028472Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-16T18:24:56.137738077Z Wrote inspect data to must-gather.
2026-04-16T18:24:56.137781544Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T18:24:56.137781544Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-16T18:24:56.265337118Z error: the server doesn't have a resource type "clusters"
2026-04-16T18:24:56.398217519Z Caches written to disk