2026-04-16T17:15:58.878600628Z [disk usage checker] Started
2026-04-16T17:15:58.881704617Z [disk usage checker] Volume usage percentage: current = 24 ; allowed = 70
2026-04-16T17:15:59.209337570Z Gathering data for ns/openshift-cluster-version...
2026-04-16T17:15:59.358146377Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T17:15:59.454262813Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T17:15:59.539357303Z Gathering data for ns/default...
2026-04-16T17:15:59.909619846Z Gathering data for ns/openshift...
2026-04-16T17:16:00.343383503Z Gathering data for ns/kube-system...
2026-04-16T17:16:00.999648424Z Gathering data for ns/openshift-etcd...
2026-04-16T17:16:01.357248263Z Wrote inspect data to must-gather.
2026-04-16T17:16:01.357278235Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T17:16:01.357278235Z     namespaces "assisted-installer" not found
2026-04-16T17:16:01.547111523Z Waiting on subprocesses to finish execution.
2026-04-16T17:16:01.556799512Z INFO: Collecting host service logs for crio
2026-04-16T17:16:01.557056076Z INFO: Collecting host service logs for kubelet
2026-04-16T17:16:01.557365418Z INFO: Collecting host service logs for rpm-ostreed
2026-04-16T17:16:01.557659526Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-16T17:16:01.557959149Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-16T17:16:01.558316921Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-16T17:16:01.558669653Z INFO: Collecting host service logs for NetworkManager
2026-04-16T17:16:01.559018775Z INFO: Collecting host service logs for openvswitch
2026-04-16T17:16:01.559399778Z INFO: Collecting host service logs for ovs-configuration
2026-04-16T17:16:01.559737728Z INFO: Collecting host service logs for ovsdb-server
2026-04-16T17:16:01.560053505Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-16T17:16:01.560464633Z INFO: Waiting for worker host service log collection to complete ...
2026-04-16T17:16:01.561345404Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-16T17:16:01.571179522Z INFO: Waiting for node performance related collection to complete ...
2026-04-16T17:16:01.574778504Z INFO: Gathering HAProxy config files
2026-04-16T17:16:01.583132834Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-16T17:16:01.602662435Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-16T17:16:01.948344560Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-16T17:16:02.117382872Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-16T17:16:02.246226656Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-16T17:16:02.246313824Z INFO: on-disk MachineConfig config collection complete.
2026-04-16T17:16:02.425913436Z INFO: "metallb-operator" not detected. Skipping.
2026-04-16T17:16:02.582234738Z INFO: Collecting Insights Archives from insights-operator-5785d4fcdd-x9csm
2026-04-16T17:16:02.582234738Z insights-runtime-extractor-p6ljq
2026-04-16T17:16:02.582234738Z insights-runtime-extractor-r6bck
2026-04-16T17:16:02.582234738Z insights-runtime-extractor-t9n8c
2026-04-16T17:16:02.821938348Z No resources found
2026-04-16T17:16:02.862293181Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-16T17:16:02.902992172Z error: the server doesn't have a resource type "performanceprofile"
2026-04-16T17:16:02.929710930Z No resources found in openshift-etcd namespace.
2026-04-16T17:16:03.038617533Z INFO: Worker host service log collection to complete.
2026-04-16T17:16:03.208772717Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-16T17:16:03.224211060Z Wrote inspect data to must-gather.
2026-04-16T17:16:03.248518690Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-16T17:16:03.248518690Z See 'oc rsync -h' for help and examples
2026-04-16T17:16:03.295491309Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-16T17:16:03.399844171Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-16T17:16:03.753494009Z Wrote inspect data to must-gather.
2026-04-16T17:16:03.753518145Z ERROR: No running kube-apiserver pods found
2026-04-16T17:16:03.800486826Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-16T17:16:03.994550532Z No resources found
2026-04-16T17:16:04.036710727Z [disk usage checker] Volume usage percentage: current = 24 ; allowed = 70
2026-04-16T17:16:04.054511182Z tar: Removing leading `/' from member names
2026-04-16T17:16:04.062175482Z INFO: HAProxy config collection complete.
2026-04-16T17:16:04.089816863Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T17:16:04.277807976Z Wrote inspect data to must-gather.
2026-04-16T17:16:04.292463680Z Wrote inspect data to must-gather.
2026-04-16T17:16:04.380038171Z INFO: 'previous-logs' folder not found on ip-10-0-137-126.ec2.internal, skipping...
2026-04-16T17:16:04.403880892Z Wrote inspect data to must-gather.
2026-04-16T17:16:04.421748096Z Wrote inspect data to must-gather.
2026-04-16T17:16:04.521466819Z Gathering data for ns/kuadrant-system...
2026-04-16T17:16:04.649894657Z error: the server doesn't have a resource type "machineconfigs"
2026-04-16T17:16:04.668588036Z INFO: Getting rules from prometheus-k8s-0
2026-04-16T17:16:04.812520768Z Wrote inspect data to must-gather.
2026-04-16T17:16:04.813722609Z INFO: 'previous-logs' folder not found on ip-10-0-138-58.ec2.internal, skipping...
2026-04-16T17:16:05.008013369Z Wrote inspect data to must-gather.
2026-04-16T17:16:05.060455265Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T17:16:05.234251260Z INFO: Getting status/config from prometheus-k8s-0
2026-04-16T17:16:05.247491421Z Wrote inspect data to must-gather.
2026-04-16T17:16:05.250270159Z INFO: 'previous-logs' folder not found on ip-10-0-143-10.ec2.internal, skipping...
2026-04-16T17:16:05.250437267Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-16T17:16:05.250489660Z INFO: Machine Config Daemon termination log collection complete.
2026-04-16T17:16:05.352829227Z Wrote inspect data to must-gather.
2026-04-16T17:16:05.393473880Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T17:16:05.606491570Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-16T17:16:05.611593828Z Gathering data for ns/openshift-monitoring...
2026-04-16T17:16:05.645541759Z Wrote inspect data to must-gather.
2026-04-16T17:16:05.779687942Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-16T17:16:05.932106166Z Wrote inspect data to must-gather.
2026-04-16T17:16:06.018664855Z INFO: INTERCONNECT MODE
2026-04-16T17:16:06.018719768Z INFO: Gathering ovn-kubernetes DBs
2026-04-16T17:16:06.059193157Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-16T17:16:06.227943347Z INFO: Gathering OVN_Northbound from ovnkube-node-2fwqq...
2026-04-16T17:16:06.228241009Z INFO: Gathering OVN_Northbound from ovnkube-node-brhp4...
2026-04-16T17:16:06.228479378Z INFO: Gathering OVN_Northbound from ovnkube-node-vts2x...
2026-04-16T17:16:06.228775306Z INFO: Gathering OVN_Southbound from ovnkube-node-2fwqq...
2026-04-16T17:16:06.229086528Z INFO: Gathering OVN_Southbound from ovnkube-node-brhp4...
2026-04-16T17:16:06.229367717Z INFO: Gathering OVN_Southbound from ovnkube-node-vts2x...
2026-04-16T17:16:06.282521255Z Wrote inspect data to must-gather.
2026-04-16T17:16:06.332101610Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-16T17:16:06.545167123Z tar: Removing leading `/' from member names
2026-04-16T17:16:06.569508308Z tar: Removing leading `/' from member names
2026-04-16T17:16:06.574816816Z tar: Removing leading `/' from member names
2026-04-16T17:16:06.579908812Z tar: Removing leading `/' from member names
2026-04-16T17:16:06.611730444Z tar: Removing leading `/' from member names
2026-04-16T17:16:06.626336240Z tar: Removing leading `/' from member names
2026-04-16T17:16:06.772133044Z Wrote inspect data to must-gather.
2026-04-16T17:16:06.786947896Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-16T17:16:07.091084334Z Wrote inspect data to must-gather.
2026-04-16T17:16:07.261249458Z INFO: Waiting for network log collection to complete ...
2026-04-16T17:16:07.261285810Z INFO: Waiting for ovnk database copies to complete ...
2026-04-16T17:16:07.261750359Z INFO: Copying ovnk databases complete.
2026-04-16T17:16:07.263733331Z 5.0M	must-gather/network_logs/ovnk_database_store
2026-04-16T17:16:07.266102807Z ovnk_database_store/
2026-04-16T17:16:07.266102807Z ovnk_database_store/ovnkube-node-brhp4_nbdb
2026-04-16T17:16:07.272527190Z INFO: Getting status from alertmanager-main-0
2026-04-16T17:16:07.280681758Z ovnk_database_store/ovnkube-node-vts2x_sbdb
2026-04-16T17:16:07.315448343Z ovnk_database_store/ovnkube-node-vts2x_nbdb
2026-04-16T17:16:07.327881420Z ovnk_database_store/ovnkube-node-2fwqq_nbdb
2026-04-16T17:16:07.339234792Z ovnk_database_store/ovnkube-node-2fwqq_sbdb
2026-04-16T17:16:07.369679504Z ovnk_database_store/ovnkube-node-brhp4_sbdb
2026-04-16T17:16:07.408114886Z INFO: Network log collection complete.
2026-04-16T17:16:07.438697442Z Wrote inspect data to must-gather.
2026-04-16T17:16:07.773656549Z Gathering data for ns/openshift-network-console...
2026-04-16T17:16:07.787920524Z Wrote inspect data to must-gather.
2026-04-16T17:16:08.191565446Z Wrote inspect data to must-gather.
2026-04-16T17:16:08.297895243Z Gathering data for ns/openshift-console-operator...
2026-04-16T17:16:08.503864625Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-16T17:16:08.507136326Z INFO: Fallback to identify the container image from release info
2026-04-16T17:16:08.763430975Z Gathering data for ns/openshift-console...
2026-04-16T17:16:08.953845268Z Wrote inspect data to must-gather.
2026-04-16T17:16:09.043977370Z [disk usage checker] Volume usage percentage: current = 24 ; allowed = 70
2026-04-16T17:16:09.052548044Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc77fc5f1546189d6b57967ccc684e794bd846ea36c3e3c1e61d83a684f0f9b9
2026-04-16T17:16:09.191510790Z daemonset.apps/perf-node-gather-daemonset created
2026-04-16T17:16:09.256862150Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-16T17:16:09.349442663Z Waiting for performance profile collector pods to become ready: 1
2026-04-16T17:16:09.657470817Z Gathering data for ns/openshift-dns-operator...
2026-04-16T17:16:09.974345007Z Gathering data for ns/openshift-dns...
2026-04-16T17:16:10.489685824Z Waiting for performance profile collector pods to become ready: 2
2026-04-16T17:16:10.573438216Z Gathering data for ns/openshift-image-registry...
2026-04-16T17:16:11.039563389Z Gathering data for ns/openshift-ingress-operator...
2026-04-16T17:16:11.381245542Z Gathering data for ns/openshift-ingress...
2026-04-16T17:16:11.631676631Z Waiting for performance profile collector pods to become ready: 3
2026-04-16T17:16:11.905317621Z Gathering data for ns/openshift-ingress-canary...
2026-04-16T17:16:12.335102873Z Gathering data for ns/openshift-insights...
2026-04-16T17:16:12.752685576Z Waiting for performance profile collector pods to become ready: 4
2026-04-16T17:16:13.884691396Z Waiting for performance profile collector pods to become ready: 5
2026-04-16T17:16:14.048370729Z [disk usage checker] Volume usage percentage: current = 24 ; allowed = 70
2026-04-16T17:16:14.934552822Z Gathering data for ns/openshift-lws-operator...
2026-04-16T17:16:15.021606720Z Waiting for performance profile collector pods to become ready: 6
2026-04-16T17:16:15.477864161Z Gathering data for ns/kserve...
2026-04-16T17:16:16.162539200Z Waiting for performance profile collector pods to become ready: 7
2026-04-16T17:16:17.185145646Z Gathering data for ns/openshift-config...
2026-04-16T17:16:17.304370469Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-16T17:16:17.510884131Z Gathering data for ns/openshift-config-managed...
2026-04-16T17:16:17.615086105Z Collecting performance related data for node ip-10-0-137-126.ec2.internal
2026-04-16T17:16:17.621673434Z Collecting performance related data for node ip-10-0-143-10.ec2.internal
2026-04-16T17:16:17.628684516Z Collecting performance related data for node ip-10-0-138-58.ec2.internal
2026-04-16T17:16:18.044664915Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-16T17:16:18.409570273Z Gathering data for ns/openshift-kube-apiserver...
2026-04-16T17:16:18.827323645Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-16T17:16:19.054577294Z [disk usage checker] Volume usage percentage: current = 24 ; allowed = 70
2026-04-16T17:16:19.197782863Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-16T17:16:19.563360682Z Gathering data for ns/openshift-kube-scheduler...
2026-04-16T17:16:19.857546692Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-16T17:16:20.217176178Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-16T17:16:20.645885987Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-16T17:16:21.014367735Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-16T17:16:21.571025909Z Gathering data for ns/openshift-multus...
2026-04-16T17:16:22.957321812Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-16T17:16:24.058922091Z [disk usage checker] Volume usage percentage: current = 24 ; allowed = 70
2026-04-16T17:16:24.504191594Z Gathering data for ns/openshift-host-network...
2026-04-16T17:16:24.864898512Z Gathering data for ns/openshift-network-diagnostics...
2026-04-16T17:16:25.402006038Z Gathering data for ns/openshift-network-node-identity...
2026-04-16T17:16:25.885003256Z Gathering data for ns/openshift-network-operator...
2026-04-16T17:16:26.183542034Z Collecting kubelet logs for node ip-10-0-137-126.ec2.internal
2026-04-16T17:16:26.185703223Z Collecting kubelet logs for node ip-10-0-143-10.ec2.internal
2026-04-16T17:16:26.187437628Z Collecting kubelet logs for node ip-10-0-138-58.ec2.internal
2026-04-16T17:16:26.299307728Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-16T17:16:26.633889756Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-16T17:16:26.640936609Z INFO: Node performance data collection complete.
2026-04-16T17:16:26.658730783Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-16T17:16:27.132639574Z Gathering data for ns/openshift-apiserver-operator...
2026-04-16T17:16:27.442984017Z Gathering data for ns/openshift-apiserver...
2026-04-16T17:16:27.892328804Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-16T17:16:28.212320757Z Gathering data for ns/openshift-controller-manager...
2026-04-16T17:16:28.510270027Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-16T17:16:29.063285428Z [disk usage checker] Volume usage percentage: current = 24 ; allowed = 70
2026-04-16T17:16:29.155457834Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-16T17:16:29.465023233Z Gathering data for ns/openshift-service-ca-operator...
2026-04-16T17:16:29.816846344Z Gathering data for ns/openshift-service-ca...
2026-04-16T17:16:30.208330522Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-16T17:16:31.110877739Z Wrote inspect data to must-gather.
2026-04-16T17:16:31.110924893Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T17:16:31.110924893Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-16T17:16:31.246990127Z error: the server doesn't have a resource type "clusters"
2026-04-16T17:16:31.426673037Z Caches written to disk