2026-05-25T13:52:55.430878874Z [disk usage checker] Started
2026-05-25T13:52:55.434053099Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-05-25T13:52:55.659396665Z Gathering data for ns/openshift-cluster-version...
2026-05-25T13:52:55.804117381Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-25T13:52:55.890955561Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-25T13:52:55.983978648Z Gathering data for ns/default...
2026-05-25T13:52:56.319766054Z Gathering data for ns/openshift...
2026-05-25T13:52:56.806050042Z Gathering data for ns/kube-system...
2026-05-25T13:52:57.650278057Z Gathering data for ns/openshift-etcd...
2026-05-25T13:52:57.846333300Z Waiting on subprocesses to finish execution.
2026-05-25T13:52:57.852473846Z INFO: Gathering machine config daemon's old logs from all nodes
2026-05-25T13:52:57.853389954Z INFO: Gathering HAProxy config files
2026-05-25T13:52:57.860290792Z INFO: Collecting host service logs for crio
2026-05-25T13:52:57.860647956Z INFO: Collecting host service logs for kubelet
2026-05-25T13:52:57.860979532Z INFO: Collecting host service logs for rpm-ostreed
2026-05-25T13:52:57.861319053Z INFO: Collecting host service logs for ostree-finalize-staged
2026-05-25T13:52:57.861781618Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-05-25T13:52:57.862117909Z INFO: Collecting host service logs for machine-config-daemon-host
2026-05-25T13:52:57.862458074Z INFO: Collecting host service logs for NetworkManager
2026-05-25T13:52:57.862819363Z INFO: Collecting host service logs for openvswitch
2026-05-25T13:52:57.863164196Z INFO: Collecting host service logs for ovs-configuration
2026-05-25T13:52:57.863583921Z INFO: Collecting host service logs for ovsdb-server
2026-05-25T13:52:57.863934390Z INFO: Collecting host service logs for ovs-vswitchd
2026-05-25T13:52:57.864335650Z INFO: Waiting for worker host service log collection to complete ...
2026-05-25T13:52:57.865238808Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-05-25T13:52:57.871050787Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-05-25T13:52:58.105120724Z INFO: Waiting for node performance related collection to complete ...
2026-05-25T13:52:58.474644269Z No resources found in openshift-etcd namespace.
2026-05-25T13:52:58.575808640Z INFO: "metallb-operator" not detected. Skipping.
2026-05-25T13:52:58.740891763Z INFO: Found 1 replicas - prometheus-k8s-0
2026-05-25T13:52:58.758855393Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-05-25T13:52:58.925095329Z No resources found
2026-05-25T13:52:58.979086143Z error: the server doesn't have a resource type "performanceprofile"
2026-05-25T13:52:59.024950815Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-05-25T13:52:59.054683201Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-05-25T13:52:59.057447611Z INFO: on-disk MachineConfig config collection complete.
2026-05-25T13:52:59.068945231Z INFO: "sriov-network-operator" not detected. Skipping.
2026-05-25T13:52:59.143697827Z INFO: Collecting Insights Archives from insights-operator-78bdfb888c-2nxfp
2026-05-25T13:52:59.143761131Z insights-runtime-extractor-246hq
2026-05-25T13:52:59.143781471Z insights-runtime-extractor-7qhj7
2026-05-25T13:52:59.143800832Z insights-runtime-extractor-fp5gh
2026-05-25T13:52:59.163680351Z Wrote inspect data to must-gather.
2026-05-25T13:52:59.208139209Z Wrote inspect data to must-gather.
2026-05-25T13:52:59.208176495Z error: inspection completed with the errors occurred while gathering data:
2026-05-25T13:52:59.208176495Z     namespaces "assisted-installer" not found
2026-05-25T13:52:59.234332016Z INFO: Worker host service log collection to complete.
2026-05-25T13:52:59.276012561Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-05-25T13:52:59.337281459Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-05-25T13:52:59.337281459Z See 'oc rsync -h' for help and examples
2026-05-25T13:52:59.446637574Z INFO: Waiting for HAProxy config collection to complete ...
2026-05-25T13:52:59.451280930Z ERROR: No running kube-apiserver pods found
2026-05-25T13:52:59.526300004Z Wrote inspect data to must-gather.
2026-05-25T13:52:59.656288862Z Wrote inspect data to must-gather.
2026-05-25T13:52:59.765266623Z INFO: 'previous-logs' folder not found on ip-10-0-135-137.ec2.internal, skipping...
2026-05-25T13:52:59.893068012Z No resources found
2026-05-25T13:52:59.998082801Z Wrote inspect data to must-gather.
2026-05-25T13:53:00.012975857Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-25T13:53:00.105356971Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-05-25T13:53:00.141955209Z error: the server doesn't have a resource type "machineconfigs"
2026-05-25T13:53:00.156734275Z Gathering data for ns/openshift-monitoring...
2026-05-25T13:53:00.158125434Z Wrote inspect data to must-gather.
2026-05-25T13:53:00.219665596Z Wrote inspect data to must-gather.
2026-05-25T13:53:00.220826307Z tar: Removing leading `/' from member names
2026-05-25T13:53:00.228868364Z INFO: HAProxy config collection complete.
2026-05-25T13:53:00.260393263Z Wrote inspect data to must-gather.
2026-05-25T13:53:00.310947537Z INFO: 'previous-logs' folder not found on ip-10-0-141-211.ec2.internal, skipping...
2026-05-25T13:53:00.328427706Z INFO: Getting rules from prometheus-k8s-0
2026-05-25T13:53:00.385813487Z Wrote inspect data to must-gather.
2026-05-25T13:53:00.440554463Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-05-25T13:53:00.520270386Z Wrote inspect data to must-gather.
2026-05-25T13:53:00.565785949Z INFO: 'previous-logs' folder not found on ip-10-0-143-87.ec2.internal, skipping...
2026-05-25T13:53:00.565897135Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-05-25T13:53:00.565948835Z INFO: Machine Config Daemon termination log collection complete.
2026-05-25T13:53:00.624429205Z Wrote inspect data to must-gather.
2026-05-25T13:53:00.731013894Z INFO: Getting status/config from prometheus-k8s-0
2026-05-25T13:53:00.762257690Z Wrote inspect data to must-gather.
2026-05-25T13:53:00.781753374Z error: the server doesn't have a resource type "kubeletconfigs"
2026-05-25T13:53:00.990445210Z Wrote inspect data to must-gather.
2026-05-25T13:53:00.991965455Z Wrote inspect data to must-gather.
2026-05-25T13:53:01.139317659Z INFO: Getting status/flags from prometheus-k8s-0
2026-05-25T13:53:01.205208010Z Wrote inspect data to must-gather.
2026-05-25T13:53:01.264733708Z INFO: INTERCONNECT MODE
2026-05-25T13:53:01.264733708Z INFO: Gathering ovn-kubernetes DBs
2026-05-25T13:53:01.366920207Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-05-25T13:53:01.399306485Z Wrote inspect data to must-gather.
2026-05-25T13:53:01.422164190Z INFO: Gathering OVN_Northbound from ovnkube-node-5494s...
2026-05-25T13:53:01.422399108Z INFO: Gathering OVN_Northbound from ovnkube-node-g96mk...
2026-05-25T13:53:01.422618586Z INFO: Gathering OVN_Northbound from ovnkube-node-hd4x4...
2026-05-25T13:53:01.422887718Z INFO: Gathering OVN_Southbound from ovnkube-node-5494s...
2026-05-25T13:53:01.423140513Z INFO: Gathering OVN_Southbound from ovnkube-node-g96mk...
2026-05-25T13:53:01.423471927Z INFO: Gathering OVN_Southbound from ovnkube-node-hd4x4...
2026-05-25T13:53:01.715258561Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-05-25T13:53:01.749566167Z tar: Removing leading `/' from member names
2026-05-25T13:53:01.777959642Z tar: Removing leading `/' from member names
2026-05-25T13:53:01.780582194Z tar: Removing leading `/' from member names
2026-05-25T13:53:01.783632582Z tar: Removing leading `/' from member names
2026-05-25T13:53:01.792273833Z tar: Removing leading `/' from member names
2026-05-25T13:53:01.792370180Z tar: Removing leading `/' from member names
2026-05-25T13:53:01.799470731Z Wrote inspect data to must-gather.
2026-05-25T13:53:01.803842743Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-25T13:53:01.989955957Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-05-25T13:53:02.045057296Z Wrote inspect data to must-gather.
2026-05-25T13:53:02.209044859Z INFO: Waiting for network log collection to complete ...
2026-05-25T13:53:02.209185164Z INFO: Waiting for ovnk database copies to complete ...
2026-05-25T13:53:02.209670719Z INFO: Copying ovnk databases complete.
2026-05-25T13:53:02.211421357Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-05-25T13:53:02.213706525Z ovnk_database_store/
2026-05-25T13:53:02.213732291Z ovnk_database_store/ovnkube-node-5494s_sbdb
2026-05-25T13:53:02.231163700Z ovnk_database_store/ovnkube-node-g96mk_nbdb
2026-05-25T13:53:02.240672138Z ovnk_database_store/ovnkube-node-5494s_nbdb
2026-05-25T13:53:02.249130089Z ovnk_database_store/ovnkube-node-g96mk_sbdb
2026-05-25T13:53:02.266157880Z Wrote inspect data to must-gather.
2026-05-25T13:53:02.268440058Z ovnk_database_store/ovnkube-node-hd4x4_sbdb
2026-05-25T13:53:02.285185231Z ovnk_database_store/ovnkube-node-hd4x4_nbdb
2026-05-25T13:53:02.294011413Z INFO: Network log collection complete.
2026-05-25T13:53:02.376172064Z INFO: Getting status from alertmanager-main-0
2026-05-25T13:53:02.470993792Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-25T13:53:02.556568683Z Wrote inspect data to must-gather.
2026-05-25T13:53:02.641908379Z Gathering data for ns/openshift-network-console...
2026-05-25T13:53:02.809846911Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-05-25T13:53:02.812247653Z INFO: Fallback to identify the container image from release info
2026-05-25T13:53:03.105359268Z Gathering data for ns/openshift-console-operator...
2026-05-25T13:53:03.444363901Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:934b226bb305ecfe687cdb9684d7d4cf04b130e6254c2817dd1a6112d4829bda
2026-05-25T13:53:03.475927817Z Gathering data for ns/openshift-console...
2026-05-25T13:53:03.567614343Z daemonset.apps/perf-node-gather-daemonset created
2026-05-25T13:53:03.691749249Z Waiting for performance profile collector pods to become ready: 1
2026-05-25T13:53:03.917466597Z Gathering data for ns/openshift-cluster-storage-operator...
2026-05-25T13:53:04.332762679Z Gathering data for ns/openshift-dns-operator...
2026-05-25T13:53:04.633690066Z Gathering data for ns/openshift-dns...
2026-05-25T13:53:04.801372940Z Waiting for performance profile collector pods to become ready: 2
2026-05-25T13:53:05.241946076Z Gathering data for ns/openshift-image-registry...
2026-05-25T13:53:05.445985260Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-05-25T13:53:05.764494510Z Gathering data for ns/openshift-ingress-operator...
2026-05-25T13:53:05.918776090Z Waiting for performance profile collector pods to become ready: 3
2026-05-25T13:53:06.149605766Z Gathering data for ns/openshift-ingress...
2026-05-25T13:53:06.509233139Z Gathering data for ns/openshift-ingress-canary...
2026-05-25T13:53:06.956270635Z Gathering data for ns/openshift-insights...
2026-05-25T13:53:07.029632711Z Waiting for performance profile collector pods to become ready: 4
2026-05-25T13:53:08.138985555Z Waiting for performance profile collector pods to become ready: 5
2026-05-25T13:53:08.859729592Z Gathering data for ns/openshift-jobset-operator...
2026-05-25T13:53:09.261362619Z Waiting for performance profile collector pods to become ready: 6
2026-05-25T13:53:09.654377063Z Gathering data for ns/openshift-config...
2026-05-25T13:53:09.963891524Z Gathering data for ns/openshift-config-managed...
2026-05-25T13:53:10.380537677Z Waiting for performance profile collector pods to become ready: 7
2026-05-25T13:53:10.387596743Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-05-25T13:53:10.451920818Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-05-25T13:53:10.709772568Z Gathering data for ns/openshift-kube-apiserver...
2026-05-25T13:53:11.019413953Z Gathering data for ns/openshift-kube-controller-manager...
2026-05-25T13:53:11.405845856Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-05-25T13:53:11.507329058Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-05-25T13:53:11.736427367Z Gathering data for ns/openshift-kube-scheduler...
2026-05-25T13:53:11.766282094Z Collecting performance related data for node ip-10-0-143-87.ec2.internal
2026-05-25T13:53:11.776352451Z Collecting performance related data for node ip-10-0-141-211.ec2.internal
2026-05-25T13:53:11.792715695Z Collecting performance related data for node ip-10-0-135-137.ec2.internal
2026-05-25T13:53:12.071784147Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-05-25T13:53:12.466691761Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-05-25T13:53:12.912469603Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-05-25T13:53:13.374834680Z Gathering data for ns/openshift-user-workload-monitoring...
2026-05-25T13:53:13.964187745Z Gathering data for ns/openshift-multus...
2026-05-25T13:53:15.456494349Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-05-25T13:53:15.462617515Z Gathering data for ns/openshift-ovn-kubernetes...
2026-05-25T13:53:17.265032300Z Gathering data for ns/openshift-host-network...
2026-05-25T13:53:17.601858633Z Gathering data for ns/openshift-network-diagnostics...
2026-05-25T13:53:18.167280722Z Gathering data for ns/openshift-network-node-identity...
2026-05-25T13:53:18.567508431Z Gathering data for ns/openshift-network-operator...
2026-05-25T13:53:18.981193494Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-05-25T13:53:19.237049525Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-05-25T13:53:19.728561794Z Gathering data for ns/openshift-apiserver-operator...
2026-05-25T13:53:19.841700951Z Collecting kubelet logs for node ip-10-0-143-87.ec2.internal
2026-05-25T13:53:19.843450227Z Collecting kubelet logs for node ip-10-0-141-211.ec2.internal
2026-05-25T13:53:19.845131912Z Collecting kubelet logs for node ip-10-0-135-137.ec2.internal
2026-05-25T13:53:20.085151590Z Gathering data for ns/openshift-apiserver...
2026-05-25T13:53:20.206110977Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-05-25T13:53:20.211648940Z INFO: Node performance data collection complete.
2026-05-25T13:53:20.462295529Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-05-25T13:53:20.579117551Z Gathering data for ns/openshift-controller-manager-operator...
2026-05-25T13:53:20.847385414Z Gathering data for ns/openshift-controller-manager...
2026-05-25T13:53:21.140682481Z Gathering data for ns/openshift-cluster-samples-operator...
2026-05-25T13:53:21.808307219Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-05-25T13:53:22.122341191Z Gathering data for ns/openshift-service-ca-operator...
2026-05-25T13:53:22.450611861Z Gathering data for ns/openshift-service-ca...
2026-05-25T13:53:22.825878021Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-05-25T13:53:23.773592695Z Wrote inspect data to must-gather.
2026-05-25T13:53:23.773640613Z error: inspection completed with the errors occurred while gathering data:
2026-05-25T13:53:23.773640613Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-05-25T13:53:23.899386317Z error: the server doesn't have a resource type "clusters"
2026-05-25T13:53:24.038032730Z Caches written to disk