2026-06-02T21:54:58.680363277Z [disk usage checker] Started
2026-06-02T21:54:58.684965801Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-02T21:54:58.903778321Z Gathering data for ns/openshift-cluster-version...
2026-06-02T21:54:59.066549746Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T21:54:59.180490318Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T21:54:59.285350502Z Gathering data for ns/default...
2026-06-02T21:54:59.715452373Z Gathering data for ns/openshift...
2026-06-02T21:55:00.196238016Z Gathering data for ns/kube-system...
2026-06-02T21:55:00.937763030Z Gathering data for ns/openshift-etcd...
2026-06-02T21:55:01.142143325Z Waiting on subprocesses to finish execution.
2026-06-02T21:55:01.150933997Z INFO: Gathering HAProxy config files
2026-06-02T21:55:01.151669193Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T21:55:01.160042883Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T21:55:01.161384528Z INFO: Collecting host service logs for crio
2026-06-02T21:55:01.161706184Z INFO: Collecting host service logs for kubelet
2026-06-02T21:55:01.162096365Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T21:55:01.162440543Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T21:55:01.162927985Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T21:55:01.166937242Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T21:55:01.167299365Z INFO: Collecting host service logs for NetworkManager
2026-06-02T21:55:01.167660675Z INFO: Collecting host service logs for openvswitch
2026-06-02T21:55:01.168027149Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T21:55:01.174383938Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T21:55:01.175340855Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T21:55:01.175680800Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T21:55:01.176060459Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T21:55:01.247532281Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T21:55:01.871433670Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T21:55:01.957071178Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T21:55:01.961713308Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T21:55:02.067350421Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T21:55:02.067474802Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T21:55:02.137106303Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T21:55:02.213653497Z Wrote inspect data to must-gather.
2026-06-02T21:55:02.213769313Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T21:55:02.213769313Z     namespaces "assisted-installer" not found
2026-06-02T21:55:02.221433068Z No resources found in openshift-etcd namespace.
2026-06-02T21:55:02.289607496Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-7x8l4
2026-06-02T21:55:02.289680384Z insights-runtime-extractor-86q85
2026-06-02T21:55:02.289713919Z insights-runtime-extractor-j8k66
2026-06-02T21:55:02.289757957Z insights-runtime-extractor-n5lr4
2026-06-02T21:55:02.360001348Z No resources found
2026-06-02T21:55:02.492214540Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T21:55:02.495598873Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T21:55:03.087554631Z ERROR: No running kube-apiserver pods found
2026-06-02T21:55:03.109873718Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T21:55:03.193190470Z Wrote inspect data to must-gather.
2026-06-02T21:55:03.261543047Z INFO: Worker host service log collection to complete.
2026-06-02T21:55:03.476749675Z Wrote inspect data to must-gather.
2026-06-02T21:55:03.561486329Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T21:55:03.653893572Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T21:55:03.653893572Z See 'oc rsync -h' for help and examples
2026-06-02T21:55:03.690195808Z tar: Removing leading `/' from member names
2026-06-02T21:55:03.695904724Z INFO: HAProxy config collection complete.
2026-06-02T21:55:03.713491819Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T21:55:03.743115429Z Wrote inspect data to must-gather.
2026-06-02T21:55:03.835290402Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-02T21:55:03.835689409Z Wrote inspect data to must-gather.
2026-06-02T21:55:03.843658834Z No resources found
2026-06-02T21:55:03.886318484Z Gathering data for ns/kuadrant-system...
2026-06-02T21:55:03.936088350Z Wrote inspect data to must-gather.
2026-06-02T21:55:03.999796950Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T21:55:04.015215931Z Wrote inspect data to must-gather.
2026-06-02T21:55:04.112361197Z INFO: 'previous-logs' folder not found on ip-10-0-131-1.ec2.internal, skipping...
2026-06-02T21:55:04.168702022Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T21:55:04.366053157Z Wrote inspect data to must-gather.
2026-06-02T21:55:04.460418400Z INFO: 'previous-logs' folder not found on ip-10-0-135-204.ec2.internal, skipping...
2026-06-02T21:55:04.553187697Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T21:55:04.584798569Z Wrote inspect data to must-gather.
2026-06-02T21:55:04.849251698Z Wrote inspect data to must-gather.
2026-06-02T21:55:04.866341897Z INFO: 'previous-logs' folder not found on ip-10-0-143-61.ec2.internal, skipping...
2026-06-02T21:55:04.866446677Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T21:55:04.866503555Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T21:55:04.971911895Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T21:55:04.998669078Z Wrote inspect data to must-gather.
2026-06-02T21:55:05.111146546Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T21:55:05.232051538Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T21:55:05.285554628Z Wrote inspect data to must-gather.
2026-06-02T21:55:05.540956607Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T21:55:05.612074361Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T21:55:05.720310678Z Wrote inspect data to must-gather.
2026-06-02T21:55:05.791373259Z INFO: INTERCONNECT MODE
2026-06-02T21:55:05.791474955Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T21:55:05.814234084Z Gathering data for ns/openshift-monitoring...
2026-06-02T21:55:05.928623240Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T21:55:05.974115118Z INFO: Gathering OVN_Northbound from ovnkube-node-qccxd...
2026-06-02T21:55:05.974417693Z INFO: Gathering OVN_Northbound from ovnkube-node-rwwhv...
2026-06-02T21:55:05.975264826Z INFO: Gathering OVN_Northbound from ovnkube-node-z7sng...
2026-06-02T21:55:05.975620951Z INFO: Gathering OVN_Southbound from ovnkube-node-qccxd...
2026-06-02T21:55:05.975945454Z INFO: Gathering OVN_Southbound from ovnkube-node-rwwhv...
2026-06-02T21:55:05.976230729Z INFO: Gathering OVN_Southbound from ovnkube-node-z7sng...
2026-06-02T21:55:06.280310846Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T21:55:06.301450205Z tar: Removing leading `/' from member names
2026-06-02T21:55:06.330594200Z tar: Removing leading `/' from member names
2026-06-02T21:55:06.346143804Z tar: Removing leading `/' from member names
2026-06-02T21:55:06.368408684Z tar: Removing leading `/' from member names
2026-06-02T21:55:06.387067727Z Wrote inspect data to must-gather.
2026-06-02T21:55:06.389682584Z tar: Removing leading `/' from member names
2026-06-02T21:55:06.419518189Z tar: Removing leading `/' from member names
2026-06-02T21:55:06.600270932Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T21:55:06.846853215Z Wrote inspect data to must-gather.
2026-06-02T21:55:07.052707041Z INFO: Waiting for network log collection to complete ...
2026-06-02T21:55:07.052851840Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T21:55:07.053358713Z INFO: Copying ovnk databases complete.
2026-06-02T21:55:07.055867530Z 4.1M	must-gather/network_logs/ovnk_database_store
2026-06-02T21:55:07.058941554Z ovnk_database_store/
2026-06-02T21:55:07.058985038Z ovnk_database_store/ovnkube-node-qccxd_sbdb
2026-06-02T21:55:07.095335542Z ovnk_database_store/ovnkube-node-qccxd_nbdb
2026-06-02T21:55:07.109115569Z ovnk_database_store/ovnkube-node-rwwhv_nbdb
2026-06-02T21:55:07.122170941Z ovnk_database_store/ovnkube-node-z7sng_sbdb
2026-06-02T21:55:07.131824423Z INFO: Getting status from alertmanager-main-0
2026-06-02T21:55:07.148374333Z ovnk_database_store/ovnkube-node-z7sng_nbdb
2026-06-02T21:55:07.160061741Z ovnk_database_store/ovnkube-node-rwwhv_sbdb
2026-06-02T21:55:07.193692494Z INFO: Network log collection complete.
2026-06-02T21:55:07.327925690Z Wrote inspect data to must-gather.
2026-06-02T21:55:07.751754551Z Wrote inspect data to must-gather.
2026-06-02T21:55:08.191506517Z Wrote inspect data to must-gather.
2026-06-02T21:55:08.227638182Z Gathering data for ns/openshift-network-console...
2026-06-02T21:55:08.632285514Z Wrote inspect data to must-gather.
2026-06-02T21:55:08.802347097Z Gathering data for ns/openshift-console-operator...
2026-06-02T21:55:08.897235278Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-02T21:55:08.926192303Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T21:55:08.934173161Z INFO: Fallback to identify the container image from release info
2026-06-02T21:55:09.280261505Z Gathering data for ns/openshift-console...
2026-06-02T21:55:09.671182548Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T21:55:09.817715920Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T21:55:09.852619385Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T21:55:09.974607587Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T21:55:10.365419425Z Gathering data for ns/openshift-dns-operator...
2026-06-02T21:55:10.744012294Z Gathering data for ns/openshift-dns...
2026-06-02T21:55:11.114199730Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T21:55:11.223525642Z Wrote inspect data to must-gather.
2026-06-02T21:55:11.457402473Z Gathering data for ns/openshift-image-registry...
2026-06-02T21:55:11.928256628Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T21:55:12.233920308Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T21:55:12.404869703Z Gathering data for ns/openshift-ingress...
2026-06-02T21:55:13.208355817Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T21:55:13.360436511Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T21:55:13.669106020Z Gathering data for ns/openshift-insights...
2026-06-02T21:55:13.904511042Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-02T21:55:14.470616400Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T21:55:15.581251021Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T21:55:15.758145141Z Gathering data for ns/opendatahub...
2026-06-02T21:55:16.714787767Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T21:55:17.408976897Z Gathering data for ns/openshift-lws-operator...
2026-06-02T21:55:17.850882284Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T21:55:18.111083478Z Collecting performance related data for node ip-10-0-143-61.ec2.internal
2026-06-02T21:55:18.118744127Z Collecting performance related data for node ip-10-0-135-204.ec2.internal
2026-06-02T21:55:18.126555849Z Collecting performance related data for node ip-10-0-131-1.ec2.internal
2026-06-02T21:55:18.914855781Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-02T21:55:19.249893141Z Gathering data for ns/openshift-config...
2026-06-02T21:55:19.640148060Z Gathering data for ns/openshift-config-managed...
2026-06-02T21:55:20.105932219Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T21:55:20.480000977Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T21:55:20.877375818Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T21:55:21.320633871Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T21:55:21.686847831Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T21:55:22.012395561Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T21:55:22.381049809Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T21:55:22.768793295Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T21:55:23.125096523Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T21:55:23.726809731Z Gathering data for ns/openshift-multus...
2026-06-02T21:55:23.920563757Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-02T21:55:25.138878012Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T21:55:26.751842274Z Gathering data for ns/openshift-host-network...
2026-06-02T21:55:26.997115033Z Collecting kubelet logs for node ip-10-0-143-61.ec2.internal
2026-06-02T21:55:26.999590760Z Collecting kubelet logs for node ip-10-0-135-204.ec2.internal
2026-06-02T21:55:27.001749317Z Collecting kubelet logs for node ip-10-0-131-1.ec2.internal
2026-06-02T21:55:27.240380210Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T21:55:27.368828450Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T21:55:27.388423581Z INFO: Node performance data collection complete.
2026-06-02T21:55:27.984631780Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T21:55:28.511811081Z Gathering data for ns/openshift-network-operator...
2026-06-02T21:55:28.925328835Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-02T21:55:28.933513264Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T21:55:29.270032679Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T21:55:29.849774613Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T21:55:30.184791407Z Gathering data for ns/openshift-apiserver...
2026-06-02T21:55:30.629951426Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T21:55:30.942490742Z Gathering data for ns/openshift-controller-manager...
2026-06-02T21:55:31.265380603Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T21:55:31.959119437Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T21:55:32.285789086Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T21:55:32.621430788Z Gathering data for ns/openshift-service-ca...
2026-06-02T21:55:33.014661617Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T21:55:33.929932444Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-02T21:55:34.015573424Z Wrote inspect data to must-gather.
2026-06-02T21:55:34.015616016Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T21:55:34.015616016Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T21:55:34.152388653Z error: the server doesn't have a resource type "clusters"
2026-06-02T21:55:34.500151681Z Caches written to disk