2026-04-17T11:26:08.113346754Z [disk usage checker] Started
2026-04-17T11:26:08.148808001Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-17T11:26:08.327934109Z Gathering data for ns/openshift-cluster-version...
2026-04-17T11:26:08.465765085Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-17T11:26:08.573875548Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T11:26:08.655102267Z Gathering data for ns/default...
2026-04-17T11:26:08.961055490Z Gathering data for ns/openshift...
2026-04-17T11:26:09.374874842Z Gathering data for ns/kube-system...
2026-04-17T11:26:10.093902347Z Gathering data for ns/openshift-etcd...
2026-04-17T11:26:10.408280845Z Wrote inspect data to must-gather.
2026-04-17T11:26:10.408375532Z error: inspection completed with the errors occurred while gathering data:
2026-04-17T11:26:10.408375532Z     namespaces "assisted-installer" not found
2026-04-17T11:26:10.584719270Z Waiting on subprocesses to finish execution.
2026-04-17T11:26:10.595230449Z INFO: Gathering HAProxy config files
2026-04-17T11:26:10.595591166Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-17T11:26:10.597420539Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-17T11:26:10.610795511Z INFO: Collecting host service logs for crio
2026-04-17T11:26:10.611227311Z INFO: Collecting host service logs for kubelet
2026-04-17T11:26:10.611580968Z INFO: Collecting host service logs for rpm-ostreed
2026-04-17T11:26:10.611910105Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-17T11:26:10.612252925Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-17T11:26:10.612590535Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-17T11:26:10.612918877Z INFO: Collecting host service logs for NetworkManager
2026-04-17T11:26:10.613261752Z INFO: Collecting host service logs for openvswitch
2026-04-17T11:26:10.613592360Z INFO: Collecting host service logs for ovs-configuration
2026-04-17T11:26:10.613932327Z INFO: Collecting host service logs for ovsdb-server
2026-04-17T11:26:10.614388892Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-17T11:26:10.614778634Z INFO: Waiting for worker host service log collection to complete ...
2026-04-17T11:26:10.618979384Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-17T11:26:10.631481166Z INFO: Waiting for node performance related collection to complete ...
2026-04-17T11:26:11.334847357Z No resources found in openshift-etcd namespace.
2026-04-17T11:26:11.478453506Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-17T11:26:11.567830289Z No resources found
2026-04-17T11:26:11.699929203Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-17T11:26:11.700018224Z INFO: on-disk MachineConfig config collection complete.
2026-04-17T11:26:11.758286108Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-4qnqt
2026-04-17T11:26:11.758335133Z insights-runtime-extractor-fk6ct
2026-04-17T11:26:11.758362649Z insights-runtime-extractor-k6bbx
2026-04-17T11:26:11.758392097Z insights-runtime-extractor-srvwb
2026-04-17T11:26:11.980547212Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-17T11:26:12.039734347Z INFO: "metallb-operator" not detected. Skipping.
2026-04-17T11:26:12.254218133Z No resources found
2026-04-17T11:26:12.327065434Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-17T11:26:12.327065434Z See 'oc rsync -h' for help and examples
2026-04-17T11:26:12.413434129Z Wrote inspect data to must-gather.
2026-04-17T11:26:12.498957941Z error: the server doesn't have a resource type "performanceprofile"
2026-04-17T11:26:12.517232637Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-17T11:26:12.604671576Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-17T11:26:12.630755184Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T11:26:12.648202057Z INFO: Worker host service log collection to complete.
2026-04-17T11:26:12.651856278Z ERROR: No running kube-apiserver pods found
2026-04-17T11:26:12.687850702Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-17T11:26:12.720353798Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-17T11:26:12.739238248Z Wrote inspect data to must-gather.
2026-04-17T11:26:12.784478362Z Wrote inspect data to must-gather.
2026-04-17T11:26:12.790390163Z Wrote inspect data to must-gather.
2026-04-17T11:26:12.814088776Z Wrote inspect data to must-gather.
2026-04-17T11:26:12.831367848Z Wrote inspect data to must-gather.
2026-04-17T11:26:12.856906348Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-17T11:26:12.927479751Z Gathering data for ns/openshift-monitoring...
2026-04-17T11:26:12.963030243Z tar: Removing leading `/' from member names
2026-04-17T11:26:12.970463234Z INFO: HAProxy config collection complete.
2026-04-17T11:26:13.018687588Z INFO: 'previous-logs' folder not found on ip-10-0-133-230.ec2.internal, skipping...
2026-04-17T11:26:13.037560930Z Wrote inspect data to must-gather.
2026-04-17T11:26:13.094873299Z Wrote inspect data to must-gather.
2026-04-17T11:26:13.158262311Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-17T11:26:13.213893311Z error: the server doesn't have a resource type "machineconfigs"
2026-04-17T11:26:13.279709309Z INFO: 'previous-logs' folder not found on ip-10-0-135-188.ec2.internal, skipping...
2026-04-17T11:26:13.305020329Z INFO: Getting rules from prometheus-k8s-0
2026-04-17T11:26:13.362577044Z Wrote inspect data to must-gather.
2026-04-17T11:26:13.455564955Z Wrote inspect data to must-gather.
2026-04-17T11:26:13.532017722Z INFO: 'previous-logs' folder not found on ip-10-0-141-16.ec2.internal, skipping...
2026-04-17T11:26:13.532052205Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-17T11:26:13.532052205Z INFO: Machine Config Daemon termination log collection complete.
2026-04-17T11:26:13.626585433Z Wrote inspect data to must-gather.
2026-04-17T11:26:13.693975000Z Wrote inspect data to must-gather.
2026-04-17T11:26:13.715920726Z INFO: Getting status/config from prometheus-k8s-0
2026-04-17T11:26:13.856885004Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-17T11:26:13.917423255Z INFO: INTERCONNECT MODE
2026-04-17T11:26:13.917461236Z INFO: Gathering ovn-kubernetes DBs
2026-04-17T11:26:14.069077817Z Wrote inspect data to must-gather.
2026-04-17T11:26:14.081374738Z INFO: Gathering OVN_Northbound from ovnkube-node-nt59h...
2026-04-17T11:26:14.081590426Z INFO: Gathering OVN_Northbound from ovnkube-node-p8dz7...
2026-04-17T11:26:14.081764408Z INFO: Gathering OVN_Northbound from ovnkube-node-xmrcg...
2026-04-17T11:26:14.082006032Z INFO: Gathering OVN_Southbound from ovnkube-node-nt59h...
2026-04-17T11:26:14.082272210Z INFO: Gathering OVN_Southbound from ovnkube-node-p8dz7...
2026-04-17T11:26:14.082564828Z INFO: Gathering OVN_Southbound from ovnkube-node-xmrcg...
2026-04-17T11:26:14.226357211Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-17T11:26:14.389328057Z tar: Removing leading `/' from member names
2026-04-17T11:26:14.400606795Z tar: Removing leading `/' from member names
2026-04-17T11:26:14.400854361Z tar: Removing leading `/' from member names
2026-04-17T11:26:14.401305274Z tar: Removing leading `/' from member names
2026-04-17T11:26:14.427734005Z tar: Removing leading `/' from member names
2026-04-17T11:26:14.432173182Z tar: Removing leading `/' from member names
2026-04-17T11:26:14.450371361Z Wrote inspect data to must-gather.
2026-04-17T11:26:14.494533830Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-17T11:26:14.552855679Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-17T11:26:14.694580027Z Wrote inspect data to must-gather.
2026-04-17T11:26:14.820046570Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-17T11:26:14.931694518Z Wrote inspect data to must-gather.
2026-04-17T11:26:14.953623881Z INFO: Waiting for network log collection to complete ...
2026-04-17T11:26:14.953675009Z INFO: Waiting for ovnk database copies to complete ...
2026-04-17T11:26:14.954228491Z INFO: Copying ovnk databases complete.
2026-04-17T11:26:14.956475577Z 2.9M	must-gather/network_logs/ovnk_database_store
2026-04-17T11:26:14.958515954Z ovnk_database_store/
2026-04-17T11:26:14.958515954Z ovnk_database_store/ovnkube-node-p8dz7_sbdb
2026-04-17T11:26:14.978669015Z ovnk_database_store/ovnkube-node-nt59h_sbdb
2026-04-17T11:26:14.994161264Z ovnk_database_store/ovnkube-node-xmrcg_nbdb
2026-04-17T11:26:15.000600453Z ovnk_database_store/ovnkube-node-nt59h_nbdb
2026-04-17T11:26:15.006885427Z ovnk_database_store/ovnkube-node-xmrcg_sbdb
2026-04-17T11:26:15.021664528Z ovnk_database_store/ovnkube-node-p8dz7_nbdb
2026-04-17T11:26:15.034042313Z INFO: Network log collection complete.
2026-04-17T11:26:15.077129338Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-17T11:26:15.080259960Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T11:26:15.210731809Z Wrote inspect data to must-gather.
2026-04-17T11:26:15.244555940Z Gathering data for ns/openshift-network-console...
2026-04-17T11:26:15.471385502Z INFO: Getting status from alertmanager-main-0
2026-04-17T11:26:15.499132811Z Wrote inspect data to must-gather.
2026-04-17T11:26:15.702174176Z Gathering data for ns/openshift-console-operator...
2026-04-17T11:26:15.785752640Z Wrote inspect data to must-gather.
2026-04-17T11:26:16.040319475Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-17T11:26:16.042365341Z INFO: Fallback to identify the container image from release info
2026-04-17T11:26:16.071960930Z Gathering data for ns/openshift-console...
2026-04-17T11:26:16.533211800Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-17T11:26:16.565751854Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-17T11:26:16.695910936Z daemonset.apps/perf-node-gather-daemonset created
2026-04-17T11:26:16.836320488Z Waiting for performance profile collector pods to become ready: 1
2026-04-17T11:26:16.924284205Z Gathering data for ns/openshift-dns-operator...
2026-04-17T11:26:17.291089164Z Gathering data for ns/openshift-dns...
2026-04-17T11:26:17.876070591Z Gathering data for ns/openshift-image-registry...
2026-04-17T11:26:17.962461952Z Waiting for performance profile collector pods to become ready: 2
2026-04-17T11:26:18.163890127Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-17T11:26:18.340673920Z Gathering data for ns/openshift-ingress-operator...
2026-04-17T11:26:18.702637785Z Gathering data for ns/openshift-ingress...
2026-04-17T11:26:19.040655303Z Gathering data for ns/openshift-ingress-canary...
2026-04-17T11:26:19.085994357Z Waiting for performance profile collector pods to become ready: 3
2026-04-17T11:26:19.432364012Z Gathering data for ns/openshift-insights...
2026-04-17T11:26:20.210764857Z Waiting for performance profile collector pods to become ready: 4
2026-04-17T11:26:21.328732339Z Waiting for performance profile collector pods to become ready: 5
2026-04-17T11:26:21.597818398Z Gathering data for ns/kserve...
2026-04-17T11:26:22.445368631Z Waiting for performance profile collector pods to become ready: 6
2026-04-17T11:26:22.942557400Z Gathering data for ns/openshift-config...
2026-04-17T11:26:23.168808271Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-17T11:26:23.209269201Z Gathering data for ns/openshift-config-managed...
2026-04-17T11:26:23.577407260Z Waiting for performance profile collector pods to become ready: 7
2026-04-17T11:26:23.642655857Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-17T11:26:23.909099725Z Gathering data for ns/openshift-kube-apiserver...
2026-04-17T11:26:24.217513533Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-17T11:26:24.511028857Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-17T11:26:24.686722902Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-17T11:26:24.865982854Z Gathering data for ns/openshift-kube-scheduler...
2026-04-17T11:26:24.977377796Z Collecting performance related data for node ip-10-0-135-188.ec2.internal
2026-04-17T11:26:24.983950229Z Collecting performance related data for node ip-10-0-141-16.ec2.internal
2026-04-17T11:26:24.991145248Z Collecting performance related data for node ip-10-0-133-230.ec2.internal
2026-04-17T11:26:25.192390925Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-17T11:26:25.538369161Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-17T11:26:25.952864666Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-17T11:26:26.378855295Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-17T11:26:27.006766627Z Gathering data for ns/openshift-multus...
2026-04-17T11:26:28.175630566Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-17T11:26:28.456708837Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-17T11:26:29.931439943Z Gathering data for ns/openshift-host-network...
2026-04-17T11:26:30.241899408Z Gathering data for ns/openshift-network-diagnostics...
2026-04-17T11:26:30.787467863Z Gathering data for ns/openshift-network-node-identity...
2026-04-17T11:26:31.242013513Z Gathering data for ns/openshift-network-operator...
2026-04-17T11:26:31.618675997Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-17T11:26:31.895017541Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-17T11:26:32.361722072Z Gathering data for ns/openshift-apiserver-operator...
2026-04-17T11:26:32.715501058Z Gathering data for ns/openshift-apiserver...
2026-04-17T11:26:33.107543025Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-17T11:26:33.143877736Z Collecting kubelet logs for node ip-10-0-135-188.ec2.internal
2026-04-17T11:26:33.146373790Z Collecting kubelet logs for node ip-10-0-141-16.ec2.internal
2026-04-17T11:26:33.149487362Z Collecting kubelet logs for node ip-10-0-133-230.ec2.internal
2026-04-17T11:26:33.183516771Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-04-17T11:26:33.431990663Z Gathering data for ns/openshift-controller-manager...
2026-04-17T11:26:33.521578370Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-17T11:26:33.526503629Z INFO: Node performance data collection complete.
2026-04-17T11:26:33.739025291Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-17T11:26:34.367650472Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-17T11:26:34.743414794Z Gathering data for ns/openshift-service-ca-operator...
2026-04-17T11:26:35.139295073Z Gathering data for ns/openshift-service-ca...
2026-04-17T11:26:35.492950809Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-17T11:26:36.333382798Z Wrote inspect data to must-gather.
2026-04-17T11:26:36.333421736Z error: inspection completed with the errors occurred while gathering data:
2026-04-17T11:26:36.333421736Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-17T11:26:36.457600047Z error: the server doesn't have a resource type "clusters"
2026-04-17T11:26:36.589544149Z Caches written to disk