2026-04-16T20:16:39.006736328Z [disk usage checker] Started
2026-04-16T20:16:39.010332695Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T20:16:39.216202366Z Gathering data for ns/openshift-cluster-version...
2026-04-16T20:16:39.358990686Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T20:16:39.442006656Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T20:16:39.519291714Z Gathering data for ns/default...
2026-04-16T20:16:39.807757769Z Gathering data for ns/openshift...
2026-04-16T20:16:40.204339367Z Gathering data for ns/kube-system...
2026-04-16T20:16:40.900831997Z Gathering data for ns/openshift-etcd...
2026-04-16T20:16:41.199742847Z Wrote inspect data to must-gather.
2026-04-16T20:16:41.199905749Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T20:16:41.199905749Z     namespaces "assisted-installer" not found
2026-04-16T20:16:41.451114686Z Waiting on subprocesses to finish execution.
2026-04-16T20:16:41.459282226Z INFO: Gathering HAProxy config files
2026-04-16T20:16:41.462784459Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-16T20:16:41.463196592Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-16T20:16:41.474433778Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-16T20:16:41.482719641Z INFO: Collecting host service logs for crio
2026-04-16T20:16:41.483129779Z INFO: Collecting host service logs for kubelet
2026-04-16T20:16:41.483526344Z INFO: Collecting host service logs for rpm-ostreed
2026-04-16T20:16:41.483881541Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-16T20:16:41.484228515Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-16T20:16:41.484599964Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-16T20:16:41.484960351Z INFO: Collecting host service logs for NetworkManager
2026-04-16T20:16:41.485324018Z INFO: Collecting host service logs for openvswitch
2026-04-16T20:16:41.485677096Z INFO: Collecting host service logs for ovs-configuration
2026-04-16T20:16:41.486027020Z INFO: Collecting host service logs for ovsdb-server
2026-04-16T20:16:41.486377474Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-16T20:16:41.486787316Z INFO: Waiting for worker host service log collection to complete ...
2026-04-16T20:16:41.878322117Z INFO: Waiting for node performance related collection to complete ...
2026-04-16T20:16:41.880895296Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-k4s7x
2026-04-16T20:16:41.880935018Z insights-runtime-extractor-gsnhj
2026-04-16T20:16:41.880955368Z insights-runtime-extractor-x64wb
2026-04-16T20:16:41.880973725Z insights-runtime-extractor-zdtb2
2026-04-16T20:16:41.949036310Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-16T20:16:42.034311736Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-16T20:16:42.188972821Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-16T20:16:42.189018188Z INFO: on-disk MachineConfig config collection complete.
2026-04-16T20:16:42.357392018Z No resources found in openshift-etcd namespace.
2026-04-16T20:16:42.364934662Z INFO: "metallb-operator" not detected. Skipping.
2026-04-16T20:16:42.397319594Z Wrote inspect data to must-gather.
2026-04-16T20:16:42.562336247Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-16T20:16:42.562336247Z See 'oc rsync -h' for help and examples
2026-04-16T20:16:42.604637170Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-16T20:16:42.673288681Z error: the server doesn't have a resource type "performanceprofile"
2026-04-16T20:16:42.799519903Z No resources found
2026-04-16T20:16:42.837402743Z ERROR: No running kube-apiserver pods found
2026-04-16T20:16:42.840231669Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-16T20:16:43.009815757Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-16T20:16:43.068229784Z INFO: Worker host service log collection to complete.
2026-04-16T20:16:43.196359012Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-16T20:16:43.283999662Z Wrote inspect data to must-gather.
2026-04-16T20:16:43.377796536Z No resources found
2026-04-16T20:16:43.579500690Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-16T20:16:43.580748431Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T20:16:43.628494261Z Wrote inspect data to must-gather.
2026-04-16T20:16:43.708417896Z Wrote inspect data to must-gather.
2026-04-16T20:16:43.725130589Z tar: Removing leading `/' from member names
2026-04-16T20:16:43.736911761Z INFO: HAProxy config collection complete.
2026-04-16T20:16:43.755235918Z INFO: 'previous-logs' folder not found on ip-10-0-130-116.ec2.internal, skipping...
2026-04-16T20:16:43.802425717Z Wrote inspect data to must-gather.
2026-04-16T20:16:43.839439580Z Wrote inspect data to must-gather.
2026-04-16T20:16:43.862156613Z Gathering data for ns/openshift-monitoring...
2026-04-16T20:16:43.914556459Z Wrote inspect data to must-gather.
2026-04-16T20:16:43.916142259Z error: the server doesn't have a resource type "machineconfigs"
2026-04-16T20:16:44.021116499Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T20:16:44.042328605Z INFO: Getting rules from prometheus-k8s-0
2026-04-16T20:16:44.074567657Z INFO: 'previous-logs' folder not found on ip-10-0-136-138.ec2.internal, skipping...
2026-04-16T20:16:44.121130607Z Wrote inspect data to must-gather.
2026-04-16T20:16:44.173777075Z Wrote inspect data to must-gather.
2026-04-16T20:16:44.350357414Z INFO: 'previous-logs' folder not found on ip-10-0-139-205.ec2.internal, skipping...
2026-04-16T20:16:44.350394783Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-16T20:16:44.350421332Z INFO: Machine Config Daemon termination log collection complete.
2026-04-16T20:16:44.392858197Z Wrote inspect data to must-gather.
2026-04-16T20:16:44.406844308Z Wrote inspect data to must-gather.
2026-04-16T20:16:44.461834953Z INFO: Getting status/config from prometheus-k8s-0
2026-04-16T20:16:44.571491974Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-16T20:16:44.643647195Z Wrote inspect data to must-gather.
2026-04-16T20:16:44.791727770Z Wrote inspect data to must-gather.
2026-04-16T20:16:44.899365094Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-16T20:16:44.947515862Z INFO: INTERCONNECT MODE
2026-04-16T20:16:44.947551189Z INFO: Gathering ovn-kubernetes DBs
2026-04-16T20:16:45.010822173Z Wrote inspect data to must-gather.
2026-04-16T20:16:45.097808721Z INFO: Gathering OVN_Northbound from ovnkube-node-2px7v...
2026-04-16T20:16:45.098082378Z INFO: Gathering OVN_Northbound from ovnkube-node-j56zc...
2026-04-16T20:16:45.098410263Z INFO: Gathering OVN_Northbound from ovnkube-node-pp78x...
2026-04-16T20:16:45.098724390Z INFO: Gathering OVN_Southbound from ovnkube-node-2px7v...
2026-04-16T20:16:45.099004773Z INFO: Gathering OVN_Southbound from ovnkube-node-j56zc...
2026-04-16T20:16:45.099291860Z INFO: Gathering OVN_Southbound from ovnkube-node-pp78x...
2026-04-16T20:16:45.135822969Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-16T20:16:45.327889466Z Wrote inspect data to must-gather.
2026-04-16T20:16:45.419213762Z tar: Removing leading `/' from member names
2026-04-16T20:16:45.430484910Z tar: Removing leading `/' from member names
2026-04-16T20:16:45.433150695Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T20:16:45.438109572Z tar: Removing leading `/' from member names
2026-04-16T20:16:45.438133986Z tar: Removing leading `/' from member names
2026-04-16T20:16:45.477836858Z tar: Removing leading `/' from member names
2026-04-16T20:16:45.503025223Z tar: Removing leading `/' from member names
2026-04-16T20:16:45.530566633Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-16T20:16:45.601435512Z Wrote inspect data to must-gather.
2026-04-16T20:16:45.792764289Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-16T20:16:45.850209827Z Wrote inspect data to must-gather.
2026-04-16T20:16:45.973711192Z INFO: Waiting for network log collection to complete ...
2026-04-16T20:16:45.973741580Z INFO: Waiting for ovnk database copies to complete ...
2026-04-16T20:16:45.974147748Z INFO: Copying ovnk databases complete.
2026-04-16T20:16:45.975857413Z 3.3M	must-gather/network_logs/ovnk_database_store
2026-04-16T20:16:45.977966064Z ovnk_database_store/
2026-04-16T20:16:45.977966064Z ovnk_database_store/ovnkube-node-j56zc_sbdb
2026-04-16T20:16:45.997871668Z ovnk_database_store/ovnkube-node-j56zc_nbdb
2026-04-16T20:16:46.005543142Z ovnk_database_store/ovnkube-node-2px7v_nbdb
2026-04-16T20:16:46.015162117Z ovnk_database_store/ovnkube-node-pp78x_sbdb
2026-04-16T20:16:46.041195239Z ovnk_database_store/ovnkube-node-2px7v_sbdb
2026-04-16T20:16:46.060997670Z ovnk_database_store/ovnkube-node-pp78x_nbdb
2026-04-16T20:16:46.073566781Z INFO: Network log collection complete.
2026-04-16T20:16:46.077191802Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T20:16:46.169642941Z Wrote inspect data to must-gather.
2026-04-16T20:16:46.203644536Z INFO: Getting status from alertmanager-main-0
2026-04-16T20:16:46.259076668Z Gathering data for ns/openshift-network-console...
2026-04-16T20:16:46.447612257Z Wrote inspect data to must-gather.
2026-04-16T20:16:46.704325792Z Gathering data for ns/openshift-console-operator...
2026-04-16T20:16:46.720068504Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-16T20:16:46.722000735Z INFO: Fallback to identify the container image from release info
2026-04-16T20:16:47.091223524Z Gathering data for ns/openshift-console...
2026-04-16T20:16:47.406170574Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-16T20:16:47.536832588Z daemonset.apps/perf-node-gather-daemonset created
2026-04-16T20:16:47.646858432Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-16T20:16:47.678645380Z Waiting for performance profile collector pods to become ready: 1
2026-04-16T20:16:48.057268369Z Gathering data for ns/openshift-dns-operator...
2026-04-16T20:16:48.366584173Z Gathering data for ns/openshift-dns...
2026-04-16T20:16:48.801512320Z Waiting for performance profile collector pods to become ready: 2
2026-04-16T20:16:48.950630688Z Gathering data for ns/openshift-image-registry...
2026-04-16T20:16:49.025777861Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T20:16:49.414753018Z Gathering data for ns/openshift-ingress-operator...
2026-04-16T20:16:49.717311180Z Gathering data for ns/openshift-ingress...
2026-04-16T20:16:49.917846692Z Waiting for performance profile collector pods to become ready: 3
2026-04-16T20:16:50.045615096Z Gathering data for ns/openshift-ingress-canary...
2026-04-16T20:16:50.414388200Z Gathering data for ns/openshift-insights...
2026-04-16T20:16:51.052405202Z Waiting for performance profile collector pods to become ready: 4
2026-04-16T20:16:52.176347303Z Waiting for performance profile collector pods to become ready: 5
2026-04-16T20:16:52.505087643Z Gathering data for ns/kserve...
2026-04-16T20:16:53.307950269Z Waiting for performance profile collector pods to become ready: 6
2026-04-16T20:16:53.880207393Z Gathering data for ns/openshift-config...
2026-04-16T20:16:54.031880653Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T20:16:54.138886912Z Gathering data for ns/openshift-config-managed...
2026-04-16T20:16:54.434200157Z Waiting for performance profile collector pods to become ready: 7
2026-04-16T20:16:54.562522774Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-16T20:16:54.817702998Z Gathering data for ns/openshift-kube-apiserver...
2026-04-16T20:16:55.113362073Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-16T20:16:55.383575885Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-16T20:16:55.552479695Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-16T20:16:55.795490152Z Collecting performance related data for node ip-10-0-130-116.ec2.internal
2026-04-16T20:16:55.804061448Z Collecting performance related data for node ip-10-0-136-138.ec2.internal
2026-04-16T20:16:55.815280627Z Collecting performance related data for node ip-10-0-139-205.ec2.internal
2026-04-16T20:16:55.920664626Z Gathering data for ns/openshift-kube-scheduler...
2026-04-16T20:16:56.222440004Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-16T20:16:56.609051921Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-16T20:16:57.035282796Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-16T20:16:57.417127907Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-16T20:16:57.941889580Z Gathering data for ns/openshift-multus...
2026-04-16T20:16:59.038539945Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T20:16:59.414108811Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-16T20:17:00.944092386Z Gathering data for ns/openshift-host-network...
2026-04-16T20:17:01.279546081Z Gathering data for ns/openshift-network-diagnostics...
2026-04-16T20:17:01.811321065Z Gathering data for ns/openshift-network-node-identity...
2026-04-16T20:17:02.225881690Z Gathering data for ns/openshift-network-operator...
2026-04-16T20:17:02.588571274Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-16T20:17:02.844357797Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-16T20:17:03.313677046Z Gathering data for ns/openshift-apiserver-operator...
2026-04-16T20:17:03.614560631Z Gathering data for ns/openshift-apiserver...
2026-04-16T20:17:04.043296438Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-16T20:17:04.061889079Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-16T20:17:04.235812459Z Collecting kubelet logs for node ip-10-0-130-116.ec2.internal
2026-04-16T20:17:04.238243190Z Collecting kubelet logs for node ip-10-0-136-138.ec2.internal
2026-04-16T20:17:04.240334148Z Collecting kubelet logs for node ip-10-0-139-205.ec2.internal
2026-04-16T20:17:04.372461640Z Gathering data for ns/openshift-controller-manager...
2026-04-16T20:17:04.604369188Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-16T20:17:04.609456761Z INFO: Node performance data collection complete.
2026-04-16T20:17:04.693351193Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-16T20:17:05.329731593Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-16T20:17:05.642224154Z Gathering data for ns/openshift-service-ca-operator...
2026-04-16T20:17:05.973741058Z Gathering data for ns/openshift-service-ca...
2026-04-16T20:17:06.328685510Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-16T20:17:07.180365885Z Wrote inspect data to must-gather.
2026-04-16T20:17:07.180413647Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T20:17:07.180413647Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-16T20:17:07.312727942Z error: the server doesn't have a resource type "clusters"
2026-04-16T20:17:07.584511607Z Caches written to disk