2026-04-23T14:21:37.892410058Z [disk usage checker] Started
2026-04-23T14:21:37.895856940Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-23T14:21:38.111759268Z Gathering data for ns/openshift-cluster-version...
2026-04-23T14:21:38.272773002Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-23T14:21:38.383000120Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-23T14:21:38.469843597Z Gathering data for ns/default...
2026-04-23T14:21:38.784172555Z Gathering data for ns/openshift...
2026-04-23T14:21:39.245446518Z Gathering data for ns/kube-system...
2026-04-23T14:21:40.045186373Z Gathering data for ns/openshift-etcd...
2026-04-23T14:21:40.405649048Z Waiting on subprocesses to finish execution.
2026-04-23T14:21:40.411586361Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-23T14:21:40.425957532Z Wrote inspect data to must-gather.
2026-04-23T14:21:40.426062828Z error: inspection completed with the errors occurred while gathering data:
2026-04-23T14:21:40.426062828Z     namespaces "assisted-installer" not found
2026-04-23T14:21:40.427987952Z INFO: Gathering HAProxy config files
2026-04-23T14:21:40.435374475Z INFO: Collecting host service logs for crio
2026-04-23T14:21:40.435663037Z INFO: Collecting host service logs for kubelet
2026-04-23T14:21:40.435984486Z INFO: Collecting host service logs for rpm-ostreed
2026-04-23T14:21:40.436044202Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-23T14:21:40.436311935Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-23T14:21:40.436619677Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-23T14:21:40.436926284Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-23T14:21:40.437247540Z INFO: Collecting host service logs for NetworkManager
2026-04-23T14:21:40.437617083Z INFO: Collecting host service logs for openvswitch
2026-04-23T14:21:40.437978950Z INFO: Collecting host service logs for ovs-configuration
2026-04-23T14:21:40.438301755Z INFO: Collecting host service logs for ovsdb-server
2026-04-23T14:21:40.438658693Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-23T14:21:40.439061158Z INFO: Waiting for worker host service log collection to complete ...
2026-04-23T14:21:40.455265752Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-23T14:21:40.541355133Z INFO: Waiting for node performance related collection to complete ...
2026-04-23T14:21:40.991552808Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-23T14:21:41.022417662Z No resources found
2026-04-23T14:21:41.175727731Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-tpxdm
2026-04-23T14:21:41.175791448Z insights-runtime-extractor-bkz2n
2026-04-23T14:21:41.175813804Z insights-runtime-extractor-dhqrw
2026-04-23T14:21:41.175834997Z insights-runtime-extractor-zgjs5
2026-04-23T14:21:41.300673436Z INFO: "metallb-operator" not detected. Skipping.
2026-04-23T14:21:41.441258006Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-23T14:21:41.487863226Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-23T14:21:41.517876864Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-23T14:21:41.517914769Z error: the server doesn't have a resource type "performanceprofile"
2026-04-23T14:21:41.524656775Z No resources found in openshift-etcd namespace.
2026-04-23T14:21:41.697986273Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-23T14:21:41.698017629Z INFO: on-disk MachineConfig config collection complete.
2026-04-23T14:21:41.917803745Z ERROR: No running kube-apiserver pods found
2026-04-23T14:21:42.213332058Z Wrote inspect data to must-gather.
2026-04-23T14:21:42.228175010Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-23T14:21:42.228175010Z See 'oc rsync -h' for help and examples
2026-04-23T14:21:42.301083031Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-23T14:21:42.361050209Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-23T14:21:42.381241202Z Wrote inspect data to must-gather.
2026-04-23T14:21:42.407821030Z INFO: Worker host service log collection to complete.
2026-04-23T14:21:42.536415761Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-23T14:21:42.594860029Z No resources found
2026-04-23T14:21:42.767361399Z Wrote inspect data to must-gather.
2026-04-23T14:21:42.780615520Z INFO: 'previous-logs' folder not found on ip-10-0-132-207.ec2.internal, skipping...
2026-04-23T14:21:42.826139430Z Wrote inspect data to must-gather.
2026-04-23T14:21:42.827439645Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-23T14:21:42.845843849Z Wrote inspect data to must-gather.
2026-04-23T14:21:42.890931877Z Wrote inspect data to must-gather.
2026-04-23T14:21:42.912694662Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-23T14:21:42.933627725Z Wrote inspect data to must-gather.
2026-04-23T14:21:42.944014604Z Gathering data for ns/openshift-monitoring...
2026-04-23T14:21:43.099210769Z Wrote inspect data to must-gather.
2026-04-23T14:21:43.100138676Z error: the server doesn't have a resource type "machineconfigs"
2026-04-23T14:21:43.105427739Z tar: Removing leading `/' from member names
2026-04-23T14:21:43.109133640Z INFO: HAProxy config collection complete.
2026-04-23T14:21:43.118755627Z INFO: 'previous-logs' folder not found on ip-10-0-137-177.ec2.internal, skipping...
2026-04-23T14:21:43.121716790Z INFO: Getting rules from prometheus-k8s-0
2026-04-23T14:21:43.341724883Z Wrote inspect data to must-gather.
2026-04-23T14:21:43.365253827Z Wrote inspect data to must-gather.
2026-04-23T14:21:43.386967553Z INFO: 'previous-logs' folder not found on ip-10-0-141-176.ec2.internal, skipping...
2026-04-23T14:21:43.387009807Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-23T14:21:43.387036027Z INFO: Machine Config Daemon termination log collection complete.
2026-04-23T14:21:43.562953153Z Wrote inspect data to must-gather.
2026-04-23T14:21:43.600662921Z INFO: Getting status/config from prometheus-k8s-0
2026-04-23T14:21:43.614649118Z Wrote inspect data to must-gather.
2026-04-23T14:21:43.720557422Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-23T14:21:43.915044049Z INFO: INTERCONNECT MODE
2026-04-23T14:21:43.915074566Z INFO: Gathering ovn-kubernetes DBs
2026-04-23T14:21:43.942818758Z Wrote inspect data to must-gather.
2026-04-23T14:21:44.013184622Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-23T14:21:44.087578018Z INFO: Gathering OVN_Northbound from ovnkube-node-kqqbw...
2026-04-23T14:21:44.087804400Z INFO: Gathering OVN_Northbound from ovnkube-node-lhgvj...
2026-04-23T14:21:44.088012046Z INFO: Gathering OVN_Northbound from ovnkube-node-mwbjc...
2026-04-23T14:21:44.088275234Z INFO: Gathering OVN_Southbound from ovnkube-node-kqqbw...
2026-04-23T14:21:44.088527371Z INFO: Gathering OVN_Southbound from ovnkube-node-lhgvj...
2026-04-23T14:21:44.088773594Z INFO: Gathering OVN_Southbound from ovnkube-node-mwbjc...
2026-04-23T14:21:44.247791101Z Wrote inspect data to must-gather.
2026-04-23T14:21:44.333325844Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-23T14:21:44.382006359Z tar: Removing leading `/' from member names
2026-04-23T14:21:44.398548601Z tar: Removing leading `/' from member names
2026-04-23T14:21:44.423049969Z tar: Removing leading `/' from member names
2026-04-23T14:21:44.428792783Z tar: Removing leading `/' from member names
2026-04-23T14:21:44.438282622Z tar: Removing leading `/' from member names
2026-04-23T14:21:44.438472392Z tar: Removing leading `/' from member names
2026-04-23T14:21:44.543561715Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-23T14:21:44.543981611Z Wrote inspect data to must-gather.
2026-04-23T14:21:44.639605243Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-23T14:21:44.795277180Z Wrote inspect data to must-gather.
2026-04-23T14:21:44.918362493Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-23T14:21:44.977760049Z INFO: Waiting for network log collection to complete ...
2026-04-23T14:21:44.977797542Z INFO: Waiting for ovnk database copies to complete ...
2026-04-23T14:21:44.978159777Z INFO: Copying ovnk databases complete.
2026-04-23T14:21:44.979765766Z 3.9M	must-gather/network_logs/ovnk_database_store
2026-04-23T14:21:44.982127669Z ovnk_database_store/
2026-04-23T14:21:44.982127669Z ovnk_database_store/ovnkube-node-lhgvj_sbdb
2026-04-23T14:21:45.008148079Z ovnk_database_store/ovnkube-node-lhgvj_nbdb
2026-04-23T14:21:45.019350669Z ovnk_database_store/ovnkube-node-mwbjc_nbdb
2026-04-23T14:21:45.030141950Z ovnk_database_store/ovnkube-node-mwbjc_sbdb
2026-04-23T14:21:45.049057841Z Wrote inspect data to must-gather.
2026-04-23T14:21:45.052846675Z ovnk_database_store/ovnkube-node-kqqbw_nbdb
2026-04-23T14:21:45.062152473Z ovnk_database_store/ovnkube-node-kqqbw_sbdb
2026-04-23T14:21:45.086645900Z INFO: Network log collection complete.
2026-04-23T14:21:45.206002098Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-23T14:21:45.339073538Z INFO: Getting status from alertmanager-main-0
2026-04-23T14:21:45.350010941Z Wrote inspect data to must-gather.
2026-04-23T14:21:45.383878513Z Gathering data for ns/openshift-network-console...
2026-04-23T14:21:45.637961150Z Wrote inspect data to must-gather.
2026-04-23T14:21:45.808000529Z Gathering data for ns/openshift-console-operator...
2026-04-23T14:21:45.921109616Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-23T14:21:45.923095611Z INFO: Fallback to identify the container image from release info
2026-04-23T14:21:46.175869237Z Gathering data for ns/openshift-console...
2026-04-23T14:21:46.387914459Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-23T14:21:46.518128833Z daemonset.apps/perf-node-gather-daemonset created
2026-04-23T14:21:46.658391113Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-23T14:21:46.661676380Z Waiting for performance profile collector pods to become ready: 1
2026-04-23T14:21:47.035419479Z Gathering data for ns/openshift-dns-operator...
2026-04-23T14:21:47.363427592Z Gathering data for ns/openshift-dns...
2026-04-23T14:21:47.778959958Z Waiting for performance profile collector pods to become ready: 2
2026-04-23T14:21:47.922393566Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-23T14:21:47.977536103Z Gathering data for ns/openshift-image-registry...
2026-04-23T14:21:48.514248041Z Gathering data for ns/openshift-ingress-operator...
2026-04-23T14:21:48.854621574Z Gathering data for ns/openshift-ingress...
2026-04-23T14:21:48.919482980Z Waiting for performance profile collector pods to become ready: 3
2026-04-23T14:21:49.196933013Z Gathering data for ns/openshift-ingress-canary...
2026-04-23T14:21:49.624578861Z Gathering data for ns/openshift-insights...
2026-04-23T14:21:50.037316127Z Waiting for performance profile collector pods to become ready: 4
2026-04-23T14:21:51.160656916Z Waiting for performance profile collector pods to become ready: 5
2026-04-23T14:21:51.760636450Z Gathering data for ns/kserve...
2026-04-23T14:21:52.292618937Z Waiting for performance profile collector pods to become ready: 6
2026-04-23T14:21:52.926809529Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-23T14:21:53.383325923Z Gathering data for ns/openshift-config...
2026-04-23T14:21:53.414809806Z Waiting for performance profile collector pods to become ready: 7
2026-04-23T14:21:53.652928733Z Gathering data for ns/openshift-config-managed...
2026-04-23T14:21:54.082883751Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-23T14:21:54.407521354Z Gathering data for ns/openshift-kube-apiserver...
2026-04-23T14:21:54.549190149Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-23T14:21:54.733088539Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-23T14:21:54.827784752Z Collecting performance related data for node ip-10-0-132-207.ec2.internal
2026-04-23T14:21:54.834614355Z Collecting performance related data for node ip-10-0-141-176.ec2.internal
2026-04-23T14:21:54.841868322Z Collecting performance related data for node ip-10-0-137-177.ec2.internal
2026-04-23T14:21:55.077566399Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-23T14:21:55.461518012Z Gathering data for ns/openshift-kube-scheduler...
2026-04-23T14:21:55.794609384Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-23T14:21:56.183405035Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-23T14:21:56.551993842Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-23T14:21:56.855595028Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-23T14:21:57.452259448Z Gathering data for ns/openshift-multus...
2026-04-23T14:21:57.931912528Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-23T14:21:58.836986112Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-23T14:22:00.384083977Z Gathering data for ns/openshift-host-network...
2026-04-23T14:22:00.766947682Z Gathering data for ns/openshift-network-diagnostics...
2026-04-23T14:22:01.308553413Z Gathering data for ns/openshift-network-node-identity...
2026-04-23T14:22:01.722256074Z Gathering data for ns/openshift-network-operator...
2026-04-23T14:22:02.086647286Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-23T14:22:02.384356698Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-23T14:22:02.850640643Z Gathering data for ns/openshift-apiserver-operator...
2026-04-23T14:22:02.936435477Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-23T14:22:03.189207886Z Gathering data for ns/openshift-apiserver...
2026-04-23T14:22:03.332529661Z Collecting kubelet logs for node ip-10-0-132-207.ec2.internal
2026-04-23T14:22:03.334690224Z Collecting kubelet logs for node ip-10-0-141-176.ec2.internal
2026-04-23T14:22:03.341094508Z Collecting kubelet logs for node ip-10-0-137-177.ec2.internal
2026-04-23T14:22:03.659084925Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-23T14:22:03.753809485Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-23T14:22:03.758773158Z INFO: Node performance data collection complete.
2026-04-23T14:22:03.950480535Z Gathering data for ns/openshift-controller-manager...
2026-04-23T14:22:04.262480803Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-23T14:22:04.891094513Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-23T14:22:05.184411777Z Gathering data for ns/openshift-service-ca-operator...
2026-04-23T14:22:05.486847161Z Gathering data for ns/openshift-service-ca...
2026-04-23T14:22:05.846888250Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-23T14:22:06.716727302Z Wrote inspect data to must-gather.
2026-04-23T14:22:06.716771581Z error: inspection completed with the errors occurred while gathering data:
2026-04-23T14:22:06.716771581Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-23T14:22:06.852675282Z error: the server doesn't have a resource type "clusters"
2026-04-23T14:22:06.999384088Z Caches written to disk