2026-05-29T11:19:51.848603013Z [disk usage checker] Started
2026-05-29T11:19:51.852125121Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70
2026-05-29T11:19:52.065844246Z Gathering data for ns/openshift-cluster-version...
2026-05-29T11:19:52.259660701Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-29T11:19:52.365294802Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-29T11:19:52.455531567Z Gathering data for ns/default...
2026-05-29T11:19:52.780453682Z Gathering data for ns/openshift...
2026-05-29T11:19:53.220989296Z Gathering data for ns/kube-system...
2026-05-29T11:19:53.999427104Z Gathering data for ns/openshift-etcd...
2026-05-29T11:19:54.183963090Z Waiting on subprocesses to finish execution.
2026-05-29T11:19:54.191387292Z INFO: Gathering machine config daemon's old logs from all nodes
2026-05-29T11:19:54.192037400Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-05-29T11:19:54.195765256Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-05-29T11:19:54.210528162Z INFO: Gathering HAProxy config files
2026-05-29T11:19:54.253134916Z INFO: Collecting host service logs for crio
2026-05-29T11:19:54.255169203Z INFO: Collecting host service logs for kubelet
2026-05-29T11:19:54.255576171Z INFO: Collecting host service logs for rpm-ostreed
2026-05-29T11:19:54.255576171Z INFO: Waiting for node performance related collection to complete ...
2026-05-29T11:19:54.255967943Z INFO: Collecting host service logs for ostree-finalize-staged
2026-05-29T11:19:54.256614571Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-05-29T11:19:54.256965323Z INFO: Collecting host service logs for machine-config-daemon-host
2026-05-29T11:19:54.257324558Z INFO: Collecting host service logs for NetworkManager
2026-05-29T11:19:54.257732497Z INFO: Collecting host service logs for openvswitch
2026-05-29T11:19:54.258096842Z INFO: Collecting host service logs for ovs-configuration
2026-05-29T11:19:54.258530488Z INFO: Collecting host service logs for ovsdb-server
2026-05-29T11:19:54.259022900Z INFO: Collecting host service logs for ovs-vswitchd
2026-05-29T11:19:54.259526352Z INFO: Waiting for worker host service log collection to complete ...
2026-05-29T11:19:54.449443396Z INFO: Collecting Insights Archives from insights-operator-78bdfb888c-ddp6w
2026-05-29T11:19:54.449443396Z insights-runtime-extractor-bb672
2026-05-29T11:19:54.449443396Z insights-runtime-extractor-wlpw2
2026-05-29T11:19:54.449443396Z insights-runtime-extractor-xfqzm
2026-05-29T11:19:54.729481706Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-05-29T11:19:55.146778371Z Wrote inspect data to must-gather.
2026-05-29T11:19:55.154849300Z error: inspection completed with the errors occurred while gathering data:
2026-05-29T11:19:55.154849300Z     namespaces "assisted-installer" not found
2026-05-29T11:19:55.260102605Z No resources found in openshift-etcd namespace.
2026-05-29T11:19:55.359776323Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-05-29T11:19:55.359971305Z INFO: on-disk MachineConfig config collection complete.
2026-05-29T11:19:55.362923427Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-05-29T11:19:55.375526062Z No resources found
2026-05-29T11:19:55.388457089Z INFO: Found 1 replicas - prometheus-k8s-0
2026-05-29T11:19:55.415985469Z error: the server doesn't have a resource type "performanceprofile"
2026-05-29T11:19:55.462839032Z Wrote inspect data to must-gather.
2026-05-29T11:19:55.555365062Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-05-29T11:19:55.555365062Z See 'oc rsync -h' for help and examples
2026-05-29T11:19:55.590744468Z INFO: "metallb-operator" not detected. Skipping.
2026-05-29T11:19:55.730302397Z INFO: "sriov-network-operator" not detected. Skipping.
2026-05-29T11:19:55.781165176Z INFO: Worker host service log collection to complete.
2026-05-29T11:19:55.855139637Z Wrote inspect data to must-gather.
2026-05-29T11:19:55.890046898Z ERROR: No running kube-apiserver pods found
2026-05-29T11:19:56.155967025Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-05-29T11:19:56.183435909Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-05-29T11:19:56.292080782Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-29T11:19:56.346966100Z Gathering data for ns/openshift-monitoring...
2026-05-29T11:19:56.363860939Z Wrote inspect data to must-gather.
2026-05-29T11:19:56.409358458Z INFO: 'previous-logs' folder not found on ip-10-0-131-208.ec2.internal, skipping...
2026-05-29T11:19:56.475657834Z Wrote inspect data to must-gather.
2026-05-29T11:19:56.484291705Z INFO: Waiting for HAProxy config collection to complete ...
2026-05-29T11:19:56.518087916Z Wrote inspect data to must-gather.
2026-05-29T11:19:56.622138598Z No resources found
2026-05-29T11:19:56.645360237Z Wrote inspect data to must-gather.
2026-05-29T11:19:56.723061636Z error: the server doesn't have a resource type "machineconfigs"
2026-05-29T11:19:56.798360587Z Wrote inspect data to must-gather.
2026-05-29T11:19:56.804421984Z INFO: Getting rules from prometheus-k8s-0
2026-05-29T11:19:56.867563978Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70
2026-05-29T11:19:56.871503980Z tar: Removing leading `/' from member names
2026-05-29T11:19:56.880717399Z INFO: HAProxy config collection complete.
2026-05-29T11:19:56.885045854Z INFO: 'previous-logs' folder not found on ip-10-0-139-116.ec2.internal, skipping...
2026-05-29T11:19:56.959647324Z Wrote inspect data to must-gather.
2026-05-29T11:19:56.967895351Z Wrote inspect data to must-gather.
2026-05-29T11:19:57.138835841Z INFO: 'previous-logs' folder not found on ip-10-0-142-12.ec2.internal, skipping...
2026-05-29T11:19:57.138876890Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-05-29T11:19:57.138900895Z INFO: Machine Config Daemon termination log collection complete.
2026-05-29T11:19:57.191876250Z Wrote inspect data to must-gather.
2026-05-29T11:19:57.198614148Z Wrote inspect data to must-gather.
2026-05-29T11:19:57.249432852Z INFO: Getting status/config from prometheus-k8s-0
2026-05-29T11:19:57.345456438Z error: the server doesn't have a resource type "kubeletconfigs"
2026-05-29T11:19:57.414270002Z Wrote inspect data to must-gather.
2026-05-29T11:19:57.539794661Z Wrote inspect data to must-gather.
2026-05-29T11:19:57.645647348Z INFO: Getting status/flags from prometheus-k8s-0
2026-05-29T11:19:57.688484218Z INFO: INTERCONNECT MODE
2026-05-29T11:19:57.688575852Z INFO: Gathering ovn-kubernetes DBs
2026-05-29T11:19:57.755384057Z Wrote inspect data to must-gather.
2026-05-29T11:19:57.837287570Z INFO: Gathering OVN_Northbound from ovnkube-node-5jfxf...
2026-05-29T11:19:57.837516564Z INFO: Gathering OVN_Northbound from ovnkube-node-9rm5p...
2026-05-29T11:19:57.837740366Z INFO: Gathering OVN_Northbound from ovnkube-node-c8682...
2026-05-29T11:19:57.837999371Z INFO: Gathering OVN_Southbound from ovnkube-node-5jfxf...
2026-05-29T11:19:57.838277761Z INFO: Gathering OVN_Southbound from ovnkube-node-9rm5p...
2026-05-29T11:19:57.838530599Z INFO: Gathering OVN_Southbound from ovnkube-node-c8682...
2026-05-29T11:19:57.897324455Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-05-29T11:19:58.031739806Z Wrote inspect data to must-gather.
2026-05-29T11:19:58.141266695Z tar: Removing leading `/' from member names
2026-05-29T11:19:58.167448080Z tar: Removing leading `/' from member names
2026-05-29T11:19:58.195843474Z tar: Removing leading `/' from member names
2026-05-29T11:19:58.206387749Z tar: Removing leading `/' from member names
2026-05-29T11:19:58.207119039Z tar: Removing leading `/' from member names
2026-05-29T11:19:58.215877780Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-29T11:19:58.223794585Z tar: Removing leading `/' from member names
2026-05-29T11:19:58.283993940Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-05-29T11:19:58.326858447Z Wrote inspect data to must-gather.
2026-05-29T11:19:58.557942964Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-05-29T11:19:58.561392931Z Wrote inspect data to must-gather.
2026-05-29T11:19:58.629549497Z INFO: Waiting for network log collection to complete ...
2026-05-29T11:19:58.629677942Z INFO: Waiting for ovnk database copies to complete ...
2026-05-29T11:19:58.630181941Z INFO: Copying ovnk databases complete.
2026-05-29T11:19:58.632389012Z 3.7M	must-gather/network_logs/ovnk_database_store
2026-05-29T11:19:58.635211571Z ovnk_database_store/
2026-05-29T11:19:58.635287313Z ovnk_database_store/ovnkube-node-5jfxf_nbdb
2026-05-29T11:19:58.676448017Z ovnk_database_store/ovnkube-node-9rm5p_nbdb
2026-05-29T11:19:58.685543805Z ovnk_database_store/ovnkube-node-5jfxf_sbdb
2026-05-29T11:19:58.705053063Z ovnk_database_store/ovnkube-node-c8682_sbdb
2026-05-29T11:19:58.729767172Z ovnk_database_store/ovnkube-node-c8682_nbdb
2026-05-29T11:19:58.738044355Z ovnk_database_store/ovnkube-node-9rm5p_sbdb
2026-05-29T11:19:58.758650357Z INFO: Network log collection complete.
2026-05-29T11:19:58.775428042Z W0529 11:19:58.775373    1376 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-05-29T11:19:58.780411822Z Wrote inspect data to must-gather.
2026-05-29T11:19:58.816374344Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-29T11:19:58.954009387Z INFO: Getting status from alertmanager-main-0
2026-05-29T11:19:59.002078608Z Gathering data for ns/openshift-network-console...
2026-05-29T11:19:59.056518766Z Wrote inspect data to must-gather.
2026-05-29T11:19:59.311688234Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-05-29T11:19:59.313961802Z INFO: Fallback to identify the container image from release info
2026-05-29T11:19:59.423674007Z Gathering data for ns/openshift-console-operator...
2026-05-29T11:19:59.802545666Z Gathering data for ns/openshift-console...
2026-05-29T11:19:59.861612498Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:934b226bb305ecfe687cdb9684d7d4cf04b130e6254c2817dd1a6112d4829bda
2026-05-29T11:19:59.993867237Z daemonset.apps/perf-node-gather-daemonset created
2026-05-29T11:20:00.119061516Z Waiting for performance profile collector pods to become ready: 1
2026-05-29T11:20:00.314069297Z Gathering data for ns/openshift-cluster-storage-operator...
2026-05-29T11:20:00.768089784Z Gathering data for ns/openshift-dns-operator...
2026-05-29T11:20:01.055897777Z Gathering data for ns/openshift-dns...
2026-05-29T11:20:01.230102324Z Waiting for performance profile collector pods to become ready: 2
2026-05-29T11:20:01.785442757Z Gathering data for ns/openshift-image-registry...
2026-05-29T11:20:01.872644137Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70
2026-05-29T11:20:02.342078897Z Gathering data for ns/openshift-ingress-operator...
2026-05-29T11:20:02.356136899Z Waiting for performance profile collector pods to become ready: 3
2026-05-29T11:20:02.751783692Z Gathering data for ns/openshift-ingress...
2026-05-29T11:20:03.112608584Z Gathering data for ns/openshift-ingress-canary...
2026-05-29T11:20:03.479483144Z Waiting for performance profile collector pods to become ready: 4
2026-05-29T11:20:03.545591993Z Gathering data for ns/openshift-insights...
2026-05-29T11:20:04.598561649Z Waiting for performance profile collector pods to become ready: 5
2026-05-29T11:20:05.586803348Z Gathering data for ns/openshift-config...
2026-05-29T11:20:05.723551368Z Waiting for performance profile collector pods to become ready: 6
2026-05-29T11:20:05.862263441Z Gathering data for ns/openshift-config-managed...
2026-05-29T11:20:06.261164651Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-05-29T11:20:06.518336521Z Gathering data for ns/openshift-kube-apiserver...
2026-05-29T11:20:06.781122932Z Gathering data for ns/openshift-kube-controller-manager...
2026-05-29T11:20:06.857010428Z Waiting for performance profile collector pods to become ready: 7
2026-05-29T11:20:06.877065783Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70
2026-05-29T11:20:07.061825210Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-05-29T11:20:07.331736771Z Gathering data for ns/openshift-kube-scheduler...
2026-05-29T11:20:07.583316104Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-05-29T11:20:07.862105651Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-05-29T11:20:07.983042762Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-05-29T11:20:08.197989506Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-05-29T11:20:08.242390334Z Collecting performance related data for node ip-10-0-142-12.ec2.internal
2026-05-29T11:20:08.255390666Z Collecting performance related data for node ip-10-0-131-208.ec2.internal
2026-05-29T11:20:08.268262295Z Collecting performance related data for node ip-10-0-139-116.ec2.internal
2026-05-29T11:20:08.533431275Z Gathering data for ns/openshift-user-workload-monitoring...
2026-05-29T11:20:09.144218276Z Gathering data for ns/openshift-multus...
2026-05-29T11:20:10.825416431Z Gathering data for ns/openshift-ovn-kubernetes...
2026-05-29T11:20:11.881531442Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70
2026-05-29T11:20:12.443899592Z Gathering data for ns/openshift-host-network...
2026-05-29T11:20:12.791134226Z Gathering data for ns/openshift-network-diagnostics...
2026-05-29T11:20:13.312011067Z Gathering data for ns/openshift-network-node-identity...
2026-05-29T11:20:13.703621165Z Gathering data for ns/openshift-network-operator...
2026-05-29T11:20:14.063100603Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-05-29T11:20:14.312304703Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-05-29T11:20:14.771309602Z Gathering data for ns/openshift-apiserver-operator...
2026-05-29T11:20:15.061911083Z Gathering data for ns/openshift-apiserver...
2026-05-29T11:20:15.450788012Z Gathering data for ns/openshift-controller-manager-operator...
2026-05-29T11:20:15.713007022Z Gathering data for ns/openshift-controller-manager...
2026-05-29T11:20:15.975442023Z Gathering data for ns/openshift-cluster-samples-operator...
2026-05-29T11:20:16.607404661Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-05-29T11:20:16.850133499Z Collecting kubelet logs for node ip-10-0-142-12.ec2.internal
2026-05-29T11:20:16.851959544Z Collecting kubelet logs for node ip-10-0-131-208.ec2.internal
2026-05-29T11:20:16.853809622Z Collecting kubelet logs for node ip-10-0-139-116.ec2.internal
2026-05-29T11:20:16.888755323Z [disk usage checker] Volume usage percentage: current = 19 ; allowed = 70
2026-05-29T11:20:16.893463413Z Gathering data for ns/openshift-service-ca-operator...
2026-05-29T11:20:17.223313846Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-05-29T11:20:17.228792392Z INFO: Node performance data collection complete.
2026-05-29T11:20:17.288151810Z Gathering data for ns/openshift-service-ca...
2026-05-29T11:20:17.676397364Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-05-29T11:20:18.532275416Z Wrote inspect data to must-gather.
2026-05-29T11:20:18.532326649Z error: inspection completed with the errors occurred while gathering data:
2026-05-29T11:20:18.532326649Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-05-29T11:20:18.663379703Z error: the server doesn't have a resource type "clusters"
2026-05-29T11:20:18.795306269Z Caches written to disk