2026-06-02T09:05:02.568304835Z [disk usage checker] Started
2026-06-02T09:05:02.572742265Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-02T09:05:02.778753136Z Gathering data for ns/openshift-cluster-version...
2026-06-02T09:05:02.935197808Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T09:05:03.038400280Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T09:05:03.115702906Z Gathering data for ns/default...
2026-06-02T09:05:03.405987153Z Gathering data for ns/openshift...
2026-06-02T09:05:03.792895552Z Gathering data for ns/kube-system...
2026-06-02T09:05:04.474741469Z Gathering data for ns/openshift-etcd...
2026-06-02T09:05:04.751604969Z Waiting on subprocesses to finish execution.
2026-06-02T09:05:04.754762701Z INFO: Gathering HAProxy config files
2026-06-02T09:05:04.764048018Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T09:05:04.765399282Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T09:05:04.769581479Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T09:05:04.776870734Z Wrote inspect data to must-gather.
2026-06-02T09:05:04.776901963Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T09:05:04.776901963Z     namespaces "assisted-installer" not found
2026-06-02T09:05:04.782021084Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T09:05:04.867183952Z INFO: Collecting host service logs for crio
2026-06-02T09:05:04.867461092Z INFO: Collecting host service logs for kubelet
2026-06-02T09:05:04.867748768Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T09:05:04.868049909Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T09:05:04.868344506Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T09:05:04.868620443Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T09:05:04.868899158Z INFO: Collecting host service logs for NetworkManager
2026-06-02T09:05:04.869209884Z INFO: Collecting host service logs for openvswitch
2026-06-02T09:05:04.869482650Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T09:05:04.869763807Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T09:05:04.870066871Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T09:05:04.870404632Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T09:05:05.457036728Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T09:05:05.618099041Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-vjv9r
2026-06-02T09:05:05.618099041Z insights-runtime-extractor-ct5z5
2026-06-02T09:05:05.618099041Z insights-runtime-extractor-jmfqs
2026-06-02T09:05:05.618099041Z insights-runtime-extractor-pmv9b
2026-06-02T09:05:05.702255134Z Wrote inspect data to must-gather.
2026-06-02T09:05:05.847072082Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T09:05:05.847614134Z No resources found in openshift-etcd namespace.
2026-06-02T09:05:05.918071974Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T09:05:06.040854575Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T09:05:06.084860888Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T09:05:06.223047604Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T09:05:06.352125063Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T09:05:06.352153530Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T09:05:06.375294569Z Wrote inspect data to must-gather.
2026-06-02T09:05:06.438661311Z Wrote inspect data to must-gather.
2026-06-02T09:05:06.441580291Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T09:05:06.476353435Z Wrote inspect data to must-gather.
2026-06-02T09:05:06.481067016Z No resources found
2026-06-02T09:05:06.512604396Z Gathering data for ns/openshift-monitoring...
2026-06-02T09:05:06.549472330Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T09:05:06.551465642Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T09:05:06.561627039Z No resources found
2026-06-02T09:05:06.618579767Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T09:05:06.618579767Z See 'oc rsync -h' for help and examples
2026-06-02T09:05:06.659539179Z INFO: Worker host service log collection to complete.
2026-06-02T09:05:06.720234502Z ERROR: No running kube-apiserver pods found
2026-06-02T09:05:06.769803752Z Wrote inspect data to must-gather.
2026-06-02T09:05:06.861607688Z Wrote inspect data to must-gather.
2026-06-02T09:05:06.871231315Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T09:05:06.882456463Z Wrote inspect data to must-gather.
2026-06-02T09:05:06.905759767Z INFO: 'previous-logs' folder not found on ip-10-0-133-25.ec2.internal, skipping...
2026-06-02T09:05:06.957899392Z tar: Removing leading `/' from member names
2026-06-02T09:05:06.962992748Z INFO: HAProxy config collection complete.
2026-06-02T09:05:07.023970932Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T09:05:07.078791541Z Wrote inspect data to must-gather.
2026-06-02T09:05:07.155264771Z INFO: 'previous-logs' folder not found on ip-10-0-137-59.ec2.internal, skipping...
2026-06-02T09:05:07.226375064Z Wrote inspect data to must-gather.
2026-06-02T09:05:07.264519422Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T09:05:07.326599440Z Wrote inspect data to must-gather.
2026-06-02T09:05:07.398863806Z INFO: 'previous-logs' folder not found on ip-10-0-140-206.ec2.internal, skipping...
2026-06-02T09:05:07.398905107Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T09:05:07.398915874Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T09:05:07.440773081Z Wrote inspect data to must-gather.
2026-06-02T09:05:07.563551468Z Wrote inspect data to must-gather.
2026-06-02T09:05:07.571586606Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T09:05:07.579799957Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-02T09:05:07.632770219Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T09:05:07.758098089Z Wrote inspect data to must-gather.
2026-06-02T09:05:07.814837458Z INFO: INTERCONNECT MODE
2026-06-02T09:05:07.814868583Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T09:05:07.969938995Z Wrote inspect data to must-gather.
2026-06-02T09:05:07.993265385Z INFO: Gathering OVN_Northbound from ovnkube-node-57dzl...
2026-06-02T09:05:07.993546840Z INFO: Gathering OVN_Northbound from ovnkube-node-twlpl...
2026-06-02T09:05:07.993824159Z INFO: Gathering OVN_Northbound from ovnkube-node-x9wz4...
2026-06-02T09:05:07.994120533Z INFO: Gathering OVN_Southbound from ovnkube-node-57dzl...
2026-06-02T09:05:07.994426269Z INFO: Gathering OVN_Southbound from ovnkube-node-twlpl...
2026-06-02T09:05:07.994709917Z INFO: Gathering OVN_Southbound from ovnkube-node-x9wz4...
2026-06-02T09:05:08.004564281Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T09:05:08.064226918Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T09:05:08.297128004Z tar: Removing leading `/' from member names
2026-06-02T09:05:08.305684431Z Wrote inspect data to must-gather.
2026-06-02T09:05:08.316940855Z tar: Removing leading `/' from member names
2026-06-02T09:05:08.330401191Z tar: Removing leading `/' from member names
2026-06-02T09:05:08.336615976Z tar: Removing leading `/' from member names
2026-06-02T09:05:08.349969993Z tar: Removing leading `/' from member names
2026-06-02T09:05:08.419995284Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T09:05:08.429538707Z tar: Removing leading `/' from member names
2026-06-02T09:05:08.527586111Z Wrote inspect data to must-gather.
2026-06-02T09:05:08.669863842Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T09:05:08.739087370Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T09:05:08.789649677Z INFO: Waiting for network log collection to complete ...
2026-06-02T09:05:08.789774315Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T09:05:08.790210259Z INFO: Copying ovnk databases complete.
2026-06-02T09:05:08.792297838Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-06-02T09:05:08.795185060Z ovnk_database_store/
2026-06-02T09:05:08.795185060Z ovnk_database_store/ovnkube-node-x9wz4_nbdb
2026-06-02T09:05:08.804779912Z ovnk_database_store/ovnkube-node-twlpl_sbdb
2026-06-02T09:05:08.821135844Z ovnk_database_store/ovnkube-node-57dzl_sbdb
2026-06-02T09:05:08.835630202Z ovnk_database_store/ovnkube-node-57dzl_nbdb
2026-06-02T09:05:08.836879947Z Wrote inspect data to must-gather.
2026-06-02T09:05:08.841510114Z ovnk_database_store/ovnkube-node-x9wz4_sbdb
2026-06-02T09:05:08.855074971Z ovnk_database_store/ovnkube-node-twlpl_nbdb
2026-06-02T09:05:08.866100722Z INFO: Network log collection complete.
2026-06-02T09:05:08.902122926Z Gathering data for ns/openshift-network-console...
2026-06-02T09:05:08.903203672Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T09:05:09.099081671Z Wrote inspect data to must-gather.
2026-06-02T09:05:09.292275188Z INFO: Getting status from alertmanager-main-0
2026-06-02T09:05:09.325495708Z Gathering data for ns/openshift-console-operator...
2026-06-02T09:05:09.399465705Z Wrote inspect data to must-gather.
2026-06-02T09:05:09.620663164Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T09:05:09.622790122Z INFO: Fallback to identify the container image from release info
2026-06-02T09:05:09.688738705Z Gathering data for ns/openshift-console...
2026-06-02T09:05:10.086461937Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T09:05:10.407259828Z Gathering data for ns/openshift-dns-operator...
2026-06-02T09:05:10.526559519Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T09:05:10.649078922Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T09:05:10.671407166Z Gathering data for ns/openshift-dns...
2026-06-02T09:05:10.761798177Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T09:05:11.308289869Z Gathering data for ns/openshift-image-registry...
2026-06-02T09:05:11.742402305Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T09:05:11.869559965Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T09:05:12.047250453Z Gathering data for ns/openshift-ingress...
2026-06-02T09:05:12.376700697Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T09:05:12.589286597Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-02T09:05:12.735213031Z Gathering data for ns/openshift-insights...
2026-06-02T09:05:12.969330293Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T09:05:14.074826215Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T09:05:14.447378772Z Gathering data for ns/openshift-config...
2026-06-02T09:05:14.699652831Z Gathering data for ns/openshift-config-managed...
2026-06-02T09:05:15.078904512Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T09:05:15.191447857Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T09:05:15.315385887Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T09:05:15.549794397Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T09:05:15.814238816Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T09:05:16.064468542Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T09:05:16.311316368Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T09:05:16.317451114Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T09:05:16.571125031Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T09:05:16.854108676Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T09:05:17.133751989Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T09:05:17.425009482Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T09:05:17.570704355Z Gathering data for ns/openshift-multus...
2026-06-02T09:05:17.594367321Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-02T09:05:18.541204793Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T09:05:18.800270532Z Collecting performance related data for node ip-10-0-137-59.ec2.internal
2026-06-02T09:05:18.810260784Z Collecting performance related data for node ip-10-0-140-206.ec2.internal
2026-06-02T09:05:18.818223478Z Collecting performance related data for node ip-10-0-133-25.ec2.internal
2026-06-02T09:05:18.913341602Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T09:05:20.477570973Z Gathering data for ns/openshift-host-network...
2026-06-02T09:05:20.755787226Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T09:05:21.290037186Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T09:05:21.707538988Z Gathering data for ns/openshift-network-operator...
2026-06-02T09:05:22.055160777Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T09:05:22.329104303Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T09:05:22.599571561Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-02T09:05:22.752536016Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T09:05:23.053358583Z Gathering data for ns/openshift-apiserver...
2026-06-02T09:05:23.464030890Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T09:05:23.708182542Z Gathering data for ns/openshift-controller-manager...
2026-06-02T09:05:23.986240410Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T09:05:24.620999816Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T09:05:24.882192934Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T09:05:25.171992473Z Gathering data for ns/openshift-service-ca...
2026-06-02T09:05:25.551732833Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T09:05:26.444535808Z Wrote inspect data to must-gather.
2026-06-02T09:05:26.444581221Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T09:05:26.444581221Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T09:05:26.703748085Z Collecting kubelet logs for node ip-10-0-137-59.ec2.internal
2026-06-02T09:05:26.705685682Z Collecting kubelet logs for node ip-10-0-140-206.ec2.internal
2026-06-02T09:05:26.707571132Z Collecting kubelet logs for node ip-10-0-133-25.ec2.internal
2026-06-02T09:05:26.996720629Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T09:05:27.001291964Z INFO: Node performance data collection complete.
2026-06-02T09:05:27.122893885Z error: the server doesn't have a resource type "clusters"
2026-06-02T09:05:27.291587783Z Caches written to disk