2026-06-02T15:46:48.446868700Z [disk usage checker] Started
2026-06-02T15:46:48.450467122Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-02T15:46:48.683937856Z Gathering data for ns/openshift-cluster-version...
2026-06-02T15:46:48.863210790Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T15:46:48.983201323Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T15:46:49.089435876Z Gathering data for ns/default...
2026-06-02T15:46:49.515464031Z Gathering data for ns/openshift...
2026-06-02T15:46:50.067488578Z Gathering data for ns/kube-system...
2026-06-02T15:46:50.897851813Z Waiting on subprocesses to finish execution.
2026-06-02T15:46:50.912117161Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T15:46:50.912595548Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T15:46:50.914717476Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T15:46:50.914928740Z INFO: Gathering HAProxy config files
2026-06-02T15:46:50.919315752Z INFO: Collecting host service logs for crio
2026-06-02T15:46:50.919992212Z INFO: Collecting host service logs for kubelet
2026-06-02T15:46:50.920331695Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T15:46:50.920683387Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T15:46:50.921025762Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T15:46:50.921394525Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T15:46:50.921744437Z INFO: Collecting host service logs for NetworkManager
2026-06-02T15:46:50.922059550Z INFO: Collecting host service logs for openvswitch
2026-06-02T15:46:50.922401171Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T15:46:50.922759798Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T15:46:50.923097327Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T15:46:50.923559680Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T15:46:50.948378432Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T15:46:51.009264549Z Gathering data for ns/openshift-etcd...
2026-06-02T15:46:51.643661494Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T15:46:51.704697458Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T15:46:51.849670789Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T15:46:51.854326310Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T15:46:51.854380694Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T15:46:51.993107288Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-56xdk
2026-06-02T15:46:51.993107288Z insights-runtime-extractor-895kp
2026-06-02T15:46:51.993107288Z insights-runtime-extractor-ffdfs
2026-06-02T15:46:51.993107288Z insights-runtime-extractor-fq9wv
2026-06-02T15:46:52.098494767Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T15:46:52.111217434Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T15:46:52.148922954Z ERROR: No running kube-apiserver pods found
2026-06-02T15:46:52.277242091Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T15:46:52.396238357Z No resources found in openshift-etcd namespace.
2026-06-02T15:46:52.509233605Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T15:46:52.509233605Z See 'oc rsync -h' for help and examples
2026-06-02T15:46:52.721229071Z No resources found
2026-06-02T15:46:52.735181665Z Wrote inspect data to must-gather.
2026-06-02T15:46:52.741553091Z INFO: Worker host service log collection to complete.
2026-06-02T15:46:53.046886804Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T15:46:53.204542246Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T15:46:53.213551875Z Wrote inspect data to must-gather.
2026-06-02T15:46:53.352573390Z INFO: 'previous-logs' folder not found on ip-10-0-136-206.ec2.internal, skipping...
2026-06-02T15:46:53.353116049Z No resources found
2026-06-02T15:46:53.465888790Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T15:46:53.550041711Z Wrote inspect data to must-gather.
2026-06-02T15:46:53.562332406Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-02T15:46:53.591547786Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T15:46:53.621212589Z Wrote inspect data to must-gather.
2026-06-02T15:46:53.675376410Z Wrote inspect data to must-gather.
2026-06-02T15:46:53.807802059Z Wrote inspect data to must-gather.
2026-06-02T15:46:53.854935843Z Wrote inspect data to must-gather.
2026-06-02T15:46:53.855050405Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T15:46:53.855050405Z     namespaces "assisted-installer" not found
2026-06-02T15:46:53.862455095Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T15:46:54.008896219Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T15:46:54.029784952Z tar: Removing leading `/' from member names
2026-06-02T15:46:54.036486919Z INFO: HAProxy config collection complete.
2026-06-02T15:46:54.072798619Z INFO: 'previous-logs' folder not found on ip-10-0-140-163.ec2.internal, skipping...
2026-06-02T15:46:54.145874922Z Gathering data for ns/kuadrant-system...
2026-06-02T15:46:54.228986379Z Wrote inspect data to must-gather.
2026-06-02T15:46:54.363744182Z Wrote inspect data to must-gather.
2026-06-02T15:46:54.384739509Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T15:46:54.393712101Z INFO: 'previous-logs' folder not found on ip-10-0-141-151.ec2.internal, skipping...
2026-06-02T15:46:54.393818506Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T15:46:54.393873954Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T15:46:54.596125554Z Wrote inspect data to must-gather.
2026-06-02T15:46:54.681471355Z Wrote inspect data to must-gather.
2026-06-02T15:46:54.886960495Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T15:46:54.890244864Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T15:46:54.917516724Z Wrote inspect data to must-gather.
2026-06-02T15:46:55.198665909Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T15:46:55.200241565Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T15:46:55.218612009Z Wrote inspect data to must-gather.
2026-06-02T15:46:55.318679069Z INFO: INTERCONNECT MODE
2026-06-02T15:46:55.318770589Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T15:46:55.452558077Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T15:46:55.519247981Z INFO: Gathering OVN_Northbound from ovnkube-node-6wlqs...
2026-06-02T15:46:55.519514159Z INFO: Gathering OVN_Northbound from ovnkube-node-7vsst...
2026-06-02T15:46:55.519761701Z INFO: Gathering OVN_Northbound from ovnkube-node-spfzb...
2026-06-02T15:46:55.520153413Z INFO: Gathering OVN_Southbound from ovnkube-node-6wlqs...
2026-06-02T15:46:55.520638954Z INFO: Gathering OVN_Southbound from ovnkube-node-7vsst...
2026-06-02T15:46:55.520902175Z INFO: Gathering OVN_Southbound from ovnkube-node-spfzb...
2026-06-02T15:46:55.536542966Z Wrote inspect data to must-gather.
2026-06-02T15:46:55.893133542Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T15:46:55.905204554Z tar: Removing leading `/' from member names
2026-06-02T15:46:55.915865887Z tar: Removing leading `/' from member names
2026-06-02T15:46:55.930951832Z tar: Removing leading `/' from member names
2026-06-02T15:46:55.969459411Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T15:46:55.974723727Z tar: Removing leading `/' from member names
2026-06-02T15:46:56.011111535Z tar: Removing leading `/' from member names
2026-06-02T15:46:56.011510893Z tar: Removing leading `/' from member names
2026-06-02T15:46:56.131904584Z Wrote inspect data to must-gather.
2026-06-02T15:46:56.286726323Z Gathering data for ns/openshift-monitoring...
2026-06-02T15:46:56.454370869Z INFO: Getting status from alertmanager-main-0
2026-06-02T15:46:56.573896064Z Wrote inspect data to must-gather.
2026-06-02T15:46:56.629373093Z INFO: Waiting for network log collection to complete ...
2026-06-02T15:46:56.629439056Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T15:46:56.629933144Z INFO: Copying ovnk databases complete.
2026-06-02T15:46:56.632551286Z 4.2M	must-gather/network_logs/ovnk_database_store
2026-06-02T15:46:56.634947330Z ovnk_database_store/
2026-06-02T15:46:56.634947330Z ovnk_database_store/ovnkube-node-6wlqs_sbdb
2026-06-02T15:46:56.663716392Z ovnk_database_store/ovnkube-node-7vsst_sbdb
2026-06-02T15:46:56.685443214Z ovnk_database_store/ovnkube-node-6wlqs_nbdb
2026-06-02T15:46:56.698178514Z ovnk_database_store/ovnkube-node-spfzb_nbdb
2026-06-02T15:46:56.708510945Z ovnk_database_store/ovnkube-node-7vsst_nbdb
2026-06-02T15:46:56.723217288Z ovnk_database_store/ovnkube-node-spfzb_sbdb
2026-06-02T15:46:56.749950798Z INFO: Network log collection complete.
2026-06-02T15:46:56.879675634Z Wrote inspect data to must-gather.
2026-06-02T15:46:57.180454495Z Wrote inspect data to must-gather.
2026-06-02T15:46:57.476210670Z Wrote inspect data to must-gather.
2026-06-02T15:46:57.771177124Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T15:46:57.773134314Z INFO: Fallback to identify the container image from release info
2026-06-02T15:46:58.496119491Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T15:46:58.584889666Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-02T15:46:58.623360288Z Gathering data for ns/openshift-network-console...
2026-06-02T15:46:58.636544506Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T15:46:58.796775599Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T15:46:59.275635736Z Gathering data for ns/openshift-console-operator...
2026-06-02T15:46:59.781870809Z Gathering data for ns/openshift-console...
2026-06-02T15:46:59.965359845Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T15:47:00.363269668Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T15:47:00.559989738Z Wrote inspect data to must-gather.
2026-06-02T15:47:00.833549681Z Gathering data for ns/openshift-dns-operator...
2026-06-02T15:47:01.089916233Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T15:47:01.197375516Z Gathering data for ns/openshift-dns...
2026-06-02T15:47:01.992539263Z Gathering data for ns/openshift-image-registry...
2026-06-02T15:47:02.233849100Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T15:47:02.581733876Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T15:47:03.010916336Z Gathering data for ns/openshift-ingress...
2026-06-02T15:47:03.372304039Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T15:47:03.593051540Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-02T15:47:03.790590112Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T15:47:04.343736426Z Gathering data for ns/openshift-insights...
2026-06-02T15:47:04.480623622Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T15:47:05.604190010Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T15:47:06.611172505Z Gathering data for ns/opendatahub...
2026-06-02T15:47:06.716566737Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T15:47:06.953710750Z Collecting performance related data for node ip-10-0-140-163.ec2.internal
2026-06-02T15:47:06.960610907Z Collecting performance related data for node ip-10-0-141-151.ec2.internal
2026-06-02T15:47:06.967812886Z Collecting performance related data for node ip-10-0-136-206.ec2.internal
2026-06-02T15:47:08.597834238Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-02T15:47:08.731000705Z Gathering data for ns/openshift-lws-operator...
2026-06-02T15:47:10.390356425Z Gathering data for ns/openshift-config...
2026-06-02T15:47:10.737837362Z Gathering data for ns/openshift-config-managed...
2026-06-02T15:47:11.248368241Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T15:47:11.609300075Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T15:47:11.998266508Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T15:47:12.400962446Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T15:47:12.840857801Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T15:47:13.208996294Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T15:47:13.602242986Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-02T15:47:13.641888515Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T15:47:14.114039969Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T15:47:14.552799112Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T15:47:15.082133450Z Collecting kubelet logs for node ip-10-0-140-163.ec2.internal
2026-06-02T15:47:15.084240527Z Collecting kubelet logs for node ip-10-0-141-151.ec2.internal
2026-06-02T15:47:15.086326269Z Collecting kubelet logs for node ip-10-0-136-206.ec2.internal
2026-06-02T15:47:15.265327242Z Gathering data for ns/openshift-multus...
2026-06-02T15:47:15.428160724Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T15:47:15.433318683Z INFO: Node performance data collection complete.
2026-06-02T15:47:16.801947759Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T15:47:18.518136393Z Gathering data for ns/openshift-host-network...
2026-06-02T15:47:18.606790210Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-02T15:47:18.960037057Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T15:47:19.589189549Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T15:47:20.115065264Z Gathering data for ns/openshift-network-operator...
2026-06-02T15:47:20.631536009Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T15:47:20.983612617Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T15:47:21.533814376Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T15:47:21.926749958Z Gathering data for ns/openshift-apiserver...
2026-06-02T15:47:22.420647765Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T15:47:22.783942265Z Gathering data for ns/openshift-controller-manager...
2026-06-02T15:47:23.149275735Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T15:47:23.611308627Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-02T15:47:23.954187380Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T15:47:24.334061768Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T15:47:24.738948718Z Gathering data for ns/openshift-service-ca...
2026-06-02T15:47:25.238681162Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T15:47:26.331635707Z Wrote inspect data to must-gather.
2026-06-02T15:47:26.331688964Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T15:47:26.331688964Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T15:47:26.474972710Z error: the server doesn't have a resource type "clusters"
2026-06-02T15:47:26.634674258Z Caches written to disk