2026-06-09T12:34:59.553829451Z [disk usage checker] Started
2026-06-09T12:34:59.557899126Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T12:34:59.776328839Z Gathering data for ns/openshift-cluster-version...
2026-06-09T12:34:59.957049071Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-09T12:35:00.075310318Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-09T12:35:00.214451620Z Gathering data for ns/default...
2026-06-09T12:35:00.573723394Z Gathering data for ns/openshift...
2026-06-09T12:35:01.056578974Z Gathering data for ns/kube-system...
2026-06-09T12:35:02.077197433Z Waiting on subprocesses to finish execution.
2026-06-09T12:35:02.083716827Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-09T12:35:02.094830650Z Executing Istio gather script
2026-06-09T12:35:02.097825299Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-09T12:35:02.112566628Z INFO: Collecting host service logs for crio
2026-06-09T12:35:02.113133563Z INFO: Collecting host service logs for kubelet
2026-06-09T12:35:02.113482785Z INFO: Collecting host service logs for rpm-ostreed
2026-06-09T12:35:02.113803641Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-09T12:35:02.114141905Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-09T12:35:02.114467646Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-09T12:35:02.114779848Z INFO: Collecting host service logs for NetworkManager
2026-06-09T12:35:02.115108363Z INFO: Collecting host service logs for openvswitch
2026-06-09T12:35:02.115411868Z INFO: Collecting host service logs for ovs-configuration
2026-06-09T12:35:02.115715560Z INFO: Collecting host service logs for ovsdb-server
2026-06-09T12:35:02.116053574Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-09T12:35:02.116415332Z INFO: Waiting for worker host service log collection to complete ...
2026-06-09T12:35:02.142730679Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-09T12:35:02.150216393Z INFO: Gathering HAProxy config files
2026-06-09T12:35:02.387015243Z INFO: Waiting for node performance related collection to complete ...
2026-06-09T12:35:02.474548081Z No resources found in openshift-etcd namespace.
2026-06-09T12:35:02.565214679Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-09T12:35:02.837980859Z INFO: Collecting Insights Archives from insights-operator-896549976-psn2d
2026-06-09T12:35:02.838052112Z insights-runtime-extractor-fblmv
2026-06-09T12:35:02.838080226Z insights-runtime-extractor-jnnd9
2026-06-09T12:35:02.838109138Z insights-runtime-extractor-n9j2v
2026-06-09T12:35:02.917401968Z Gathering data for ns/openshift-etcd...
2026-06-09T12:35:03.016410523Z Wrote inspect data to must-gather.
2026-06-09T12:35:03.230967571Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-09T12:35:03.402813398Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-09T12:35:03.475988460Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-09T12:35:03.540260657Z error: the server doesn't have a resource type "performanceprofile"
2026-06-09T12:35:03.581040415Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-09T12:35:03.581125886Z INFO: on-disk MachineConfig config collection complete.
2026-06-09T12:35:03.583014743Z No resources found
2026-06-09T12:35:03.642043542Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-09T12:35:03.642043542Z See 'oc rsync -h' for help and examples
2026-06-09T12:35:03.732771693Z INFO: Worker host service log collection to complete.
2026-06-09T12:35:03.757549296Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-09T12:35:04.001392491Z ERROR: No running kube-apiserver pods found
2026-06-09T12:35:04.096556167Z INFO: "metallb-operator" not detected. Skipping.
2026-06-09T12:35:04.137833482Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-09T12:35:04.371275847Z Wrote inspect data to must-gather.
2026-06-09T12:35:04.509463215Z Wrote inspect data to must-gather.
2026-06-09T12:35:04.529678391Z Wrote inspect data to must-gather.
2026-06-09T12:35:04.544474263Z Wrote inspect data to must-gather.
2026-06-09T12:35:04.544605871Z error: inspection completed with the errors occurred while gathering data:
2026-06-09T12:35:04.544605871Z     namespaces "assisted-installer" not found
2026-06-09T12:35:04.606213770Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T12:35:04.620306309Z Wrote inspect data to must-gather.
2026-06-09T12:35:04.629540632Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-09T12:35:04.649967878Z INFO: 'previous-logs' folder not found on ip-10-0-131-56.ec2.internal, skipping...
2026-06-09T12:35:04.672804939Z No resources found
2026-06-09T12:35:04.675692783Z Wrote inspect data to must-gather.
2026-06-09T12:35:04.736835345Z Gathering data for ns/openshift-monitoring...
2026-06-09T12:35:04.745926944Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-09T12:35:04.814870067Z Wrote inspect data to must-gather.
2026-06-09T12:35:04.853394582Z error: the server doesn't have a resource type "machineconfigs"
2026-06-09T12:35:04.957619531Z INFO: Getting rules from prometheus-k8s-0
2026-06-09T12:35:05.022831319Z INFO: 'previous-logs' folder not found on ip-10-0-132-10.ec2.internal, skipping...
2026-06-09T12:35:05.048086615Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-09T12:35:05.057084821Z Wrote inspect data to must-gather.
2026-06-09T12:35:05.133178734Z tar: Removing leading `/' from member names
2026-06-09T12:35:05.135942831Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-09T12:35:05.138291237Z INFO: HAProxy config collection complete.
2026-06-09T12:35:05.278602885Z INFO: 'previous-logs' folder not found on ip-10-0-140-126.ec2.internal, skipping...
2026-06-09T12:35:05.278713887Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-09T12:35:05.278766902Z INFO: Machine Config Daemon termination log collection complete.
2026-06-09T12:35:05.288545416Z Wrote inspect data to must-gather.
2026-06-09T12:35:05.319286349Z Wrote inspect data to must-gather.
2026-06-09T12:35:05.436591390Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-09T12:35:05.532768042Z INFO: Getting status/config from prometheus-k8s-0
2026-06-09T12:35:05.560409633Z Wrote inspect data to must-gather.
2026-06-09T12:35:05.657803842Z Wrote inspect data to must-gather.
2026-06-09T12:35:05.842267013Z INFO: INTERCONNECT MODE
2026-06-09T12:35:05.842296236Z INFO: Gathering ovn-kubernetes DBs
2026-06-09T12:35:05.862337333Z Wrote inspect data to must-gather.
2026-06-09T12:35:05.885086495Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-09T12:35:06.012124059Z INFO: Gathering OVN_Northbound from ovnkube-node-4w4xg...
2026-06-09T12:35:06.012337545Z INFO: Gathering OVN_Northbound from ovnkube-node-88fx9...
2026-06-09T12:35:06.012543450Z INFO: Gathering OVN_Northbound from ovnkube-node-k8kq9...
2026-06-09T12:35:06.012810702Z INFO: Gathering OVN_Southbound from ovnkube-node-4w4xg...
2026-06-09T12:35:06.013102232Z INFO: Gathering OVN_Southbound from ovnkube-node-88fx9...
2026-06-09T12:35:06.013489322Z INFO: Gathering OVN_Southbound from ovnkube-node-k8kq9...
2026-06-09T12:35:06.102094010Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-09T12:35:06.154186412Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:06.161948106Z Wrote inspect data to must-gather.
2026-06-09T12:35:06.420604517Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:06.423538691Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-09T12:35:06.435362235Z Wrote inspect data to must-gather.
2026-06-09T12:35:06.498881169Z tar: Removing leading `/' from member names
2026-06-09T12:35:06.499248652Z tar: Removing leading `/' from member names
2026-06-09T12:35:06.501691113Z tar: Removing leading `/' from member names
2026-06-09T12:35:06.516664099Z tar: Removing leading `/' from member names
2026-06-09T12:35:06.520273209Z tar: Removing leading `/' from member names
2026-06-09T12:35:06.563915896Z tar: Removing leading `/' from member names
2026-06-09T12:35:06.608111601Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-09T12:35:06.633775318Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:06.665709686Z Wrote inspect data to must-gather.
2026-06-09T12:35:06.857473033Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:06.860447522Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-09T12:35:06.861188823Z INFO: Waiting for network log collection to complete ...
2026-06-09T12:35:06.861229060Z INFO: Waiting for ovnk database copies to complete ...
2026-06-09T12:35:06.861614162Z INFO: Copying ovnk databases complete.
2026-06-09T12:35:06.863278446Z 2.6M	must-gather/network_logs/ovnk_database_store
2026-06-09T12:35:06.865537379Z ovnk_database_store/
2026-06-09T12:35:06.865537379Z ovnk_database_store/ovnkube-node-4w4xg_sbdb
2026-06-09T12:35:06.883524304Z Wrote inspect data to must-gather.
2026-06-09T12:35:06.883798563Z ovnk_database_store/ovnkube-node-88fx9_sbdb
2026-06-09T12:35:06.898268811Z ovnk_database_store/ovnkube-node-4w4xg_nbdb
2026-06-09T12:35:06.904156510Z ovnk_database_store/ovnkube-node-88fx9_nbdb
2026-06-09T12:35:06.910509091Z ovnk_database_store/ovnkube-node-k8kq9_nbdb
2026-06-09T12:35:06.916583768Z ovnk_database_store/ovnkube-node-k8kq9_sbdb
2026-06-09T12:35:06.934502942Z INFO: Network log collection complete.
2026-06-09T12:35:06.938667897Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-09T12:35:07.055122192Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:07.089749025Z Wrote inspect data to must-gather.
2026-06-09T12:35:07.204523333Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-09T12:35:07.245086696Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:07.248639281Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-09T12:35:07.333731304Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-09T12:35:07.336145714Z INFO: Fallback to identify the container image from release info
2026-06-09T12:35:07.476812976Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:07.620358349Z INFO: Getting status from alertmanager-main-0
2026-06-09T12:35:07.660036652Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:07.663187863Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-09T12:35:07.809593299Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:07.976751209Z Wrote inspect data to /must-gather/istio.
2026-06-09T12:35:08.014367130Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75a8fe9618bb81a42d565c535f20bf55d78662baa7f32548859596b4c5aa793e
2026-06-09T12:35:08.146022192Z daemonset.apps/perf-node-gather-daemonset created
2026-06-09T12:35:08.270110672Z Waiting for performance profile collector pods to become ready: 1
2026-06-09T12:35:08.277728300Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-09T12:35:08.684977596Z Done executing Istio gather script
2026-06-09T12:35:09.007155147Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-09T12:35:09.348215312Z Gathering data for ns/openshift-network-console...
2026-06-09T12:35:09.381519708Z Waiting for performance profile collector pods to become ready: 2
2026-06-09T12:35:09.611666032Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T12:35:10.079637847Z Gathering data for ns/openshift-console-operator...
2026-06-09T12:35:10.512217482Z Waiting for performance profile collector pods to become ready: 3
2026-06-09T12:35:10.601150861Z Gathering data for ns/openshift-console...
2026-06-09T12:35:11.269930618Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-09T12:35:11.618471910Z Waiting for performance profile collector pods to become ready: 4
2026-06-09T12:35:11.958097055Z Gathering data for ns/openshift-dns-operator...
2026-06-09T12:35:12.363709248Z Gathering data for ns/openshift-dns...
2026-06-09T12:35:12.721485688Z Waiting for performance profile collector pods to become ready: 5
2026-06-09T12:35:13.365907711Z Gathering data for ns/openshift-image-registry...
2026-06-09T12:35:13.826664485Z Waiting for performance profile collector pods to become ready: 6
2026-06-09T12:35:14.122295126Z Gathering data for ns/openshift-ingress-operator...
2026-06-09T12:35:14.542780546Z Gathering data for ns/openshift-ingress...
2026-06-09T12:35:14.617621471Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T12:35:14.953295756Z Waiting for performance profile collector pods to become ready: 7
2026-06-09T12:35:15.048552292Z Gathering data for ns/openshift-ingress-canary...
2026-06-09T12:35:15.566777302Z Gathering data for ns/openshift-insights...
2026-06-09T12:35:16.063707036Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-09T12:35:16.302578337Z Collecting performance related data for node ip-10-0-131-56.ec2.internal
2026-06-09T12:35:16.309586163Z Collecting performance related data for node ip-10-0-140-126.ec2.internal
2026-06-09T12:35:16.316754622Z Collecting performance related data for node ip-10-0-132-10.ec2.internal
2026-06-09T12:35:18.259710080Z Gathering data for ns/openshift-config...
2026-06-09T12:35:18.735707532Z Gathering data for ns/openshift-config-managed...
2026-06-09T12:35:19.301817346Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-09T12:35:19.622622570Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T12:35:19.971235200Z Gathering data for ns/openshift-kube-apiserver...
2026-06-09T12:35:20.528657288Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-09T12:35:20.955316212Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-09T12:35:21.373114616Z Gathering data for ns/openshift-kube-scheduler...
2026-06-09T12:35:21.789118823Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-09T12:35:22.245970279Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-09T12:35:22.988701107Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-09T12:35:23.562926748Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-09T12:35:24.353699249Z Gathering data for ns/openshift-multus...
2026-06-09T12:35:24.627336148Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T12:35:25.016258082Z Collecting kubelet logs for node ip-10-0-131-56.ec2.internal
2026-06-09T12:35:25.018113587Z Collecting kubelet logs for node ip-10-0-140-126.ec2.internal
2026-06-09T12:35:25.020177907Z Collecting kubelet logs for node ip-10-0-132-10.ec2.internal
2026-06-09T12:35:25.350490393Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-6fx6c namespace
2026-06-09T12:35:25.356990805Z INFO: Node performance data collection complete.
2026-06-09T12:35:27.275195528Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-09T12:35:29.443486307Z Gathering data for ns/openshift-host-network...
2026-06-09T12:35:29.632096880Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T12:35:29.952571612Z Gathering data for ns/openshift-network-diagnostics...
2026-06-09T12:35:30.749309815Z Gathering data for ns/openshift-network-node-identity...
2026-06-09T12:35:31.255759562Z Gathering data for ns/openshift-network-operator...
2026-06-09T12:35:31.721622499Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-09T12:35:32.047353946Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-09T12:35:32.599655151Z Gathering data for ns/openshift-apiserver-operator...
2026-06-09T12:35:32.917151259Z Gathering data for ns/openshift-apiserver...
2026-06-09T12:35:33.345766175Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-09T12:35:33.720554229Z Gathering data for ns/openshift-controller-manager...
2026-06-09T12:35:34.012016679Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-09T12:35:34.636796212Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T12:35:34.786333010Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-09T12:35:35.186683951Z Gathering data for ns/openshift-service-ca-operator...
2026-06-09T12:35:35.645620509Z Gathering data for ns/openshift-service-ca...
2026-06-09T12:35:36.088442573Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-09T12:35:37.155691652Z Wrote inspect data to must-gather.
2026-06-09T12:35:37.155740162Z error: inspection completed with the errors occurred while gathering data:
2026-06-09T12:35:37.155740162Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-09T12:35:37.278171058Z error: the server doesn't have a resource type "clusters"
2026-06-09T12:35:37.382462993Z Caches written to disk