2026-06-12T00:11:22.170953926Z [disk usage checker] Started
2026-06-12T00:11:22.174242497Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T00:11:22.369930502Z Gathering data for ns/openshift-cluster-version...
2026-06-12T00:11:22.512261368Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-12T00:11:22.590876285Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-12T00:11:22.672383017Z Gathering data for ns/default...
2026-06-12T00:11:22.945279582Z Gathering data for ns/openshift...
2026-06-12T00:11:23.365445844Z Gathering data for ns/kube-system...
2026-06-12T00:11:24.084813891Z Gathering data for ns/openshift-etcd...
2026-06-12T00:11:24.421416474Z Wrote inspect data to must-gather.
2026-06-12T00:11:24.421449798Z error: inspection completed with the errors occurred while gathering data:
2026-06-12T00:11:24.421449798Z     namespaces "assisted-installer" not found
2026-06-12T00:11:24.701449938Z Waiting on subprocesses to finish execution.
2026-06-12T00:11:24.713008177Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-12T00:11:24.713519480Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-12T00:11:24.716560479Z INFO: Gathering HAProxy config files
2026-06-12T00:11:24.723598953Z Executing Istio gather script
2026-06-12T00:11:24.730816328Z INFO: Collecting host service logs for crio
2026-06-12T00:11:24.731197683Z INFO: Collecting host service logs for kubelet
2026-06-12T00:11:24.731585473Z INFO: Collecting host service logs for rpm-ostreed
2026-06-12T00:11:24.731970954Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-12T00:11:24.732344971Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-12T00:11:24.732722898Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-12T00:11:24.733096204Z INFO: Collecting host service logs for NetworkManager
2026-06-12T00:11:24.733537771Z INFO: Collecting host service logs for openvswitch
2026-06-12T00:11:24.733972948Z INFO: Collecting host service logs for ovs-configuration
2026-06-12T00:11:24.734334730Z INFO: Collecting host service logs for ovsdb-server
2026-06-12T00:11:24.734765020Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-12T00:11:24.735177436Z INFO: Waiting for worker host service log collection to complete ...
2026-06-12T00:11:24.740163673Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-12T00:11:24.998035268Z INFO: Waiting for node performance related collection to complete ...
2026-06-12T00:11:25.316143209Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-12T00:11:25.398024551Z No resources found
2026-06-12T00:11:25.479898762Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-12T00:11:25.585806181Z INFO: "metallb-operator" not detected. Skipping.
2026-06-12T00:11:25.655139533Z No resources found in openshift-etcd namespace.
2026-06-12T00:11:25.926911894Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-12T00:11:26.039346245Z error: the server doesn't have a resource type "performanceprofile"
2026-06-12T00:11:26.042497346Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-12T00:11:26.099929688Z INFO: Collecting Insights Archives from insights-operator-5bbd86d6bd-f44zw
2026-06-12T00:11:26.100012978Z insights-runtime-extractor-4r6js
2026-06-12T00:11:26.100045542Z insights-runtime-extractor-djwv4
2026-06-12T00:11:26.100064015Z insights-runtime-extractor-vc4kq
2026-06-12T00:11:26.174959669Z INFO: Worker host service log collection to complete.
2026-06-12T00:11:26.234230573Z Wrote inspect data to must-gather.
2026-06-12T00:11:26.240761335Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-12T00:11:26.240799074Z INFO: on-disk MachineConfig config collection complete.
2026-06-12T00:11:26.350523629Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-12T00:11:26.438241754Z Wrote inspect data to must-gather.
2026-06-12T00:11:26.645228499Z No resources found
2026-06-12T00:11:26.933071144Z Wrote inspect data to must-gather.
2026-06-12T00:11:26.940797786Z Wrote inspect data to must-gather.
2026-06-12T00:11:26.944397341Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-12T00:11:26.944397341Z See 'oc rsync -h' for help and examples
2026-06-12T00:11:26.954885794Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-12T00:11:27.023085685Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-12T00:11:27.075091922Z Wrote inspect data to must-gather.
2026-06-12T00:11:27.100905655Z ERROR: No running kube-apiserver pods found
2026-06-12T00:11:27.105660196Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-12T00:11:27.143199206Z Wrote inspect data to must-gather.
2026-06-12T00:11:27.187876413Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T00:11:27.235029955Z Wrote inspect data to must-gather.
2026-06-12T00:11:27.320884223Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-12T00:11:27.350098248Z INFO: 'previous-logs' folder not found on ip-10-0-134-3.ec2.internal, skipping...
2026-06-12T00:11:27.364542489Z tar: Removing leading `/' from member names
2026-06-12T00:11:27.364812817Z Wrote inspect data to must-gather.
2026-06-12T00:11:27.367079649Z error: the server doesn't have a resource type "machineconfigs"
2026-06-12T00:11:27.369021964Z INFO: HAProxy config collection complete.
2026-06-12T00:11:27.518979484Z Gathering data for ns/openshift-monitoring...
2026-06-12T00:11:27.556998906Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-12T00:11:27.600334070Z INFO: Getting rules from prometheus-k8s-0
2026-06-12T00:11:27.632854363Z INFO: 'previous-logs' folder not found on ip-10-0-135-200.ec2.internal, skipping...
2026-06-12T00:11:27.642891782Z Wrote inspect data to must-gather.
2026-06-12T00:11:27.807320490Z Wrote inspect data to must-gather.
2026-06-12T00:11:27.911891954Z INFO: 'previous-logs' folder not found on ip-10-0-138-177.ec2.internal, skipping...
2026-06-12T00:11:27.911991199Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-12T00:11:27.912019619Z INFO: Machine Config Daemon termination log collection complete.
2026-06-12T00:11:27.941543118Z Wrote inspect data to must-gather.
2026-06-12T00:11:28.019782407Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-12T00:11:28.046054665Z INFO: Getting status/config from prometheus-k8s-0
2026-06-12T00:11:28.227062010Z INFO: INTERCONNECT MODE
2026-06-12T00:11:28.227094189Z INFO: Gathering ovn-kubernetes DBs
2026-06-12T00:11:28.236805204Z Wrote inspect data to must-gather.
2026-06-12T00:11:28.380042185Z INFO: Gathering OVN_Northbound from ovnkube-node-dtk6w...
2026-06-12T00:11:28.380325824Z INFO: Gathering OVN_Northbound from ovnkube-node-gsz67...
2026-06-12T00:11:28.380576525Z INFO: Gathering OVN_Northbound from ovnkube-node-sd8nc...
2026-06-12T00:11:28.380884339Z INFO: Gathering OVN_Southbound from ovnkube-node-dtk6w...
2026-06-12T00:11:28.381194885Z INFO: Gathering OVN_Southbound from ovnkube-node-gsz67...
2026-06-12T00:11:28.381494252Z INFO: Gathering OVN_Southbound from ovnkube-node-sd8nc...
2026-06-12T00:11:28.450639749Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-12T00:11:28.498030194Z Wrote inspect data to must-gather.
2026-06-12T00:11:28.507598631Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-12T00:11:28.652876698Z tar: Removing leading `/' from member names
2026-06-12T00:11:28.698642511Z tar: Removing leading `/' from member names
2026-06-12T00:11:28.729387974Z tar: Removing leading `/' from member names
2026-06-12T00:11:28.735839439Z tar: Removing leading `/' from member names
2026-06-12T00:11:28.746737234Z tar: Removing leading `/' from member names
2026-06-12T00:11:28.750292347Z tar: Removing leading `/' from member names
2026-06-12T00:11:28.778229904Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:28.805956978Z Wrote inspect data to must-gather.
2026-06-12T00:11:28.829360835Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-12T00:11:29.037936946Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:29.041483383Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-12T00:11:29.074160916Z Wrote inspect data to must-gather.
2026-06-12T00:11:29.093538157Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-12T00:11:29.125469377Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-12T00:11:29.200827983Z INFO: Waiting for network log collection to complete ...
2026-06-12T00:11:29.200876393Z INFO: Waiting for ovnk database copies to complete ...
2026-06-12T00:11:29.201357567Z INFO: Copying ovnk databases complete.
2026-06-12T00:11:29.203073949Z 3.7M	must-gather/network_logs/ovnk_database_store
2026-06-12T00:11:29.206120076Z ovnk_database_store/
2026-06-12T00:11:29.206145302Z ovnk_database_store/ovnkube-node-dtk6w_sbdb
2026-06-12T00:11:29.239496731Z ovnk_database_store/ovnkube-node-dtk6w_nbdb
2026-06-12T00:11:29.249118917Z ovnk_database_store/ovnkube-node-gsz67_sbdb
2026-06-12T00:11:29.267256942Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:29.269781922Z ovnk_database_store/ovnkube-node-sd8nc_nbdb
2026-06-12T00:11:29.278366374Z ovnk_database_store/ovnkube-node-gsz67_nbdb
2026-06-12T00:11:29.286406498Z ovnk_database_store/ovnkube-node-sd8nc_sbdb
2026-06-12T00:11:29.303554629Z Wrote inspect data to must-gather.
2026-06-12T00:11:29.307587000Z INFO: Network log collection complete.
2026-06-12T00:11:29.371266165Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-12T00:11:29.488500320Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:29.491391575Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-12T00:11:29.512150502Z Wrote inspect data to must-gather.
2026-06-12T00:11:29.695407135Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:29.735046617Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-12T00:11:29.752409000Z INFO: Getting status from alertmanager-main-0
2026-06-12T00:11:29.814718039Z Wrote inspect data to must-gather.
2026-06-12T00:11:29.911412185Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:29.914393528Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-12T00:11:29.928150211Z Gathering data for ns/openshift-network-console...
2026-06-12T00:11:30.093592256Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-12T00:11:30.095651417Z INFO: Fallback to identify the container image from release info
2026-06-12T00:11:30.137594133Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:30.342704181Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:30.346109251Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-12T00:11:30.369439866Z Gathering data for ns/openshift-console-operator...
2026-06-12T00:11:30.501447890Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:30.673483346Z Wrote inspect data to /must-gather/istio.
2026-06-12T00:11:30.740995420Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d66a6b2ec52dede5d83ce04f6abfc519df1fd7dc36248741e03ecb9bf8d1762
2026-06-12T00:11:30.787736925Z Gathering data for ns/openshift-console...
2026-06-12T00:11:30.884655213Z daemonset.apps/perf-node-gather-daemonset created
2026-06-12T00:11:31.017985857Z Waiting for performance profile collector pods to become ready: 1
2026-06-12T00:11:31.337566947Z Done executing Istio gather script
2026-06-12T00:11:31.457697186Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-12T00:11:31.924288698Z Gathering data for ns/openshift-dns-operator...
2026-06-12T00:11:32.141846959Z Waiting for performance profile collector pods to become ready: 2
2026-06-12T00:11:32.192801798Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T00:11:32.192801798Z Gathering data for ns/openshift-dns...
2026-06-12T00:11:32.825105493Z Gathering data for ns/openshift-image-registry...
2026-06-12T00:11:33.256013442Z Waiting for performance profile collector pods to become ready: 3
2026-06-12T00:11:33.334757867Z Gathering data for ns/openshift-ingress-operator...
2026-06-12T00:11:33.650640952Z Gathering data for ns/openshift-ingress...
2026-06-12T00:11:33.971376235Z Gathering data for ns/openshift-ingress-canary...
2026-06-12T00:11:34.354509312Z Gathering data for ns/openshift-insights...
2026-06-12T00:11:34.379049860Z Waiting for performance profile collector pods to become ready: 4
2026-06-12T00:11:35.481872985Z Waiting for performance profile collector pods to become ready: 5
2026-06-12T00:11:36.302383361Z Gathering data for ns/openshift-config...
2026-06-12T00:11:36.558625043Z Gathering data for ns/openshift-config-managed...
2026-06-12T00:11:36.608951355Z Waiting for performance profile collector pods to become ready: 6
2026-06-12T00:11:36.957753005Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-12T00:11:37.195704873Z Gathering data for ns/openshift-kube-apiserver...
2026-06-12T00:11:37.197470386Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T00:11:37.447742758Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-12T00:11:37.719035191Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-12T00:11:37.735254553Z Waiting for performance profile collector pods to become ready: 7
2026-06-12T00:11:37.976056631Z Gathering data for ns/openshift-kube-scheduler...
2026-06-12T00:11:38.260001387Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-12T00:11:38.534486519Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-12T00:11:38.845132826Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-12T00:11:38.852617592Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-12T00:11:39.105806542Z Collecting performance related data for node ip-10-0-134-3.ec2.internal
2026-06-12T00:11:39.113012205Z Collecting performance related data for node ip-10-0-135-200.ec2.internal
2026-06-12T00:11:39.121971337Z Collecting performance related data for node ip-10-0-138-177.ec2.internal
2026-06-12T00:11:39.165129434Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-12T00:11:39.732926925Z Gathering data for ns/openshift-multus...
2026-06-12T00:11:41.296162680Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-12T00:11:42.201910432Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T00:11:42.592881932Z Gathering data for ns/openshift-host-network...
2026-06-12T00:11:42.879659059Z Gathering data for ns/openshift-network-diagnostics...
2026-06-12T00:11:43.401774825Z Gathering data for ns/openshift-network-node-identity...
2026-06-12T00:11:43.790418825Z Gathering data for ns/openshift-network-operator...
2026-06-12T00:11:44.171363503Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-12T00:11:44.424943520Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-12T00:11:44.894183006Z Gathering data for ns/openshift-apiserver-operator...
2026-06-12T00:11:45.220713703Z Gathering data for ns/openshift-apiserver...
2026-06-12T00:11:45.720881036Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-12T00:11:46.015610321Z Gathering data for ns/openshift-controller-manager...
2026-06-12T00:11:46.322485279Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-12T00:11:46.979790716Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-12T00:11:47.207196996Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T00:11:47.232919670Z Collecting kubelet logs for node ip-10-0-134-3.ec2.internal
2026-06-12T00:11:47.234809999Z Collecting kubelet logs for node ip-10-0-135-200.ec2.internal
2026-06-12T00:11:47.237201716Z Collecting kubelet logs for node ip-10-0-138-177.ec2.internal
2026-06-12T00:11:47.308287394Z Gathering data for ns/openshift-service-ca-operator...
2026-06-12T00:11:47.588103161Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-tvjkn namespace
2026-06-12T00:11:47.593500062Z INFO: Node performance data collection complete.
2026-06-12T00:11:47.655730018Z Gathering data for ns/openshift-service-ca...
2026-06-12T00:11:48.005322652Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-12T00:11:48.868580504Z Wrote inspect data to must-gather.
2026-06-12T00:11:48.868625921Z error: inspection completed with the errors occurred while gathering data:
2026-06-12T00:11:48.868625921Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-12T00:11:48.989436038Z error: the server doesn't have a resource type "clusters"
2026-06-12T00:11:49.117927682Z Caches written to disk