2026-09-08T10:39:15.218321076Z [disk usage checker] Started 2026-09-08T10:39:15.221783211Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-08T10:39:15.431820065Z Gathering data for ns/openshift-cluster-version... 2026-09-08T10:39:15.576284151Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-08T10:39:15.665403814Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-08T10:39:15.748808606Z Gathering data for ns/default... 2026-09-08T10:39:16.041059938Z Gathering data for ns/openshift... 2026-09-08T10:39:16.474132265Z Gathering data for ns/kube-system... 2026-09-08T10:39:17.232008084Z Gathering data for ns/openshift-etcd... 2026-09-08T10:39:17.544818585Z Wrote inspect data to must-gather. 2026-09-08T10:39:17.544843669Z error: inspection completed with the errors occurred while gathering data: 2026-09-08T10:39:17.544843669Z namespaces "assisted-installer" not found 2026-09-08T10:39:17.782924889Z Waiting on subprocesses to finish execution. 2026-09-08T10:39:17.795652014Z Executing Istio gather script 2026-09-08T10:39:17.796639858Z INFO: Collecting host service logs for crio 2026-09-08T10:39:17.796938825Z INFO: Collecting host service logs for kubelet 2026-09-08T10:39:17.797305820Z INFO: Collecting host service logs for rpm-ostreed 2026-09-08T10:39:17.797610391Z INFO: Collecting host service logs for ostree-finalize-staged 2026-09-08T10:39:17.797932640Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-09-08T10:39:17.798219533Z INFO: Gathering machine config daemon's old logs from all nodes 2026-09-08T10:39:17.798219533Z INFO: Collecting host service logs for machine-config-daemon-host 2026-09-08T10:39:17.798514579Z INFO: Collecting host service logs for NetworkManager 2026-09-08T10:39:17.798931885Z INFO: Collecting host service logs for openvswitch 2026-09-08T10:39:17.799317358Z INFO: Collecting host service logs for ovs-configuration 2026-09-08T10:39:17.799628604Z INFO: Collecting host service logs for ovsdb-server 2026-09-08T10:39:17.800046045Z INFO: Collecting host service logs for ovs-vswitchd 2026-09-08T10:39:17.800412515Z INFO: Waiting for worker host service log collection to complete ... 2026-09-08T10:39:17.803477347Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-09-08T10:39:17.812255146Z INFO: Gathering HAProxy config files 2026-09-08T10:39:17.825941495Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-09-08T10:39:18.025656055Z INFO: Waiting for node performance related collection to complete ... 2026-09-08T10:39:18.441334405Z No resources found 2026-09-08T10:39:18.476924070Z INFO: Collecting Insights Archives from insights-operator-76bcd6ccf5-524nf 2026-09-08T10:39:18.477000805Z insights-runtime-extractor-c5frh 2026-09-08T10:39:18.477035783Z insights-runtime-extractor-frtg9 2026-09-08T10:39:18.477144627Z insights-runtime-extractor-vfxt5 2026-09-08T10:39:18.619836916Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-09-08T10:39:18.663187928Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-09-08T10:39:18.663304120Z INFO: on-disk MachineConfig config collection complete. 2026-09-08T10:39:18.819089849Z Wrote inspect data to must-gather. 2026-09-08T10:39:18.944913695Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-09-08T10:39:18.975660182Z error: the server doesn't have a resource type "performanceprofile" 2026-09-08T10:39:19.022745771Z INFO: "metallb-operator" not detected. Skipping. 2026-09-08T10:39:19.133468169Z ERROR: No running kube-apiserver pods found 2026-09-08T10:39:19.168577627Z INFO: Worker host service log collection to complete. 2026-09-08T10:39:19.249395430Z No resources found in openshift-etcd namespace. 2026-09-08T10:39:19.290295371Z INFO: Found 1 replicas - prometheus-k8s-0 2026-09-08T10:39:19.327994046Z INFO: "sriov-network-operator" not detected. Skipping. 2026-09-08T10:39:19.411933406Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-09-08T10:39:19.411933406Z See 'oc rsync -h' for help and examples 2026-09-08T10:39:19.564113449Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-09-08T10:39:19.640463220Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-08T10:39:19.646365423Z Wrote inspect data to must-gather. 2026-09-08T10:39:19.738841172Z INFO: 'previous-logs' folder not found on ip-10-0-131-17.ec2.internal, skipping... 2026-09-08T10:39:19.743507434Z INFO: Waiting for HAProxy config collection to complete ... 2026-09-08T10:39:19.796690324Z Wrote inspect data to must-gather. 2026-09-08T10:39:20.015960527Z No resources found 2026-09-08T10:39:20.017536695Z Wrote inspect data to must-gather. 2026-09-08T10:39:20.104716706Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-09-08T10:39:20.282013986Z error: the server doesn't have a resource type "machineconfigs" 2026-09-08T10:39:20.283506256Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-08T10:39:20.309051854Z Wrote inspect data to must-gather. 2026-09-08T10:39:20.314847776Z Wrote inspect data to must-gather. 2026-09-08T10:39:20.342686926Z Wrote inspect data to must-gather. 2026-09-08T10:39:20.348144593Z Gathering data for ns/openshift-monitoring... 2026-09-08T10:39:20.433028182Z tar: Removing leading `/' from member names 2026-09-08T10:39:20.440053587Z INFO: HAProxy config collection complete. 2026-09-08T10:39:20.466420936Z INFO: 'previous-logs' folder not found on ip-10-0-138-137.ec2.internal, skipping... 2026-09-08T10:39:20.507971807Z error: the server doesn't have a resource type "machineconfigpools" 2026-09-08T10:39:20.540477964Z Wrote inspect data to must-gather. 2026-09-08T10:39:20.731676344Z INFO: Getting rules from prometheus-k8s-0 2026-09-08T10:39:20.755709552Z INFO: 'previous-logs' folder not found on ip-10-0-138-206.ec2.internal, skipping... 2026-09-08T10:39:20.755822440Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-09-08T10:39:20.755854032Z INFO: Machine Config Daemon termination log collection complete. 2026-09-08T10:39:20.773256701Z Wrote inspect data to must-gather. 2026-09-08T10:39:20.817427871Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-09-08T10:39:20.843329494Z Wrote inspect data to must-gather. 2026-09-08T10:39:20.928987297Z error: the server doesn't have a resource type "kubeletconfigs" 2026-09-08T10:39:21.081547822Z Wrote inspect data to must-gather. 2026-09-08T10:39:21.139952492Z Wrote inspect data to must-gather. 2026-09-08T10:39:21.143384483Z INFO: Getting status/config from prometheus-k8s-0 2026-09-08T10:39:21.335083336Z Wrote inspect data to must-gather. 2026-09-08T10:39:21.359121484Z INFO: INTERCONNECT MODE 2026-09-08T10:39:21.359243329Z INFO: Gathering ovn-kubernetes DBs 2026-09-08T10:39:21.459908703Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-09-08T10:39:21.528568958Z Wrote inspect data to must-gather. 2026-09-08T10:39:21.534840115Z INFO: Gathering OVN_Northbound from ovnkube-node-2rmb7... 2026-09-08T10:39:21.535052528Z INFO: Gathering OVN_Northbound from ovnkube-node-k296b... 2026-09-08T10:39:21.535359138Z INFO: Gathering OVN_Northbound from ovnkube-node-l7zwl... 2026-09-08T10:39:21.535610757Z INFO: Gathering OVN_Southbound from ovnkube-node-2rmb7... 2026-09-08T10:39:21.536126821Z INFO: Gathering OVN_Southbound from ovnkube-node-k296b... 2026-09-08T10:39:21.536596339Z INFO: Gathering OVN_Southbound from ovnkube-node-l7zwl... 2026-09-08T10:39:21.555684274Z INFO: Getting status/flags from prometheus-k8s-0 2026-09-08T10:39:21.767681445Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:21.853817296Z tar: Removing leading `/' from member names 2026-09-08T10:39:21.857546312Z tar: Removing leading `/' from member names 2026-09-08T10:39:21.859073666Z tar: Removing leading `/' from member names 2026-09-08T10:39:21.862686468Z tar: Removing leading `/' from member names 2026-09-08T10:39:21.912208575Z tar: Removing leading `/' from member names 2026-09-08T10:39:21.928393704Z Wrote inspect data to must-gather. 2026-09-08T10:39:21.932925541Z tar: Removing leading `/' from member names 2026-09-08T10:39:21.951924825Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-09-08T10:39:22.049536462Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:22.052652915Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-09-08T10:39:22.063986080Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-08T10:39:22.163540181Z Wrote inspect data to must-gather. 2026-09-08T10:39:22.200995247Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-09-08T10:39:22.286896582Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:22.355476498Z INFO: Waiting for network log collection to complete ... 2026-09-08T10:39:22.355504889Z INFO: Waiting for ovnk database copies to complete ... 2026-09-08T10:39:22.355952332Z INFO: Copying ovnk databases complete. 2026-09-08T10:39:22.357638828Z 3.5M must-gather/network_logs/ovnk_database_store 2026-09-08T10:39:22.360022886Z ovnk_database_store/ 2026-09-08T10:39:22.360022886Z ovnk_database_store/ovnkube-node-k296b_nbdb 2026-09-08T10:39:22.369984779Z ovnk_database_store/ovnkube-node-l7zwl_nbdb 2026-09-08T10:39:22.376791489Z ovnk_database_store/ovnkube-node-l7zwl_sbdb 2026-09-08T10:39:22.389416820Z Wrote inspect data to must-gather. 2026-09-08T10:39:22.394457575Z ovnk_database_store/ovnkube-node-2rmb7_nbdb 2026-09-08T10:39:22.403540289Z ovnk_database_store/ovnkube-node-2rmb7_sbdb 2026-09-08T10:39:22.426165380Z ovnk_database_store/ovnkube-node-k296b_sbdb 2026-09-08T10:39:22.454840230Z INFO: Network log collection complete. 2026-09-08T10:39:22.461340775Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-09-08T10:39:22.513599388Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:22.516430249Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-09-08T10:39:22.606345205Z W0908 10:39:22.606298 1510 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-09-08T10:39:22.610862473Z Wrote inspect data to must-gather. 2026-09-08T10:39:22.683865787Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-08T10:39:22.715293780Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:22.847337643Z INFO: Getting status from alertmanager-main-0 2026-09-08T10:39:22.889453762Z Gathering data for ns/openshift-network-console... 2026-09-08T10:39:22.892222155Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-09-08T10:39:22.894866103Z INFO: Fallback to identify the container image from release info 2026-09-08T10:39:22.932572328Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:22.935408086Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-09-08T10:39:23.164137160Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:23.355063106Z Gathering data for ns/openshift-console-operator... 2026-09-08T10:39:23.357929462Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:23.360205741Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-09-08T10:39:23.532138977Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:23.573395989Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399 2026-09-08T10:39:23.714863025Z daemonset.apps/perf-node-gather-daemonset created 2026-09-08T10:39:23.729613792Z Wrote inspect data to /must-gather/istio. 2026-09-08T10:39:23.778011600Z Gathering data for ns/openshift-console... 2026-09-08T10:39:23.852263897Z Waiting for performance profile collector pods to become ready: 1 2026-09-08T10:39:24.437043977Z Done executing Istio gather script 2026-09-08T10:39:24.466257190Z Gathering data for ns/openshift-cluster-storage-operator... 2026-09-08T10:39:24.974855719Z Waiting for performance profile collector pods to become ready: 2 2026-09-08T10:39:25.004346384Z Gathering data for ns/openshift-dns-operator... 2026-09-08T10:39:25.294813576Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-08T10:39:25.391179604Z Gathering data for ns/openshift-dns... 2026-09-08T10:39:25.985411272Z Gathering data for ns/openshift-image-registry... 2026-09-08T10:39:26.076482420Z Waiting for performance profile collector pods to become ready: 3 2026-09-08T10:39:26.498589548Z Gathering data for ns/openshift-ingress-operator... 2026-09-08T10:39:26.842492610Z Gathering data for ns/openshift-ingress... 2026-09-08T10:39:27.201894143Z Waiting for performance profile collector pods to become ready: 4 2026-09-08T10:39:27.240080695Z Gathering data for ns/openshift-ingress-canary... 2026-09-08T10:39:27.661194652Z Gathering data for ns/openshift-insights... 2026-09-08T10:39:28.323707895Z Waiting for performance profile collector pods to become ready: 5 2026-09-08T10:39:29.448231821Z Waiting for performance profile collector pods to become ready: 6 2026-09-08T10:39:29.827459962Z Gathering data for ns/openshift-config... 2026-09-08T10:39:30.127501219Z Gathering data for ns/openshift-config-managed... 2026-09-08T10:39:30.299553922Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-08T10:39:30.529882826Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-09-08T10:39:30.570214613Z Waiting for performance profile collector pods to become ready: 7 2026-09-08T10:39:30.793377883Z Gathering data for ns/openshift-kube-apiserver... 2026-09-08T10:39:31.047268722Z Gathering data for ns/openshift-kube-controller-manager... 2026-09-08T10:39:31.357781384Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-09-08T10:39:31.631236689Z Gathering data for ns/openshift-kube-scheduler... 2026-09-08T10:39:31.701062518Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-09-08T10:39:31.901709634Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-09-08T10:39:31.949862785Z Collecting performance related data for node ip-10-0-138-137.ec2.internal 2026-09-08T10:39:31.958009348Z Collecting performance related data for node ip-10-0-131-17.ec2.internal 2026-09-08T10:39:31.968415131Z Collecting performance related data for node ip-10-0-138-206.ec2.internal 2026-09-08T10:39:32.222642129Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-09-08T10:39:32.604168928Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-09-08T10:39:32.973753585Z Gathering data for ns/openshift-user-workload-monitoring... 2026-09-08T10:39:33.609195600Z Gathering data for ns/openshift-multus... 2026-09-08T10:39:35.089753822Z Gathering data for ns/openshift-ovn-kubernetes... 2026-09-08T10:39:35.304322435Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-08T10:39:36.504541774Z Gathering data for ns/openshift-host-network... 2026-09-08T10:39:36.818697015Z Gathering data for ns/openshift-network-diagnostics... 2026-09-08T10:39:37.397704136Z Gathering data for ns/openshift-network-node-identity... 2026-09-08T10:39:37.830122172Z Gathering data for ns/openshift-network-operator... 2026-09-08T10:39:38.230669562Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-09-08T10:39:38.529357937Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-09-08T10:39:39.014406450Z Gathering data for ns/openshift-apiserver-operator... 2026-09-08T10:39:39.314242015Z Gathering data for ns/openshift-apiserver... 2026-09-08T10:39:39.684595640Z Gathering data for ns/openshift-controller-manager-operator... 2026-09-08T10:39:39.966922996Z Gathering data for ns/openshift-controller-manager... 2026-09-08T10:39:40.149066836Z Collecting kubelet logs for node ip-10-0-138-137.ec2.internal 2026-09-08T10:39:40.151138481Z Collecting kubelet logs for node ip-10-0-131-17.ec2.internal 2026-09-08T10:39:40.153050825Z Collecting kubelet logs for node ip-10-0-138-206.ec2.internal 2026-09-08T10:39:40.263720708Z Gathering data for ns/openshift-cluster-samples-operator... 2026-09-08T10:39:40.309288535Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-08T10:39:40.506259669Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-zssmc namespace 2026-09-08T10:39:40.510940608Z INFO: Node performance data collection complete. 2026-09-08T10:39:40.954519756Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-09-08T10:39:41.217225379Z Gathering data for ns/openshift-service-ca-operator... 2026-09-08T10:39:41.506763912Z Gathering data for ns/openshift-service-ca... 2026-09-08T10:39:41.837502178Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-09-08T10:39:42.679148996Z Wrote inspect data to must-gather. 2026-09-08T10:39:42.679365204Z error: inspection completed with the errors occurred while gathering data: 2026-09-08T10:39:42.679365204Z skipping gathering secrets/support due to error: secrets "support" not found 2026-09-08T10:39:42.797334725Z error: the server doesn't have a resource type "clusters" 2026-09-08T10:39:42.922013466Z Caches written to disk