2026-09-17T09:55:48.430793513Z [disk usage checker] Started 2026-09-17T09:55:48.434267654Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-17T09:55:48.624754643Z Gathering data for ns/openshift-cluster-version... 2026-09-17T09:55:48.772511540Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-17T09:55:48.870936302Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-17T09:55:48.952318752Z Gathering data for ns/default... 2026-09-17T09:55:49.258776939Z Gathering data for ns/openshift... 2026-09-17T09:55:49.702742336Z Gathering data for ns/kube-system... 2026-09-17T09:55:50.406525700Z Gathering data for ns/openshift-etcd... 2026-09-17T09:55:50.704838997Z Wrote inspect data to must-gather. 2026-09-17T09:55:50.704870533Z error: inspection completed with the errors occurred while gathering data: 2026-09-17T09:55:50.704870533Z namespaces "assisted-installer" not found 2026-09-17T09:55:50.925964134Z Waiting on subprocesses to finish execution. 2026-09-17T09:55:50.934886728Z INFO: Gathering machine config daemon's old logs from all nodes 2026-09-17T09:55:50.935483510Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-09-17T09:55:50.935907930Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-09-17T09:55:50.937168975Z INFO: Collecting host service logs for crio 2026-09-17T09:55:50.937503643Z INFO: Collecting host service logs for kubelet 2026-09-17T09:55:50.937865384Z INFO: Collecting host service logs for rpm-ostreed 2026-09-17T09:55:50.938203936Z INFO: Collecting host service logs for ostree-finalize-staged 2026-09-17T09:55:50.938533346Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-09-17T09:55:50.938868249Z INFO: Collecting host service logs for machine-config-daemon-host 2026-09-17T09:55:50.939277158Z INFO: Collecting host service logs for NetworkManager 2026-09-17T09:55:50.939702582Z INFO: Collecting host service logs for openvswitch 2026-09-17T09:55:50.940036139Z INFO: Collecting host service logs for ovs-configuration 2026-09-17T09:55:50.940361082Z INFO: Collecting host service logs for ovsdb-server 2026-09-17T09:55:50.940748414Z INFO: Collecting host service logs for ovs-vswitchd 2026-09-17T09:55:50.941128704Z INFO: Waiting for worker host service log collection to complete ... 2026-09-17T09:55:50.941682520Z INFO: Gathering HAProxy config files 2026-09-17T09:55:50.941862184Z Executing Istio gather script 2026-09-17T09:55:51.214163260Z INFO: Waiting for node performance related collection to complete ... 2026-09-17T09:55:51.224920400Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-09-17T09:55:51.587199715Z No resources found 2026-09-17T09:55:51.701971525Z Wrote inspect data to must-gather. 2026-09-17T09:55:52.296067969Z INFO: Found 1 replicas - prometheus-k8s-0 2026-09-17T09:55:52.325521477Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-09-17T09:55:52.431223818Z INFO: "metallb-operator" not detected. Skipping. 2026-09-17T09:55:52.477481656Z INFO: "sriov-network-operator" not detected. Skipping. 2026-09-17T09:55:52.616377646Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-09-17T09:55:52.616462713Z INFO: on-disk MachineConfig config collection complete. 2026-09-17T09:55:52.632319984Z ERROR: No running kube-apiserver pods found 2026-09-17T09:55:52.715918029Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-17T09:55:52.725340655Z Wrote inspect data to must-gather. 2026-09-17T09:55:52.773112033Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-09-17T09:55:52.913531685Z Wrote inspect data to must-gather. 2026-09-17T09:55:52.942071919Z error: the server doesn't have a resource type "performanceprofile" 2026-09-17T09:55:53.009197995Z No resources found in openshift-etcd namespace. 2026-09-17T09:55:53.050276753Z Wrote inspect data to must-gather. 2026-09-17T09:55:53.051766823Z INFO: Collecting Insights Archives from insights-operator-5844b856db-7lzhg 2026-09-17T09:55:53.051812148Z insights-runtime-extractor-9cbj5 2026-09-17T09:55:53.051831444Z insights-runtime-extractor-bkzw5 2026-09-17T09:55:53.051850698Z insights-runtime-extractor-zpjzh 2026-09-17T09:55:53.122972435Z No resources found 2026-09-17T09:55:53.148690403Z INFO: Worker host service log collection to complete. 2026-09-17T09:55:53.222775016Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-09-17T09:55:53.234044360Z Wrote inspect data to must-gather. 2026-09-17T09:55:53.273054227Z INFO: Waiting for HAProxy config collection to complete ... 2026-09-17T09:55:53.333429061Z Wrote inspect data to must-gather. 2026-09-17T09:55:53.333905209Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-09-17T09:55:53.333905209Z See 'oc rsync -h' for help and examples 2026-09-17T09:55:53.454345870Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-17T09:55:53.472521920Z Gathering data for ns/openshift-monitoring... 2026-09-17T09:55:53.495628364Z INFO: 'previous-logs' folder not found on ip-10-0-134-128.ec2.internal, skipping... 2026-09-17T09:55:53.526167033Z Wrote inspect data to must-gather. 2026-09-17T09:55:53.621986803Z tar: Removing leading `/' from member names 2026-09-17T09:55:53.628356938Z INFO: HAProxy config collection complete. 2026-09-17T09:55:53.685929137Z Wrote inspect data to must-gather. 2026-09-17T09:55:53.735707927Z error: the server doesn't have a resource type "machineconfigs" 2026-09-17T09:55:53.791806233Z INFO: Getting rules from prometheus-k8s-0 2026-09-17T09:55:53.824772050Z INFO: 'previous-logs' folder not found on ip-10-0-134-161.ec2.internal, skipping... 2026-09-17T09:55:53.928514936Z error: the server doesn't have a resource type "machineconfigpools" 2026-09-17T09:55:53.975449728Z Wrote inspect data to must-gather. 2026-09-17T09:55:54.051742944Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-09-17T09:55:54.089475013Z INFO: 'previous-logs' folder not found on ip-10-0-134-196.ec2.internal, skipping... 2026-09-17T09:55:54.089507297Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-09-17T09:55:54.089537606Z INFO: Machine Config Daemon termination log collection complete. 2026-09-17T09:55:54.172307640Z Wrote inspect data to must-gather. 2026-09-17T09:55:54.240524544Z INFO: Getting status/config from prometheus-k8s-0 2026-09-17T09:55:54.243672187Z Wrote inspect data to must-gather. 2026-09-17T09:55:54.324171987Z error: the server doesn't have a resource type "kubeletconfigs" 2026-09-17T09:55:54.517345120Z Wrote inspect data to must-gather. 2026-09-17T09:55:54.527862948Z INFO: INTERCONNECT MODE 2026-09-17T09:55:54.527943701Z INFO: Gathering ovn-kubernetes DBs 2026-09-17T09:55:54.645662616Z INFO: Getting status/flags from prometheus-k8s-0 2026-09-17T09:55:54.692084167Z INFO: Gathering OVN_Northbound from ovnkube-node-bkgnp... 2026-09-17T09:55:54.692345489Z INFO: Gathering OVN_Northbound from ovnkube-node-cxm9r... 2026-09-17T09:55:54.692614804Z INFO: Gathering OVN_Northbound from ovnkube-node-qx7b4... 2026-09-17T09:55:54.692904661Z INFO: Gathering OVN_Southbound from ovnkube-node-bkgnp... 2026-09-17T09:55:54.693204431Z INFO: Gathering OVN_Southbound from ovnkube-node-cxm9r... 2026-09-17T09:55:54.693481961Z INFO: Gathering OVN_Southbound from ovnkube-node-qx7b4... 2026-09-17T09:55:54.787051638Z Wrote inspect data to must-gather. 2026-09-17T09:55:54.925557283Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-09-17T09:55:54.979681455Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-09-17T09:55:55.008107172Z tar: Removing leading `/' from member names 2026-09-17T09:55:55.032736449Z tar: Removing leading `/' from member names 2026-09-17T09:55:55.052748414Z tar: Removing leading `/' from member names 2026-09-17T09:55:55.065956408Z tar: Removing leading `/' from member names 2026-09-17T09:55:55.069254429Z tar: Removing leading `/' from member names 2026-09-17T09:55:55.078704169Z tar: Removing leading `/' from member names 2026-09-17T09:55:55.155957306Z Wrote inspect data to must-gather. 2026-09-17T09:55:55.173609353Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:55.189978394Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-17T09:55:55.267606586Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-09-17T09:55:55.392151663Z Wrote inspect data to must-gather. 2026-09-17T09:55:55.412040344Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:55.414852555Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-09-17T09:55:55.561298450Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-09-17T09:55:55.578881037Z INFO: Waiting for network log collection to complete ... 2026-09-17T09:55:55.578993400Z INFO: Waiting for ovnk database copies to complete ... 2026-09-17T09:55:55.579497777Z INFO: Copying ovnk databases complete. 2026-09-17T09:55:55.581515782Z 2.8M must-gather/network_logs/ovnk_database_store 2026-09-17T09:55:55.584401506Z ovnk_database_store/ 2026-09-17T09:55:55.584446982Z ovnk_database_store/ovnkube-node-bkgnp_nbdb 2026-09-17T09:55:55.593169244Z ovnk_database_store/ovnkube-node-bkgnp_sbdb 2026-09-17T09:55:55.613685697Z ovnk_database_store/ovnkube-node-qx7b4_sbdb 2026-09-17T09:55:55.617261360Z Wrote inspect data to must-gather. 2026-09-17T09:55:55.629656088Z ovnk_database_store/ovnkube-node-cxm9r_sbdb 2026-09-17T09:55:55.631681739Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:55.647160548Z ovnk_database_store/ovnkube-node-qx7b4_nbdb 2026-09-17T09:55:55.652958336Z ovnk_database_store/ovnkube-node-cxm9r_nbdb 2026-09-17T09:55:55.662053291Z INFO: Network log collection complete. 2026-09-17T09:55:55.817677789Z W0917 09:55:55.817635 1534 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-09-17T09:55:55.825196711Z Wrote inspect data to must-gather. 2026-09-17T09:55:55.851434650Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:55.854203729Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-09-17T09:55:55.890996137Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-17T09:55:55.964405131Z INFO: Getting status from alertmanager-main-0 2026-09-17T09:55:56.083150182Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:56.097788537Z Gathering data for ns/openshift-network-console... 2026-09-17T09:55:56.127432271Z Wrote inspect data to must-gather. 2026-09-17T09:55:56.280985385Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:56.283249062Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-09-17T09:55:56.385731962Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-09-17T09:55:56.387934845Z INFO: Fallback to identify the container image from release info 2026-09-17T09:55:56.510182416Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:56.573442037Z Gathering data for ns/openshift-console-operator... 2026-09-17T09:55:56.695541122Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:56.697498474Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-09-17T09:55:56.839060246Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:56.966350478Z Gathering data for ns/openshift-console... 2026-09-17T09:55:56.969131094Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a 2026-09-17T09:55:57.050792899Z Wrote inspect data to /must-gather/istio. 2026-09-17T09:55:57.101880570Z daemonset.apps/perf-node-gather-daemonset created 2026-09-17T09:55:57.217308005Z Waiting for performance profile collector pods to become ready: 1 2026-09-17T09:55:57.521477298Z Gathering data for ns/openshift-cluster-storage-operator... 2026-09-17T09:55:57.715183946Z Done executing Istio gather script 2026-09-17T09:55:58.031903791Z Gathering data for ns/openshift-dns-operator... 2026-09-17T09:55:58.330315610Z Gathering data for ns/openshift-dns... 2026-09-17T09:55:58.340513790Z Waiting for performance profile collector pods to become ready: 2 2026-09-17T09:55:58.459273927Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-17T09:55:59.071329409Z Gathering data for ns/openshift-image-registry... 2026-09-17T09:55:59.450396136Z Waiting for performance profile collector pods to become ready: 3 2026-09-17T09:55:59.568690296Z Gathering data for ns/openshift-ingress-operator... 2026-09-17T09:55:59.886311819Z Gathering data for ns/openshift-ingress... 2026-09-17T09:56:00.229963491Z Gathering data for ns/openshift-ingress-canary... 2026-09-17T09:56:00.569110957Z Waiting for performance profile collector pods to become ready: 4 2026-09-17T09:56:00.659678854Z Gathering data for ns/openshift-insights... 2026-09-17T09:56:01.672120647Z Waiting for performance profile collector pods to become ready: 5 2026-09-17T09:56:02.545676949Z Gathering data for ns/openshift-jobset-operator... 2026-09-17T09:56:02.767255805Z Waiting for performance profile collector pods to become ready: 6 2026-09-17T09:56:03.356286094Z Gathering data for ns/openshift-config... 2026-09-17T09:56:03.463657840Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-17T09:56:03.626269278Z Gathering data for ns/openshift-config-managed... 2026-09-17T09:56:03.883554704Z Waiting for performance profile collector pods to become ready: 7 2026-09-17T09:56:04.064222665Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-09-17T09:56:04.326292628Z Gathering data for ns/openshift-kube-apiserver... 2026-09-17T09:56:04.631958247Z Gathering data for ns/openshift-kube-controller-manager... 2026-09-17T09:56:04.962077802Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-09-17T09:56:05.005172931Z Waiting for performance profile collector pods to become ready: 8 2026-09-17T09:56:05.263914464Z Gathering data for ns/openshift-kube-scheduler... 2026-09-17T09:56:05.530630802Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-09-17T09:56:05.818510212Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-09-17T09:56:06.128628997Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-09-17T09:56:06.162531895Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-09-17T09:56:06.394612848Z Collecting performance related data for node ip-10-0-134-196.ec2.internal 2026-09-17T09:56:06.400590131Z Collecting performance related data for node ip-10-0-134-161.ec2.internal 2026-09-17T09:56:06.407976380Z Collecting performance related data for node ip-10-0-134-128.ec2.internal 2026-09-17T09:56:06.542406371Z Gathering data for ns/openshift-user-workload-monitoring... 2026-09-17T09:56:07.140968834Z Gathering data for ns/openshift-multus... 2026-09-17T09:56:08.468157197Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-17T09:56:09.115920209Z Gathering data for ns/openshift-ovn-kubernetes... 2026-09-17T09:56:10.424491357Z Gathering data for ns/openshift-host-network... 2026-09-17T09:56:10.752097558Z Gathering data for ns/openshift-network-diagnostics... 2026-09-17T09:56:11.303618103Z Gathering data for ns/openshift-network-node-identity... 2026-09-17T09:56:11.810760392Z Gathering data for ns/openshift-network-operator... 2026-09-17T09:56:12.220606337Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-09-17T09:56:12.539743436Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-09-17T09:56:13.209362625Z Gathering data for ns/openshift-apiserver-operator... 2026-09-17T09:56:13.473495842Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-09-17T09:56:13.618800508Z Gathering data for ns/openshift-apiserver... 2026-09-17T09:56:14.051447645Z Collecting kubelet logs for node ip-10-0-134-196.ec2.internal 2026-09-17T09:56:14.053232759Z Collecting kubelet logs for node ip-10-0-134-161.ec2.internal 2026-09-17T09:56:14.054999257Z Collecting kubelet logs for node ip-10-0-134-128.ec2.internal 2026-09-17T09:56:14.254663873Z Gathering data for ns/openshift-controller-manager-operator... 2026-09-17T09:56:14.391528863Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-vgpsj namespace 2026-09-17T09:56:14.396444890Z INFO: Node performance data collection complete. 2026-09-17T09:56:14.590629628Z Gathering data for ns/openshift-controller-manager... 2026-09-17T09:56:14.915959516Z Gathering data for ns/openshift-cluster-samples-operator... 2026-09-17T09:56:15.563726422Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-09-17T09:56:15.862496636Z Gathering data for ns/openshift-service-ca-operator... 2026-09-17T09:56:16.182296119Z Gathering data for ns/openshift-service-ca... 2026-09-17T09:56:16.573485029Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-09-17T09:56:17.469896380Z Wrote inspect data to must-gather. 2026-09-17T09:56:17.469936247Z error: inspection completed with the errors occurred while gathering data: 2026-09-17T09:56:17.469936247Z skipping gathering secrets/support due to error: secrets "support" not found 2026-09-17T09:56:17.584979004Z error: the server doesn't have a resource type "clusters" 2026-09-17T09:56:17.717252391Z Caches written to disk