2026-10-30T20:31:00.915328187Z [disk usage checker] Started 2026-10-30T20:31:00.918473866Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:01.717187218Z Gathering data for ns/openshift-cluster-version... 2026-10-30T20:31:02.590575506Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-30T20:31:03.125616624Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-30T20:31:03.668692352Z Gathering data for ns/default... 2026-10-30T20:31:05.509161001Z Gathering data for ns/openshift... 2026-10-30T20:31:05.922811553Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:07.402738647Z Gathering data for ns/kube-system... 2026-10-30T20:31:10.927157507Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:15.074617984Z Gathering data for ns/openshift-etcd... 2026-10-30T20:31:15.931431516Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:16.907962336Z Wrote inspect data to must-gather. 2026-10-30T20:31:16.908021237Z error: inspection completed with the errors occurred while gathering data: 2026-10-30T20:31:16.908021237Z namespaces "assisted-installer" not found 2026-10-30T20:31:20.935614819Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:25.939911423Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:30.944317688Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:35.949053838Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:36.689724486Z Waiting on subprocesses to finish execution. 2026-10-30T20:31:36.696969671Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-10-30T20:31:36.705025505Z INFO: Gathering machine config daemon's old logs from all nodes 2026-10-30T20:31:36.709703862Z Executing Istio gather script 2026-10-30T20:31:36.710412745Z INFO: Gathering HAProxy config files 2026-10-30T20:31:36.710823265Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-10-30T20:31:36.749797661Z INFO: Waiting for node performance related collection to complete ... 2026-10-30T20:31:36.848172026Z INFO: Collecting host service logs for crio 2026-10-30T20:31:36.848629324Z INFO: Collecting host service logs for kubelet 2026-10-30T20:31:36.849020250Z INFO: Collecting host service logs for rpm-ostreed 2026-10-30T20:31:36.849387241Z INFO: Collecting host service logs for ostree-finalize-staged 2026-10-30T20:31:36.849734515Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-10-30T20:31:36.850124241Z INFO: Collecting host service logs for machine-config-daemon-host 2026-10-30T20:31:36.850642378Z INFO: Collecting host service logs for NetworkManager 2026-10-30T20:31:36.851033645Z INFO: Collecting host service logs for openvswitch 2026-10-30T20:31:36.851439240Z INFO: Collecting host service logs for ovs-configuration 2026-10-30T20:31:36.851819922Z INFO: Collecting host service logs for ovsdb-server 2026-10-30T20:31:36.852220213Z INFO: Collecting host service logs for ovs-vswitchd 2026-10-30T20:31:36.852765197Z INFO: Waiting for worker host service log collection to complete ... 2026-10-30T20:31:37.312859220Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-10-30T20:31:37.490888525Z error: the server doesn't have a resource type "performanceprofile" 2026-10-30T20:31:37.760629498Z INFO: Found 1 replicas - prometheus-k8s-0 2026-10-30T20:31:37.825189171Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-10-30T20:31:37.940432354Z INFO: "nfd" not detected. Skipping. 2026-10-30T20:31:38.022544277Z INFO: "metallb-operator" not detected. Skipping. 2026-10-30T20:31:38.063054176Z No resources found 2026-10-30T20:31:38.104531101Z No resources found in openshift-etcd namespace. 2026-10-30T20:31:38.605004130Z INFO: "sriov-network-operator" not detected. Skipping. 2026-10-30T20:31:38.756693841Z INFO: Waiting for HAProxy config collection to complete ... 2026-10-30T20:31:38.897946169Z Wrote inspect data to must-gather. 2026-10-30T20:31:39.099642817Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-10-30T20:31:39.140426111Z No resources found 2026-10-30T20:31:39.263175690Z Wrote inspect data to must-gather. 2026-10-30T20:31:39.335877800Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-10-30T20:31:39.370146745Z ERROR: No running kube-apiserver pods found 2026-10-30T20:31:39.383888679Z Wrote inspect data to must-gather. 2026-10-30T20:31:39.455508719Z Wrote inspect data to must-gather. 2026-10-30T20:31:39.513345447Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-30T20:31:39.543645092Z Wrote inspect data to must-gather. 2026-10-30T20:31:39.638521756Z Wrote inspect data to must-gather. 2026-10-30T20:31:39.751705127Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istio-reader-clusterrole-openshift-gateway-openshift-ingress 2026-10-30T20:31:39.852040752Z error: the server doesn't have a resource type "machineconfigs" 2026-10-30T20:31:40.034885363Z Wrote inspect data to must-gather. 2026-10-30T20:31:40.051385806Z Wrote inspect data to must-gather. 2026-10-30T20:31:40.201776268Z tar: Removing leading `/' from member names 2026-10-30T20:31:40.229172389Z error: the server doesn't have a resource type "machineconfigpools" 2026-10-30T20:31:40.304550825Z INFO: HAProxy config collection complete. 2026-10-30T20:31:40.595792530Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-10-30T20:31:40.646148449Z INFO: Getting rules from prometheus-k8s-0 2026-10-30T20:31:40.680494049Z Wrote inspect data to must-gather. 2026-10-30T20:31:40.741700620Z Wrote inspect data to must-gather. 2026-10-30T20:31:40.954630360Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:41.073365061Z error: the server doesn't have a resource type "kubeletconfigs" 2026-10-30T20:31:41.284498237Z Wrote inspect data to must-gather. 2026-10-30T20:31:41.517304373Z Wrote inspect data to must-gather. 2026-10-30T20:31:41.950870649Z INFO: LEGACY MODE 2026-10-30T20:31:41.950909444Z INFO: Gathering ovn-kubernetes master data 2026-10-30T20:31:41.956075554Z Wrote inspect data to must-gather. 2026-10-30T20:31:42.139719277Z INFO: Getting status/config from prometheus-k8s-0 2026-10-30T20:31:42.436528858Z Wrote inspect data to must-gather. 2026-10-30T20:31:42.948818159Z Wrote inspect data to must-gather. 2026-10-30T20:31:43.461617958Z Wrote inspect data to must-gather. 2026-10-30T20:31:43.531237265Z INFO: Getting status/flags from prometheus-k8s-0 2026-10-30T20:31:43.715540550Z INFO: Waiting for network log collection to complete ... 2026-10-30T20:31:43.715582165Z INFO: Waiting for ovnk database copies to complete ... 2026-10-30T20:31:43.945128756Z Wrote inspect data to must-gather. 2026-10-30T20:31:44.368661288Z Wrote inspect data to must-gather. 2026-10-30T20:31:45.039185009Z INFO: Hosted cluster detected, get NTO container image from the TuneD pod 2026-10-30T20:31:45.388584316Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c 2026-10-30T20:31:45.733019209Z daemonset.apps/perf-node-gather-daemonset created 2026-10-30T20:31:45.959151612Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:45.988282586Z Waiting for performance profile collector pods to become ready: 1 2026-10-30T20:31:47.238396346Z Waiting for performance profile collector pods to become ready: 2 2026-10-30T20:31:47.268610542Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:31:47.270802941Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-10-30T20:31:47.270842570Z INFO: Machine Config Daemon termination log collection complete. 2026-10-30T20:31:47.522786277Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:31:47.524949507Z INFO: Collecting Insights Archives from 2026-10-30T20:31:47.614191254Z error: resource name may not be empty 2026-10-30T20:31:47.854540030Z E1030 20:31:47.854502 406 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://172.31.0.1:443/api?timeout=32s\": net/http: TLS handshake timeout" 2026-10-30T20:31:47.952566714Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:31:47.955146566Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-10-30T20:31:47.955187070Z INFO: on-disk MachineConfig config collection complete. 2026-10-30T20:31:48.330257344Z error: Get "https://172.31.0.1:443/api/v1/nodes?labelSelector=node-role.kubernetes.io%2Fmaster": net/http: TLS handshake timeout 2026-10-30T20:31:48.333423602Z INFO: Worker host service log collection to complete. 2026-10-30T20:31:48.491016656Z Waiting for performance profile collector pods to become ready: 3 2026-10-30T20:31:48.603529418Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:31:48.886357575Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:31:49.015315035Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:31:49.095439772Z INFO: Copying ovnk databases complete. 2026-10-30T20:31:49.097139189Z du: cannot access 'must-gather/network_logs/ovnk_database_store': No such file or directory 2026-10-30T20:31:49.097687631Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 771 is not a child of this shell 2026-10-30T20:31:49.097687631Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 772 is not a child of this shell 2026-10-30T20:31:49.097687631Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 773 is not a child of this shell 2026-10-30T20:31:49.097687631Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 774 is not a child of this shell 2026-10-30T20:31:49.097687631Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 775 is not a child of this shell 2026-10-30T20:31:49.097687631Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 776 is not a child of this shell 2026-10-30T20:31:49.097725290Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 777 is not a child of this shell 2026-10-30T20:31:49.097725290Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 778 is not a child of this shell 2026-10-30T20:31:49.097725290Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 793 is not a child of this shell 2026-10-30T20:31:49.097725290Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 794 is not a child of this shell 2026-10-30T20:31:49.097725290Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 795 is not a child of this shell 2026-10-30T20:31:49.097725290Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 796 is not a child of this shell 2026-10-30T20:31:49.097725290Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 798 is not a child of this shell 2026-10-30T20:31:49.101295604Z tar: ovnk_database_store: Cannot stat: No such file or directory 2026-10-30T20:31:49.104642447Z tar: Exiting with failure status due to previous errors 2026-10-30T20:31:49.105265290Z INFO: Network log collection complete. 2026-10-30T20:31:49.748834203Z Waiting for performance profile collector pods to become ready: 4 2026-10-30T20:31:49.913019009Z E1030 20:31:49.912955 1045 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://172.31.0.1:443/api?timeout=32s\": net/http: TLS handshake timeout" 2026-10-30T20:31:50.345497386Z Wrote inspect data to /must-gather/istio. 2026-10-30T20:31:50.348778794Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istiod-clusterrole-openshift-gateway-openshift-ingress 2026-10-30T20:31:50.894169860Z Wrote inspect data to /must-gather/istio. 2026-10-30T20:31:50.898420267Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istiod-gateway-controller-openshift-gateway-openshift-ingress 2026-10-30T20:31:50.963773694Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-10-30T20:31:51.013077928Z Waiting for performance profile collector pods to become ready: 5 2026-10-30T20:31:52.311752220Z Waiting for performance profile collector pods to become ready: 6 2026-10-30T20:31:53.572869217Z Waiting for performance profile collector pods to become ready: 7 2026-10-30T20:31:54.003048943Z Wrote inspect data to must-gather. 2026-10-30T20:31:54.417970150Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-10-30T20:31:54.824688910Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-10-30T20:31:55.262844571Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-10-30T20:31:55.390829309Z Collecting performance related data for node ip-10-0-133-7.us-west-1.compute.internal 2026-10-30T20:31:55.397927400Z Collecting performance related data for node ip-10-0-132-82.us-west-1.compute.internal 2026-10-30T20:31:55.405583956Z Collecting performance related data for node ip-10-0-141-5.us-west-1.compute.internal 2026-10-30T20:31:55.968404001Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:31:56.446390904Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-10-30T20:32:00.973078537Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:32:00.986436273Z E1030 20:32:00.986393 1509 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://172.31.0.1:443/api?timeout=32s\": net/http: TLS handshake timeout" 2026-10-30T20:32:01.420833720Z Wrote inspect data to /must-gather/istio. 2026-10-30T20:32:01.423676569Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istio-reader-clusterrole-openshift-gateway-openshift-ingress 2026-10-30T20:32:01.953068057Z Wrote inspect data to /must-gather/istio. 2026-10-30T20:32:01.956360087Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istiod-clusterrole-openshift-gateway-openshift-ingress 2026-10-30T20:32:02.494421295Z Wrote inspect data to /must-gather/istio. 2026-10-30T20:32:02.497345986Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istiod-gateway-controller-openshift-gateway-openshift-ingress 2026-10-30T20:32:03.031837956Z Wrote inspect data to /must-gather/istio. 2026-10-30T20:32:05.977814092Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:32:07.655531208Z INFO: Getting status from alertmanager-main-0 2026-10-30T20:32:10.982562812Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:32:13.128823999Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:32:13.382415322Z Inspecting resource mutatingwebhookconfiguration.admissionregistration.k8s.io/istio-sidecar-injector-openshift-gateway-openshift-ingress 2026-10-30T20:32:13.963116090Z Gathering data for ns/openshift-ingress... 2026-10-30T20:32:15.987271599Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:32:18.881274298Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-30T20:32:20.416267927Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-30T20:32:20.992091921Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:32:21.360925946Z Wrote inspect data to /must-gather/istio. 2026-10-30T20:32:25.996947463Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:32:27.677690007Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:32:27.683145177Z Collecting kubelet logs for node ip-10-0-133-7.us-west-1.compute.internal 2026-10-30T20:32:27.685061362Z Collecting kubelet logs for node ip-10-0-132-82.us-west-1.compute.internal 2026-10-30T20:32:27.686872351Z Collecting kubelet logs for node ip-10-0-141-5.us-west-1.compute.internal 2026-10-30T20:32:28.750694761Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-n79m4 namespace 2026-10-30T20:32:28.804839398Z INFO: Node performance data collection complete. 2026-10-30T20:32:31.001663688Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:32:31.463778245Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:32:36.006123438Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:32:41.010701880Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70 2026-10-30T20:32:41.967474605Z Unable to connect to the server: net/http: TLS handshake timeout 2026-10-30T20:32:42.613504195Z Done executing Istio gather script 2026-10-30T20:32:42.933731733Z error: the server doesn't have a resource type "clusters" 2026-10-30T20:32:42.989893012Z Caches written to disk