2026-09-08T13:45:42.972528411Z [disk usage checker] Started 2026-09-08T13:45:42.976456101Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-08T13:45:43.185089193Z Gathering data for ns/openshift-cluster-version... 2026-09-08T13:45:43.347501350Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-08T13:45:43.458774294Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-08T13:45:43.549095642Z Gathering data for ns/default... 2026-09-08T13:45:43.862348467Z Gathering data for ns/openshift... 2026-09-08T13:45:44.345968107Z Gathering data for ns/kube-system... 2026-09-08T13:45:45.037076949Z Gathering data for ns/openshift-etcd... 2026-09-08T13:45:45.427673360Z Wrote inspect data to must-gather. 2026-09-08T13:45:45.427797630Z error: inspection completed with the errors occurred while gathering data: 2026-09-08T13:45:45.427797630Z namespaces "assisted-installer" not found 2026-09-08T13:45:45.782526369Z Waiting on subprocesses to finish execution. 2026-09-08T13:45:45.788554502Z INFO: Gathering HAProxy config files 2026-09-08T13:45:45.795381845Z INFO: Gathering machine config daemon's old logs from all nodes 2026-09-08T13:45:45.796648327Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-09-08T13:45:45.802064939Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-09-08T13:45:45.813841596Z Executing Istio gather script 2026-09-08T13:45:45.858367343Z INFO: Waiting for node performance related collection to complete ... 2026-09-08T13:45:45.901778237Z INFO: Collecting host service logs for crio 2026-09-08T13:45:45.902139259Z INFO: Collecting host service logs for kubelet 2026-09-08T13:45:45.902488613Z INFO: Collecting host service logs for rpm-ostreed 2026-09-08T13:45:45.902874453Z INFO: Collecting host service logs for ostree-finalize-staged 2026-09-08T13:45:45.903233558Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-09-08T13:45:45.903572617Z INFO: Collecting host service logs for machine-config-daemon-host 2026-09-08T13:45:45.903937458Z INFO: Collecting host service logs for NetworkManager 2026-09-08T13:45:45.904276775Z INFO: Collecting host service logs for openvswitch 2026-09-08T13:45:45.904607914Z INFO: Collecting host service logs for ovs-configuration 2026-09-08T13:45:45.904979170Z INFO: Collecting host service logs for ovsdb-server 2026-09-08T13:45:45.905312640Z INFO: Collecting host service logs for ovs-vswitchd 2026-09-08T13:45:45.905780145Z INFO: Waiting for worker host service log collection to complete ... 2026-09-08T13:45:46.528300263Z No resources found 2026-09-08T13:45:46.592831278Z INFO: Found 1 replicas - prometheus-k8s-0 2026-09-08T13:45:46.687603115Z INFO: Collecting Insights Archives from insights-operator-76bcd6ccf5-8v9kw 2026-09-08T13:45:46.687666229Z insights-runtime-extractor-7kmm7 2026-09-08T13:45:46.687685544Z insights-runtime-extractor-zjjzt 2026-09-08T13:45:46.687705876Z insights-runtime-extractor-zn476 2026-09-08T13:45:46.843945331Z INFO: "metallb-operator" not detected. Skipping. 2026-09-08T13:45:46.847227633Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-09-08T13:45:46.915815903Z Wrote inspect data to must-gather. 2026-09-08T13:45:47.512844156Z INFO: "sriov-network-operator" not detected. Skipping. 2026-09-08T13:45:47.543879457Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-09-08T13:45:47.545465974Z Wrote inspect data to must-gather. 2026-09-08T13:45:47.834328341Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-09-08T13:45:47.977000841Z No resources found in openshift-etcd namespace. 2026-09-08T13:45:48.003073846Z No resources found 2026-09-08T13:45:48.006238461Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-09-08T13:45:48.088186554Z error: the server doesn't have a resource type "performanceprofile" 2026-09-08T13:45:48.197684011Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-08T13:45:48.218337537Z INFO: Waiting for HAProxy config collection to complete ... 2026-09-08T13:45:48.220872261Z INFO: Worker host service log collection to complete. 2026-09-08T13:45:48.262003882Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-09-08T13:45:48.262138983Z INFO: on-disk MachineConfig config collection complete. 2026-09-08T13:45:48.262246730Z INFO: 'previous-logs' folder not found on ip-10-0-134-224.ec2.internal, skipping... 2026-09-08T13:45:48.338794719Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-09-08T13:45:48.338794719Z See 'oc rsync -h' for help and examples 2026-09-08T13:45:48.474380553Z Wrote inspect data to must-gather. 2026-09-08T13:45:48.506239112Z ERROR: No running kube-apiserver pods found 2026-09-08T13:45:48.531996523Z Wrote inspect data to must-gather. 2026-09-08T13:45:48.639247547Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-08T13:45:48.688883816Z Wrote inspect data to must-gather. 2026-09-08T13:45:48.710070365Z Gathering data for ns/openshift-monitoring... 2026-09-08T13:45:48.739213006Z Wrote inspect data to must-gather. 2026-09-08T13:45:48.754008355Z tar: Removing leading `/' from member names 2026-09-08T13:45:48.759908541Z INFO: HAProxy config collection complete. 2026-09-08T13:45:48.857547145Z INFO: Getting rules from prometheus-k8s-0 2026-09-08T13:45:48.880374308Z Wrote inspect data to must-gather. 2026-09-08T13:45:48.904837898Z INFO: 'previous-logs' folder not found on ip-10-0-136-211.ec2.internal, skipping... 2026-09-08T13:45:48.981162534Z Wrote inspect data to must-gather. 2026-09-08T13:45:49.077363937Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-09-08T13:45:49.085914908Z error: the server doesn't have a resource type "machineconfigs" 2026-09-08T13:45:49.216880708Z INFO: 'previous-logs' folder not found on ip-10-0-142-86.ec2.internal, skipping... 2026-09-08T13:45:49.216915354Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-09-08T13:45:49.216915354Z INFO: Machine Config Daemon termination log collection complete. 2026-09-08T13:45:49.262918063Z Wrote inspect data to must-gather. 2026-09-08T13:45:49.265384132Z error: the server doesn't have a resource type "machineconfigpools" 2026-09-08T13:45:49.336666553Z INFO: Getting status/config from prometheus-k8s-0 2026-09-08T13:45:49.491559073Z Wrote inspect data to must-gather. 2026-09-08T13:45:49.508380354Z Wrote inspect data to must-gather. 2026-09-08T13:45:49.659134020Z error: the server doesn't have a resource type "kubeletconfigs" 2026-09-08T13:45:49.802774606Z INFO: Getting status/flags from prometheus-k8s-0 2026-09-08T13:45:49.812493763Z INFO: INTERCONNECT MODE 2026-09-08T13:45:49.812493763Z INFO: Gathering ovn-kubernetes DBs 2026-09-08T13:45:49.892978632Z Wrote inspect data to must-gather. 2026-09-08T13:45:49.994361275Z INFO: Gathering OVN_Northbound from ovnkube-node-c2n4x... 2026-09-08T13:45:49.994570236Z INFO: Gathering OVN_Northbound from ovnkube-node-cvm89... 2026-09-08T13:45:49.994879045Z INFO: Gathering OVN_Northbound from ovnkube-node-ms6p6... 2026-09-08T13:45:49.995217320Z INFO: Gathering OVN_Southbound from ovnkube-node-c2n4x... 2026-09-08T13:45:49.995501954Z INFO: Gathering OVN_Southbound from ovnkube-node-cvm89... 2026-09-08T13:45:49.995845095Z INFO: Gathering OVN_Southbound from ovnkube-node-ms6p6... 2026-09-08T13:45:50.092295903Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-09-08T13:45:50.263049255Z Wrote inspect data to must-gather. 2026-09-08T13:45:50.324484521Z tar: Removing leading `/' from member names 2026-09-08T13:45:50.371747771Z tar: Removing leading `/' from member names 2026-09-08T13:45:50.378114588Z tar: Removing leading `/' from member names 2026-09-08T13:45:50.394350284Z tar: Removing leading `/' from member names 2026-09-08T13:45:50.468058530Z tar: Removing leading `/' from member names 2026-09-08T13:45:50.472578973Z tar: Removing leading `/' from member names 2026-09-08T13:45:50.531953706Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-08T13:45:50.535876761Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-09-08T13:45:50.561747934Z Wrote inspect data to must-gather. 2026-09-08T13:45:50.831779670Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-09-08T13:45:50.855092405Z Wrote inspect data to must-gather. 2026-09-08T13:45:50.939736906Z INFO: Waiting for network log collection to complete ... 2026-09-08T13:45:50.939776135Z INFO: Waiting for ovnk database copies to complete ... 2026-09-08T13:45:50.940206129Z INFO: Copying ovnk databases complete. 2026-09-08T13:45:50.943337668Z 3.7M must-gather/network_logs/ovnk_database_store 2026-09-08T13:45:50.945825427Z ovnk_database_store/ 2026-09-08T13:45:50.945871502Z ovnk_database_store/ovnkube-node-ms6p6_nbdb 2026-09-08T13:45:50.947007499Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-09-08T13:45:50.955999456Z ovnk_database_store/ovnkube-node-c2n4x_nbdb 2026-09-08T13:45:50.966801165Z ovnk_database_store/ovnkube-node-c2n4x_sbdb 2026-09-08T13:45:50.990942436Z ovnk_database_store/ovnkube-node-cvm89_sbdb 2026-09-08T13:45:51.017560442Z ovnk_database_store/ovnkube-node-cvm89_nbdb 2026-09-08T13:45:51.027217443Z ovnk_database_store/ovnkube-node-ms6p6_sbdb 2026-09-08T13:45:51.055036441Z INFO: Network log collection complete. 2026-09-08T13:45:51.091092491Z W0908 13:45:51.091045 1471 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-09-08T13:45:51.096045676Z Wrote inspect data to must-gather. 2026-09-08T13:45:51.166813046Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:51.237404597Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-08T13:45:51.254135629Z INFO: Getting status from alertmanager-main-0 2026-09-08T13:45:51.422305716Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:51.425100079Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-09-08T13:45:51.433430024Z Wrote inspect data to must-gather. 2026-09-08T13:45:51.457380106Z Gathering data for ns/openshift-network-console... 2026-09-08T13:45:51.645410585Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:51.730571946Z Wrote inspect data to must-gather. 2026-09-08T13:45:51.866089478Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:51.869599891Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-09-08T13:45:52.045207145Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-09-08T13:45:52.047449858Z INFO: Fallback to identify the container image from release info 2026-09-08T13:45:52.049460491Z Gathering data for ns/openshift-console-operator... 2026-09-08T13:45:52.088685297Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:52.298055780Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:52.300429271Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-09-08T13:45:52.528335249Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:52.545385041Z Gathering data for ns/openshift-console... 2026-09-08T13:45:52.720095141Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:52.724451820Z Inspecting resource crd/inferencepools.inference.networking.k8s.io 2026-09-08T13:45:52.809995793Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399 2026-09-08T13:45:52.926909266Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:52.956236313Z daemonset.apps/perf-node-gather-daemonset created 2026-09-08T13:45:53.106377228Z Waiting for performance profile collector pods to become ready: 1 2026-09-08T13:45:53.153050802Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:53.157464586Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io 2026-09-08T13:45:53.229699415Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-08T13:45:53.293051927Z Gathering data for ns/openshift-cluster-storage-operator... 2026-09-08T13:45:53.340164996Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:53.547869177Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:53.550172316Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-09-08T13:45:53.746710027Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:53.968224977Z Wrote inspect data to /must-gather/istio. 2026-09-08T13:45:53.990661976Z Gathering data for ns/openshift-dns-operator... 2026-09-08T13:45:54.233740225Z Waiting for performance profile collector pods to become ready: 2 2026-09-08T13:45:54.377499903Z Gathering data for ns/openshift-dns... 2026-09-08T13:45:54.638948757Z Done executing Istio gather script 2026-09-08T13:45:55.056262971Z Gathering data for ns/openshift-image-registry... 2026-09-08T13:45:55.351077430Z Waiting for performance profile collector pods to become ready: 3 2026-09-08T13:45:55.577019077Z Gathering data for ns/openshift-ingress-operator... 2026-09-08T13:45:55.995962685Z Gathering data for ns/openshift-ingress... 2026-09-08T13:45:56.350167665Z Gathering data for ns/openshift-ingress-canary... 2026-09-08T13:45:56.472099322Z Waiting for performance profile collector pods to become ready: 4 2026-09-08T13:45:56.780423078Z Gathering data for ns/openshift-insights... 2026-09-08T13:45:57.601104260Z Waiting for performance profile collector pods to become ready: 5 2026-09-08T13:45:58.235444491Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-08T13:45:58.722683565Z Waiting for performance profile collector pods to become ready: 6 2026-09-08T13:45:59.374287864Z Gathering data for ns/kserve... 2026-09-08T13:45:59.841345131Z Waiting for performance profile collector pods to become ready: 7 2026-09-08T13:46:00.965551041Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-09-08T13:46:01.180195815Z Gathering data for ns/openshift-config... 2026-09-08T13:46:01.218823015Z Collecting performance related data for node ip-10-0-134-224.ec2.internal 2026-09-08T13:46:01.227479493Z Collecting performance related data for node ip-10-0-142-86.ec2.internal 2026-09-08T13:46:01.242029886Z Collecting performance related data for node ip-10-0-136-211.ec2.internal 2026-09-08T13:46:01.529350035Z Gathering data for ns/openshift-config-managed... 2026-09-08T13:46:02.078083425Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-09-08T13:46:02.500832049Z Gathering data for ns/openshift-kube-apiserver... 2026-09-08T13:46:02.881802751Z Gathering data for ns/openshift-kube-controller-manager... 2026-09-08T13:46:03.240680826Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-08T13:46:03.244491755Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-09-08T13:46:03.624072370Z Gathering data for ns/openshift-kube-scheduler... 2026-09-08T13:46:03.952072174Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-09-08T13:46:04.344139869Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-09-08T13:46:04.709960288Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-09-08T13:46:05.071181925Z Gathering data for ns/openshift-user-workload-monitoring... 2026-09-08T13:46:05.718539618Z Gathering data for ns/openshift-multus... 2026-09-08T13:46:07.493319032Z Gathering data for ns/openshift-ovn-kubernetes... 2026-09-08T13:46:08.245242732Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-09-08T13:46:08.874778718Z Gathering data for ns/openshift-host-network... 2026-09-08T13:46:09.229492325Z Gathering data for ns/openshift-network-diagnostics... 2026-09-08T13:46:09.580033678Z Collecting kubelet logs for node ip-10-0-134-224.ec2.internal 2026-09-08T13:46:09.581808914Z Collecting kubelet logs for node ip-10-0-142-86.ec2.internal 2026-09-08T13:46:09.583556193Z Collecting kubelet logs for node ip-10-0-136-211.ec2.internal 2026-09-08T13:46:09.940993250Z Gathering data for ns/openshift-network-node-identity... 2026-09-08T13:46:10.006650920Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-r7425 namespace 2026-09-08T13:46:10.012427387Z INFO: Node performance data collection complete. 2026-09-08T13:46:10.399968193Z Gathering data for ns/openshift-network-operator... 2026-09-08T13:46:10.858504457Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-09-08T13:46:11.154082204Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-09-08T13:46:11.670843636Z Gathering data for ns/openshift-apiserver-operator... 2026-09-08T13:46:12.006751137Z Gathering data for ns/openshift-apiserver... 2026-09-08T13:46:12.446847331Z Gathering data for ns/openshift-controller-manager-operator... 2026-09-08T13:46:12.804395515Z Gathering data for ns/openshift-controller-manager... 2026-09-08T13:46:13.159682215Z Gathering data for ns/openshift-cluster-samples-operator... 2026-09-08T13:46:13.249676413Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-09-08T13:46:13.876391368Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-09-08T13:46:14.241109476Z Gathering data for ns/openshift-service-ca-operator... 2026-09-08T13:46:14.602431605Z Gathering data for ns/openshift-service-ca... 2026-09-08T13:46:15.046374311Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-09-08T13:46:16.142420932Z Wrote inspect data to must-gather. 2026-09-08T13:46:16.142472099Z error: inspection completed with the errors occurred while gathering data: 2026-09-08T13:46:16.142472099Z skipping gathering secrets/support due to error: secrets "support" not found 2026-09-08T13:46:16.274756620Z error: the server doesn't have a resource type "clusters" 2026-09-08T13:46:16.416652763Z Caches written to disk