2026-07-27T10:59:29.632862361Z [disk usage checker] Started 2026-07-27T10:59:29.636384489Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-07-27T10:59:29.823165073Z Gathering data for ns/openshift-cluster-version... 2026-07-27T10:59:29.956861563Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-07-27T10:59:30.030946947Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-27T10:59:30.103625584Z Gathering data for ns/default... 2026-07-27T10:59:30.366011798Z Gathering data for ns/openshift... 2026-07-27T10:59:30.762395878Z Gathering data for ns/kube-system... 2026-07-27T10:59:31.379530813Z Gathering data for ns/openshift-etcd... 2026-07-27T10:59:31.649327320Z Wrote inspect data to must-gather. 2026-07-27T10:59:31.649363490Z error: inspection completed with the errors occurred while gathering data: 2026-07-27T10:59:31.649363490Z namespaces "assisted-installer" not found 2026-07-27T10:59:32.150858088Z Waiting on subprocesses to finish execution. 2026-07-27T10:59:32.152939011Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-07-27T10:59:32.161823009Z Executing Istio gather script 2026-07-27T10:59:32.169565935Z INFO: Gathering HAProxy config files 2026-07-27T10:59:32.170594692Z INFO: Collecting host service logs for crio 2026-07-27T10:59:32.170774324Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-07-27T10:59:32.170914727Z INFO: Collecting host service logs for kubelet 2026-07-27T10:59:32.171268510Z INFO: Collecting host service logs for rpm-ostreed 2026-07-27T10:59:32.171617636Z INFO: Collecting host service logs for ostree-finalize-staged 2026-07-27T10:59:32.171978280Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-07-27T10:59:32.172340950Z INFO: Collecting host service logs for machine-config-daemon-host 2026-07-27T10:59:32.172685063Z INFO: Collecting host service logs for NetworkManager 2026-07-27T10:59:32.173054404Z INFO: Collecting host service logs for openvswitch 2026-07-27T10:59:32.173522591Z INFO: Collecting host service logs for ovs-configuration 2026-07-27T10:59:32.173870302Z INFO: Collecting host service logs for ovsdb-server 2026-07-27T10:59:32.174299571Z INFO: Collecting host service logs for ovs-vswitchd 2026-07-27T10:59:32.174723205Z INFO: Waiting for worker host service log collection to complete ... 2026-07-27T10:59:32.209918025Z INFO: Gathering machine config daemon's old logs from all nodes 2026-07-27T10:59:32.318668588Z INFO: Waiting for node performance related collection to complete ... 2026-07-27T10:59:32.904110919Z INFO: Collecting Insights Archives from insights-operator-5885fdb759-cntm5 2026-07-27T10:59:32.904194534Z insights-runtime-extractor-76t7w 2026-07-27T10:59:32.904217754Z insights-runtime-extractor-8jg86 2026-07-27T10:59:32.904238514Z insights-runtime-extractor-9h2wx 2026-07-27T10:59:32.999498488Z No resources found in openshift-etcd namespace. 2026-07-27T10:59:33.110219679Z INFO: Found 1 replicas - prometheus-k8s-0 2026-07-27T10:59:33.114405530Z No resources found 2026-07-27T10:59:33.164918576Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-07-27T10:59:33.181740688Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-07-27T10:59:33.181784457Z INFO: on-disk MachineConfig config collection complete. 2026-07-27T10:59:33.195637072Z INFO: "metallb-operator" not detected. Skipping. 2026-07-27T10:59:33.196326955Z INFO: "sriov-network-operator" not detected. Skipping. 2026-07-27T10:59:33.345461809Z error: the server doesn't have a resource type "performanceprofile" 2026-07-27T10:59:33.356946476Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-07-27T10:59:33.356946476Z See 'oc rsync -h' for help and examples 2026-07-27T10:59:33.685177473Z INFO: Waiting for HAProxy config collection to complete ... 2026-07-27T10:59:33.795542798Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-07-27T10:59:33.826085841Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-27T10:59:33.872631018Z Wrote inspect data to must-gather. 2026-07-27T10:59:33.936053403Z Wrote inspect data to must-gather. 2026-07-27T10:59:33.949865766Z Wrote inspect data to must-gather. 2026-07-27T10:59:33.977538874Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-07-27T10:59:34.015335296Z INFO: Worker host service log collection to complete. 2026-07-27T10:59:34.043465988Z No resources found 2026-07-27T10:59:34.225700722Z Wrote inspect data to must-gather. 2026-07-27T10:59:34.302734424Z error: the server doesn't have a resource type "machineconfigs" 2026-07-27T10:59:34.375913184Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-07-27T10:59:34.402153130Z tar: Removing leading `/' from member names 2026-07-27T10:59:34.409731198Z INFO: HAProxy config collection complete. 2026-07-27T10:59:34.449998561Z Wrote inspect data to must-gather. 2026-07-27T10:59:34.553838835Z ERROR: No running kube-apiserver pods found 2026-07-27T10:59:34.565593605Z Wrote inspect data to must-gather. 2026-07-27T10:59:34.652715400Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-07-27T10:59:34.668307919Z INFO: 'previous-logs' folder not found on ip-10-0-130-41.ec2.internal, skipping... 2026-07-27T10:59:34.747664985Z error: the server doesn't have a resource type "machineconfigpools" 2026-07-27T10:59:34.824658701Z Wrote inspect data to must-gather. 2026-07-27T10:59:34.875371675Z Wrote inspect data to must-gather. 2026-07-27T10:59:34.971190069Z INFO: Getting rules from prometheus-k8s-0 2026-07-27T10:59:35.032216517Z Gathering data for ns/openshift-monitoring... 2026-07-27T10:59:35.065401628Z INFO: 'previous-logs' folder not found on ip-10-0-142-95.ec2.internal, skipping... 2026-07-27T10:59:35.069256428Z Wrote inspect data to must-gather. 2026-07-27T10:59:35.084139263Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-07-27T10:59:35.189843027Z Wrote inspect data to must-gather. 2026-07-27T10:59:35.242417447Z error: the server doesn't have a resource type "kubeletconfigs" 2026-07-27T10:59:35.349636118Z INFO: 'previous-logs' folder not found on ip-10-0-143-4.ec2.internal, skipping... 2026-07-27T10:59:35.349667813Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-07-27T10:59:35.349699650Z INFO: Machine Config Daemon termination log collection complete. 2026-07-27T10:59:35.416339190Z INFO: Getting status/config from prometheus-k8s-0 2026-07-27T10:59:35.465625594Z Wrote inspect data to must-gather. 2026-07-27T10:59:35.471708776Z Wrote inspect data to must-gather. 2026-07-27T10:59:35.670724938Z Wrote inspect data to must-gather. 2026-07-27T10:59:35.758053845Z INFO: INTERCONNECT MODE 2026-07-27T10:59:35.758154552Z INFO: Gathering ovn-kubernetes DBs 2026-07-27T10:59:35.763100369Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-07-27T10:59:35.795874316Z INFO: Getting status/flags from prometheus-k8s-0 2026-07-27T10:59:35.886741525Z Wrote inspect data to must-gather. 2026-07-27T10:59:35.928751057Z INFO: Gathering OVN_Northbound from ovnkube-node-6n6sf... 2026-07-27T10:59:35.929009609Z INFO: Gathering OVN_Northbound from ovnkube-node-gf7vz... 2026-07-27T10:59:35.929250802Z INFO: Gathering OVN_Northbound from ovnkube-node-rbv5f... 2026-07-27T10:59:35.929556100Z INFO: Gathering OVN_Southbound from ovnkube-node-6n6sf... 2026-07-27T10:59:35.929844287Z INFO: Gathering OVN_Southbound from ovnkube-node-gf7vz... 2026-07-27T10:59:35.930147841Z INFO: Gathering OVN_Southbound from ovnkube-node-rbv5f... 2026-07-27T10:59:35.957412024Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:36.050044306Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-07-27T10:59:36.237520863Z tar: Removing leading `/' from member names 2026-07-27T10:59:36.241282486Z tar: Removing leading `/' from member names 2026-07-27T10:59:36.256186382Z tar: Removing leading `/' from member names 2026-07-27T10:59:36.256258075Z Wrote inspect data to must-gather. 2026-07-27T10:59:36.260293441Z tar: Removing leading `/' from member names 2026-07-27T10:59:36.271576750Z tar: Removing leading `/' from member names 2026-07-27T10:59:36.277739622Z tar: Removing leading `/' from member names 2026-07-27T10:59:36.337556109Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:36.339903979Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-07-27T10:59:36.403863207Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-07-27T10:59:36.419951702Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-07-27T10:59:36.495430334Z Wrote inspect data to must-gather. 2026-07-27T10:59:36.580080124Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:36.690790242Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-07-27T10:59:36.724399897Z Wrote inspect data to must-gather. 2026-07-27T10:59:36.816261460Z INFO: Waiting for network log collection to complete ... 2026-07-27T10:59:36.816374385Z INFO: Waiting for ovnk database copies to complete ... 2026-07-27T10:59:36.816918137Z INFO: Copying ovnk databases complete. 2026-07-27T10:59:36.820692908Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:36.821394936Z 2.5M must-gather/network_logs/ovnk_database_store 2026-07-27T10:59:36.825039922Z ovnk_database_store/ 2026-07-27T10:59:36.825086676Z ovnk_database_store/ovnkube-node-gf7vz_sbdb 2026-07-27T10:59:36.825615923Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-07-27T10:59:36.846225908Z ovnk_database_store/ovnkube-node-6n6sf_nbdb 2026-07-27T10:59:36.853025758Z ovnk_database_store/ovnkube-node-rbv5f_nbdb 2026-07-27T10:59:36.859691734Z ovnk_database_store/ovnkube-node-gf7vz_nbdb 2026-07-27T10:59:36.868067652Z ovnk_database_store/ovnkube-node-6n6sf_sbdb 2026-07-27T10:59:36.885910989Z ovnk_database_store/ovnkube-node-rbv5f_sbdb 2026-07-27T10:59:36.903252587Z INFO: Network log collection complete. 2026-07-27T10:59:36.948816547Z W0727 10:59:36.948764 1528 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-07-27T10:59:36.953559854Z Wrote inspect data to must-gather. 2026-07-27T10:59:37.018790195Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:37.066112942Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-27T10:59:37.072499926Z INFO: Getting status from alertmanager-main-0 2026-07-27T10:59:37.238819753Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-07-27T10:59:37.241444129Z INFO: Fallback to identify the container image from release info 2026-07-27T10:59:37.254507010Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:37.257096083Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-07-27T10:59:37.258090945Z Gathering data for ns/openshift-network-console... 2026-07-27T10:59:37.471577374Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:37.647383100Z Gathering data for ns/openshift-console-operator... 2026-07-27T10:59:37.655497336Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:37.658805083Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-07-27T10:59:37.806604363Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:37.957720415Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811 2026-07-27T10:59:38.002019274Z Wrote inspect data to /must-gather/istio. 2026-07-27T10:59:38.018482993Z Gathering data for ns/openshift-console... 2026-07-27T10:59:38.080521581Z daemonset.apps/perf-node-gather-daemonset created 2026-07-27T10:59:38.216514216Z Waiting for performance profile collector pods to become ready: 1 2026-07-27T10:59:38.535049630Z Gathering data for ns/openshift-cluster-storage-operator... 2026-07-27T10:59:38.693610124Z Done executing Istio gather script 2026-07-27T10:59:38.983993712Z Gathering data for ns/openshift-dns-operator... 2026-07-27T10:59:39.272780869Z Gathering data for ns/openshift-dns... 2026-07-27T10:59:39.324680101Z Waiting for performance profile collector pods to become ready: 2 2026-07-27T10:59:39.671467478Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-07-27T10:59:39.786092858Z Gathering data for ns/openshift-image-registry... 2026-07-27T10:59:40.192710364Z Gathering data for ns/openshift-ingress-operator... 2026-07-27T10:59:40.445962785Z Waiting for performance profile collector pods to become ready: 3 2026-07-27T10:59:40.525235486Z Gathering data for ns/openshift-ingress... 2026-07-27T10:59:40.814820671Z Gathering data for ns/openshift-ingress-canary... 2026-07-27T10:59:41.141837991Z Gathering data for ns/openshift-insights... 2026-07-27T10:59:41.552183349Z Waiting for performance profile collector pods to become ready: 4 2026-07-27T10:59:42.657723708Z Waiting for performance profile collector pods to become ready: 5 2026-07-27T10:59:42.820237583Z Gathering data for ns/openshift-jobset-operator... 2026-07-27T10:59:43.480215495Z Gathering data for ns/openshift-config... 2026-07-27T10:59:43.705496410Z Gathering data for ns/openshift-config-managed... 2026-07-27T10:59:43.781651050Z Waiting for performance profile collector pods to become ready: 6 2026-07-27T10:59:44.095071919Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-07-27T10:59:44.323105979Z Gathering data for ns/openshift-kube-apiserver... 2026-07-27T10:59:44.597638318Z Gathering data for ns/openshift-kube-controller-manager... 2026-07-27T10:59:44.675919571Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-07-27T10:59:44.902251796Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-07-27T10:59:44.903460396Z Waiting for performance profile collector pods to become ready: 7 2026-07-27T10:59:45.148064910Z Gathering data for ns/openshift-kube-scheduler... 2026-07-27T10:59:45.379337061Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-07-27T10:59:45.652868308Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-07-27T10:59:45.929266047Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-07-27T10:59:46.024652544Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-07-27T10:59:46.227380372Z Gathering data for ns/openshift-user-workload-monitoring... 2026-07-27T10:59:46.279340220Z Collecting performance related data for node ip-10-0-143-4.ec2.internal 2026-07-27T10:59:46.289823062Z Collecting performance related data for node ip-10-0-130-41.ec2.internal 2026-07-27T10:59:46.302607984Z Collecting performance related data for node ip-10-0-142-95.ec2.internal 2026-07-27T10:59:46.779653469Z Gathering data for ns/openshift-multus... 2026-07-27T10:59:48.136586942Z Gathering data for ns/openshift-ovn-kubernetes... 2026-07-27T10:59:49.299630634Z Gathering data for ns/openshift-host-network... 2026-07-27T10:59:49.568088073Z Gathering data for ns/openshift-network-diagnostics... 2026-07-27T10:59:49.683955193Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-07-27T10:59:50.062293361Z Gathering data for ns/openshift-network-node-identity... 2026-07-27T10:59:50.483318784Z Gathering data for ns/openshift-network-operator... 2026-07-27T10:59:50.850583187Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-07-27T10:59:51.095897439Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-07-27T10:59:51.605508342Z Gathering data for ns/openshift-apiserver-operator... 2026-07-27T10:59:51.881818634Z Gathering data for ns/openshift-apiserver... 2026-07-27T10:59:52.249337230Z Gathering data for ns/openshift-controller-manager-operator... 2026-07-27T10:59:52.512117664Z Gathering data for ns/openshift-controller-manager... 2026-07-27T10:59:52.760348138Z Gathering data for ns/openshift-cluster-samples-operator... 2026-07-27T10:59:53.381236923Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-07-27T10:59:53.642255886Z Gathering data for ns/openshift-service-ca-operator... 2026-07-27T10:59:53.948302052Z Gathering data for ns/openshift-service-ca... 2026-07-27T10:59:54.045662555Z Collecting kubelet logs for node ip-10-0-143-4.ec2.internal 2026-07-27T10:59:54.047416091Z Collecting kubelet logs for node ip-10-0-130-41.ec2.internal 2026-07-27T10:59:54.049032688Z Collecting kubelet logs for node ip-10-0-142-95.ec2.internal 2026-07-27T10:59:54.320683260Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-07-27T10:59:54.363088725Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-6xd7v namespace 2026-07-27T10:59:54.367144988Z INFO: Node performance data collection complete. 2026-07-27T10:59:54.688750753Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70 2026-07-27T10:59:55.151634097Z Wrote inspect data to must-gather. 2026-07-27T10:59:55.151677217Z error: inspection completed with the errors occurred while gathering data: 2026-07-27T10:59:55.151677217Z skipping gathering secrets/support due to error: secrets "support" not found 2026-07-27T10:59:55.272557520Z error: the server doesn't have a resource type "clusters" 2026-07-27T10:59:55.395939089Z Caches written to disk