2026-09-17T18:18:05.819920995Z [disk usage checker] Started 2026-09-17T18:18:05.823305122Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-09-17T18:18:06.021702571Z Gathering data for ns/openshift-cluster-version... 2026-09-17T18:18:06.144737493Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-17T18:18:06.221387097Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-17T18:18:06.295715299Z Gathering data for ns/default... 2026-09-17T18:18:06.574511283Z Gathering data for ns/openshift... 2026-09-17T18:18:06.949340374Z Gathering data for ns/kube-system... 2026-09-17T18:18:07.670758624Z Gathering data for ns/openshift-etcd... 2026-09-17T18:18:07.957453404Z Wrote inspect data to must-gather. 2026-09-17T18:18:07.957481158Z error: inspection completed with the errors occurred while gathering data: 2026-09-17T18:18:07.957481158Z namespaces "assisted-installer" not found 2026-09-17T18:18:08.278668241Z Waiting on subprocesses to finish execution. 2026-09-17T18:18:08.285161705Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-09-17T18:18:08.285592666Z INFO: Gathering machine config daemon's old logs from all nodes 2026-09-17T18:18:08.287731273Z Executing Istio gather script 2026-09-17T18:18:08.290200965Z INFO: Gathering HAProxy config files 2026-09-17T18:18:08.293827200Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-09-17T18:18:08.300159084Z INFO: Collecting host service logs for crio 2026-09-17T18:18:08.300493096Z INFO: Collecting host service logs for kubelet 2026-09-17T18:18:08.300830039Z INFO: Collecting host service logs for rpm-ostreed 2026-09-17T18:18:08.301152419Z INFO: Collecting host service logs for ostree-finalize-staged 2026-09-17T18:18:08.301459359Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-09-17T18:18:08.301746151Z INFO: Collecting host service logs for machine-config-daemon-host 2026-09-17T18:18:08.302068531Z INFO: Collecting host service logs for NetworkManager 2026-09-17T18:18:08.302370703Z INFO: Collecting host service logs for openvswitch 2026-09-17T18:18:08.302671015Z INFO: Collecting host service logs for ovs-configuration 2026-09-17T18:18:08.302974777Z INFO: Collecting host service logs for ovsdb-server 2026-09-17T18:18:08.303288923Z INFO: Collecting host service logs for ovs-vswitchd 2026-09-17T18:18:08.303653447Z INFO: Waiting for worker host service log collection to complete ... 2026-09-17T18:18:08.336240977Z INFO: Waiting for node performance related collection to complete ... 2026-09-17T18:18:08.830672399Z error: the server doesn't have a resource type "performanceprofile" 2026-09-17T18:18:08.868128372Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-09-17T18:18:08.868227111Z INFO: on-disk MachineConfig config collection complete. 2026-09-17T18:18:09.180584766Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-bqddj 2026-09-17T18:18:09.180662790Z insights-runtime-extractor-5jxx2 2026-09-17T18:18:09.180684035Z insights-runtime-extractor-5lz6f 2026-09-17T18:18:09.180704223Z insights-runtime-extractor-rjfk9 2026-09-17T18:18:09.336538227Z INFO: Found 1 replicas - prometheus-k8s-0 2026-09-17T18:18:09.630509307Z No resources found in openshift-etcd namespace. 2026-09-17T18:18:09.773856545Z Wrote inspect data to must-gather. 2026-09-17T18:18:10.055630707Z No resources found 2026-09-17T18:18:10.078016566Z INFO: "metallb-operator" not detected. Skipping. 2026-09-17T18:18:10.098190905Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-09-17T18:18:10.098190905Z See 'oc rsync -h' for help and examples 2026-09-17T18:18:10.184754256Z Wrote inspect data to must-gather. 2026-09-17T18:18:10.220264790Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-09-17T18:18:10.298759371Z Wrote inspect data to must-gather. 2026-09-17T18:18:10.365381772Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-09-17T18:18:10.449636489Z Wrote inspect data to must-gather. 2026-09-17T18:18:10.458455829Z Wrote inspect data to must-gather. 2026-09-17T18:18:10.475300905Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-09-17T18:18:10.517379230Z Gathering data for ns/openshift-monitoring... 2026-09-17T18:18:10.612659589Z Wrote inspect data to must-gather. 2026-09-17T18:18:10.618018357Z Wrote inspect data to must-gather. 2026-09-17T18:18:10.678614963Z INFO: "sriov-network-operator" not detected. Skipping. 2026-09-17T18:18:10.719293706Z INFO: Waiting for HAProxy config collection to complete ... 2026-09-17T18:18:10.723179570Z ERROR: No running kube-apiserver pods found 2026-09-17T18:18:10.735075765Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-09-17T18:18:10.737467407Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-09-17T18:18:10.777631746Z No resources found 2026-09-17T18:18:10.815429478Z error: the server doesn't have a resource type "machineconfigs" 2026-09-17T18:18:10.822557918Z INFO: Worker host service log collection to complete. 2026-09-17T18:18:10.828655369Z INFO: 'previous-logs' folder not found on ip-10-0-128-4.ec2.internal, skipping... 2026-09-17T18:18:10.832415838Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-17T18:18:10.840636567Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-09-17T18:18:10.990592894Z tar: Removing leading `/' from member names 2026-09-17T18:18:10.993946740Z error: the server doesn't have a resource type "machineconfigpools" 2026-09-17T18:18:10.994064958Z Wrote inspect data to must-gather. 2026-09-17T18:18:10.995897826Z INFO: HAProxy config collection complete. 2026-09-17T18:18:11.077509495Z INFO: Getting rules from prometheus-k8s-0 2026-09-17T18:18:11.107227251Z INFO: 'previous-logs' folder not found on ip-10-0-137-14.ec2.internal, skipping... 2026-09-17T18:18:11.234758877Z Wrote inspect data to must-gather. 2026-09-17T18:18:11.256966432Z Wrote inspect data to must-gather. 2026-09-17T18:18:11.360104646Z INFO: 'previous-logs' folder not found on ip-10-0-137-166.ec2.internal, skipping... 2026-09-17T18:18:11.360217385Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-09-17T18:18:11.360267902Z INFO: Machine Config Daemon termination log collection complete. 2026-09-17T18:18:11.388292250Z error: the server doesn't have a resource type "kubeletconfigs" 2026-09-17T18:18:11.499744414Z INFO: Getting status/config from prometheus-k8s-0 2026-09-17T18:18:11.514516803Z Wrote inspect data to must-gather. 2026-09-17T18:18:11.612489470Z Wrote inspect data to must-gather. 2026-09-17T18:18:11.770955922Z INFO: INTERCONNECT MODE 2026-09-17T18:18:11.771015596Z INFO: Gathering ovn-kubernetes DBs 2026-09-17T18:18:11.826336318Z Wrote inspect data to must-gather. 2026-09-17T18:18:11.882207557Z INFO: Getting status/flags from prometheus-k8s-0 2026-09-17T18:18:11.891246187Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-09-17T18:18:11.931419353Z INFO: Gathering OVN_Northbound from ovnkube-node-5nn7p... 2026-09-17T18:18:11.931769577Z INFO: Gathering OVN_Northbound from ovnkube-node-8sz5h... 2026-09-17T18:18:11.932102348Z INFO: Gathering OVN_Northbound from ovnkube-node-bl8z7... 2026-09-17T18:18:11.932449400Z INFO: Gathering OVN_Southbound from ovnkube-node-5nn7p... 2026-09-17T18:18:11.932748894Z INFO: Gathering OVN_Southbound from ovnkube-node-8sz5h... 2026-09-17T18:18:11.933101040Z INFO: Gathering OVN_Southbound from ovnkube-node-bl8z7... 2026-09-17T18:18:12.149395541Z Wrote inspect data to must-gather. 2026-09-17T18:18:12.192790058Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-09-17T18:18:12.205894032Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-09-17T18:18:12.288246746Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:12.290170213Z tar: Removing leading `/' from member names 2026-09-17T18:18:12.315840216Z tar: Removing leading `/' from member names 2026-09-17T18:18:12.324237912Z tar: Removing leading `/' from member names 2026-09-17T18:18:12.325204139Z tar: Removing leading `/' from member names 2026-09-17T18:18:12.339345304Z tar: Removing leading `/' from member names 2026-09-17T18:18:12.339345304Z tar: Removing leading `/' from member names 2026-09-17T18:18:12.456260747Z Wrote inspect data to must-gather. 2026-09-17T18:18:12.485294415Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-09-17T18:18:12.529767669Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:12.532507802Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-09-17T18:18:12.703130789Z Wrote inspect data to must-gather. 2026-09-17T18:18:12.754690474Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:12.770324247Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-09-17T18:18:12.792945945Z INFO: Waiting for network log collection to complete ... 2026-09-17T18:18:12.793077621Z INFO: Waiting for ovnk database copies to complete ... 2026-09-17T18:18:12.793603804Z INFO: Copying ovnk databases complete. 2026-09-17T18:18:12.795265677Z 2.5M must-gather/network_logs/ovnk_database_store 2026-09-17T18:18:12.797406022Z ovnk_database_store/ 2026-09-17T18:18:12.797406022Z ovnk_database_store/ovnkube-node-bl8z7_nbdb 2026-09-17T18:18:12.805110130Z ovnk_database_store/ovnkube-node-5nn7p_sbdb 2026-09-17T18:18:12.822865679Z ovnk_database_store/ovnkube-node-8sz5h_sbdb 2026-09-17T18:18:12.838018595Z ovnk_database_store/ovnkube-node-bl8z7_sbdb 2026-09-17T18:18:12.855644388Z ovnk_database_store/ovnkube-node-5nn7p_nbdb 2026-09-17T18:18:12.862369327Z ovnk_database_store/ovnkube-node-8sz5h_nbdb 2026-09-17T18:18:12.872840712Z INFO: Network log collection complete. 2026-09-17T18:18:12.892010938Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-09-17T18:18:12.976337978Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:12.979153622Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-09-17T18:18:13.021350585Z Wrote inspect data to must-gather. 2026-09-17T18:18:13.079372207Z Gathering data for ns/openshift-network-console... 2026-09-17T18:18:13.187198654Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:13.206568472Z INFO: Getting status from alertmanager-main-0 2026-09-17T18:18:13.338904067Z W0917 18:18:13.338865 1555 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-09-17T18:18:13.349639358Z Wrote inspect data to must-gather. 2026-09-17T18:18:13.388156793Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:13.391973262Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-09-17T18:18:13.528303965Z Gathering data for ns/openshift-console-operator... 2026-09-17T18:18:13.618808036Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:13.626715433Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-09-17T18:18:13.628951691Z INFO: Fallback to identify the container image from release info 2026-09-17T18:18:13.800838549Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:13.803250797Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-09-17T18:18:13.897873869Z Gathering data for ns/openshift-console... 2026-09-17T18:18:13.953115679Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:14.139774585Z Wrote inspect data to /must-gather/istio. 2026-09-17T18:18:14.276943991Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea 2026-09-17T18:18:14.398573221Z Gathering data for ns/openshift-cluster-storage-operator... 2026-09-17T18:18:14.408922836Z daemonset.apps/perf-node-gather-daemonset created 2026-09-17T18:18:14.540297697Z Waiting for performance profile collector pods to become ready: 1 2026-09-17T18:18:14.822841325Z Done executing Istio gather script 2026-09-17T18:18:14.928269215Z Gathering data for ns/openshift-dns-operator... 2026-09-17T18:18:15.191189929Z Gathering data for ns/openshift-dns... 2026-09-17T18:18:15.655229657Z Waiting for performance profile collector pods to become ready: 2 2026-09-17T18:18:15.744456583Z Gathering data for ns/openshift-image-registry... 2026-09-17T18:18:15.851257944Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-09-17T18:18:16.171015785Z Gathering data for ns/openshift-ingress-operator... 2026-09-17T18:18:16.463633093Z Gathering data for ns/openshift-ingress... 2026-09-17T18:18:16.771644236Z Waiting for performance profile collector pods to become ready: 3 2026-09-17T18:18:16.801292315Z Gathering data for ns/openshift-ingress-canary... 2026-09-17T18:18:17.151025080Z Gathering data for ns/openshift-insights... 2026-09-17T18:18:17.874872113Z Waiting for performance profile collector pods to become ready: 4 2026-09-17T18:18:18.925931072Z Gathering data for ns/openshift-config... 2026-09-17T18:18:18.991399389Z Waiting for performance profile collector pods to become ready: 5 2026-09-17T18:18:19.171739349Z Gathering data for ns/openshift-config-managed... 2026-09-17T18:18:19.536193807Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-09-17T18:18:19.782099754Z Gathering data for ns/openshift-kube-apiserver... 2026-09-17T18:18:20.022200524Z Gathering data for ns/openshift-kube-controller-manager... 2026-09-17T18:18:20.112749449Z Waiting for performance profile collector pods to become ready: 6 2026-09-17T18:18:20.289489824Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-09-17T18:18:20.550012781Z Gathering data for ns/openshift-kube-scheduler... 2026-09-17T18:18:20.787669566Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-09-17T18:18:20.855790038Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-09-17T18:18:21.045084356Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-09-17T18:18:21.221308272Z Waiting for performance profile collector pods to become ready: 7 2026-09-17T18:18:21.340911492Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-09-17T18:18:21.618098144Z Gathering data for ns/openshift-user-workload-monitoring... 2026-09-17T18:18:22.068176565Z Gathering data for ns/openshift-multus... 2026-09-17T18:18:22.319894185Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-09-17T18:18:22.527929234Z Collecting performance related data for node ip-10-0-137-166.ec2.internal 2026-09-17T18:18:22.534922349Z Collecting performance related data for node ip-10-0-137-14.ec2.internal 2026-09-17T18:18:22.541873772Z Collecting performance related data for node ip-10-0-128-4.ec2.internal 2026-09-17T18:18:23.567341271Z Gathering data for ns/openshift-ovn-kubernetes... 2026-09-17T18:18:24.744276400Z Gathering data for ns/openshift-host-network... 2026-09-17T18:18:25.046443362Z Gathering data for ns/openshift-network-diagnostics... 2026-09-17T18:18:25.568514819Z Gathering data for ns/openshift-network-node-identity... 2026-09-17T18:18:25.860865024Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-09-17T18:18:25.925059287Z Gathering data for ns/openshift-network-operator... 2026-09-17T18:18:26.280431528Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-09-17T18:18:26.575160785Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-09-17T18:18:27.027299251Z Gathering data for ns/openshift-apiserver-operator... 2026-09-17T18:18:27.316103565Z Gathering data for ns/openshift-apiserver... 2026-09-17T18:18:27.699652290Z Gathering data for ns/openshift-controller-manager-operator... 2026-09-17T18:18:27.988663532Z Gathering data for ns/openshift-controller-manager... 2026-09-17T18:18:28.238492072Z Gathering data for ns/openshift-cluster-samples-operator... 2026-09-17T18:18:28.830407246Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-09-17T18:18:29.131201544Z Gathering data for ns/openshift-service-ca-operator... 2026-09-17T18:18:29.448896850Z Gathering data for ns/openshift-service-ca... 2026-09-17T18:18:29.776274019Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-09-17T18:18:30.154707034Z Collecting kubelet logs for node ip-10-0-137-166.ec2.internal 2026-09-17T18:18:30.157077757Z Collecting kubelet logs for node ip-10-0-137-14.ec2.internal 2026-09-17T18:18:30.159185709Z Collecting kubelet logs for node ip-10-0-128-4.ec2.internal 2026-09-17T18:18:30.482751574Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-7mlf2 namespace 2026-09-17T18:18:30.487350634Z INFO: Node performance data collection complete. 2026-09-17T18:18:30.700984525Z Wrote inspect data to must-gather. 2026-09-17T18:18:30.701037653Z error: inspection completed with the errors occurred while gathering data: 2026-09-17T18:18:30.701037653Z skipping gathering secrets/support due to error: secrets "support" not found 2026-09-17T18:18:30.826137868Z error: the server doesn't have a resource type "clusters" 2026-09-17T18:18:30.865938599Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-09-17T18:18:30.949686173Z Caches written to disk