2026-07-21T09:04:53.977344467Z [disk usage checker] Started 2026-07-21T09:04:53.980609805Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-07-21T09:04:54.178767245Z Gathering data for ns/openshift-cluster-version... 2026-07-21T09:04:54.311463542Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-07-21T09:04:54.400690419Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-21T09:04:54.493050667Z Gathering data for ns/default... 2026-07-21T09:04:54.832089733Z Gathering data for ns/openshift... 2026-07-21T09:04:55.259485267Z Gathering data for ns/kube-system... 2026-07-21T09:04:55.995970447Z Gathering data for ns/openshift-etcd... 2026-07-21T09:04:56.313691437Z Wrote inspect data to must-gather. 2026-07-21T09:04:56.313723017Z error: inspection completed with the errors occurred while gathering data: 2026-07-21T09:04:56.313723017Z namespaces "assisted-installer" not found 2026-07-21T09:04:56.602417447Z Waiting on subprocesses to finish execution. 2026-07-21T09:04:56.615651005Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-07-21T09:04:56.619084624Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-07-21T09:04:56.620378361Z INFO: Gathering machine config daemon's old logs from all nodes 2026-07-21T09:04:56.625840336Z INFO: Gathering HAProxy config files 2026-07-21T09:04:56.635235442Z Executing Istio gather script 2026-07-21T09:04:56.655236147Z INFO: Waiting for node performance related collection to complete ... 2026-07-21T09:04:56.676568897Z INFO: Collecting host service logs for crio 2026-07-21T09:04:56.676835497Z INFO: Collecting host service logs for kubelet 2026-07-21T09:04:56.677136200Z INFO: Collecting host service logs for rpm-ostreed 2026-07-21T09:04:56.677403470Z INFO: Collecting host service logs for ostree-finalize-staged 2026-07-21T09:04:56.677678030Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-07-21T09:04:56.677936668Z INFO: Collecting host service logs for machine-config-daemon-host 2026-07-21T09:04:56.678226891Z INFO: Collecting host service logs for NetworkManager 2026-07-21T09:04:56.678508452Z INFO: Collecting host service logs for openvswitch 2026-07-21T09:04:56.678771547Z INFO: Collecting host service logs for ovs-configuration 2026-07-21T09:04:56.679049209Z INFO: Collecting host service logs for ovsdb-server 2026-07-21T09:04:56.679326693Z INFO: Collecting host service logs for ovs-vswitchd 2026-07-21T09:04:56.679645056Z INFO: Waiting for worker host service log collection to complete ... 2026-07-21T09:04:57.094373385Z INFO: Found 1 replicas - prometheus-k8s-0 2026-07-21T09:04:57.179908127Z INFO: Collecting Insights Archives from insights-operator-555d9d7885-njpqb 2026-07-21T09:04:57.180158441Z insights-runtime-extractor-dz6tn 2026-07-21T09:04:57.180190360Z insights-runtime-extractor-pbdxv 2026-07-21T09:04:57.180211354Z insights-runtime-extractor-sqgwf 2026-07-21T09:04:57.243459092Z No resources found in openshift-etcd namespace. 2026-07-21T09:04:57.295994279Z No resources found 2026-07-21T09:04:57.350341395Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-07-21T09:04:57.448078114Z error: the server doesn't have a resource type "performanceprofile" 2026-07-21T09:04:57.491823994Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-07-21T09:04:57.491924193Z INFO: on-disk MachineConfig config collection complete. 2026-07-21T09:04:57.727372366Z INFO: "metallb-operator" not detected. Skipping. 2026-07-21T09:04:57.875162746Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-07-21T09:04:57.875162746Z See 'oc rsync -h' for help and examples 2026-07-21T09:04:58.127971850Z Wrote inspect data to must-gather. 2026-07-21T09:04:58.225327468Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-07-21T09:04:58.306189269Z INFO: Waiting for HAProxy config collection to complete ... 2026-07-21T09:04:58.316146195Z ERROR: No running kube-apiserver pods found 2026-07-21T09:04:58.330791260Z Wrote inspect data to must-gather. 2026-07-21T09:04:58.358457325Z INFO: "sriov-network-operator" not detected. Skipping. 2026-07-21T09:04:58.424714671Z INFO: Worker host service log collection to complete. 2026-07-21T09:04:58.453868434Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-07-21T09:04:58.936488566Z Wrote inspect data to must-gather. 2026-07-21T09:04:58.945383852Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-21T09:04:59.028599840Z Wrote inspect data to must-gather. 2026-07-21T09:04:59.030215086Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-07-21T09:04:59.130361865Z tar: Removing leading `/' from member names 2026-07-21T09:04:59.141845703Z INFO: HAProxy config collection complete. 2026-07-21T09:04:59.194964312Z INFO: 'previous-logs' folder not found on ip-10-0-128-156.ec2.internal, skipping... 2026-07-21T09:04:59.195478280Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-07-21T09:04:59.203475372Z Gathering data for ns/openshift-monitoring... 2026-07-21T09:04:59.259034140Z error: the server doesn't have a resource type "machineconfigs" 2026-07-21T09:04:59.264958856Z No resources found 2026-07-21T09:04:59.269315300Z Wrote inspect data to must-gather. 2026-07-21T09:04:59.337070555Z Wrote inspect data to must-gather. 2026-07-21T09:04:59.343532634Z Wrote inspect data to must-gather. 2026-07-21T09:04:59.344357243Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-07-21T09:04:59.480361210Z error: the server doesn't have a resource type "machineconfigpools" 2026-07-21T09:04:59.512270471Z INFO: Getting rules from prometheus-k8s-0 2026-07-21T09:04:59.538942343Z INFO: 'previous-logs' folder not found on ip-10-0-132-245.ec2.internal, skipping... 2026-07-21T09:04:59.633182661Z Wrote inspect data to must-gather. 2026-07-21T09:04:59.708259592Z Wrote inspect data to must-gather. 2026-07-21T09:04:59.819724418Z INFO: 'previous-logs' folder not found on ip-10-0-141-18.ec2.internal, skipping... 2026-07-21T09:04:59.819758234Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-07-21T09:04:59.819789784Z INFO: Machine Config Daemon termination log collection complete. 2026-07-21T09:04:59.884562575Z error: the server doesn't have a resource type "kubeletconfigs" 2026-07-21T09:04:59.903900172Z Wrote inspect data to must-gather. 2026-07-21T09:04:59.947054194Z INFO: Getting status/config from prometheus-k8s-0 2026-07-21T09:05:00.126972944Z Wrote inspect data to must-gather. 2026-07-21T09:05:00.149318441Z Wrote inspect data to must-gather. 2026-07-21T09:05:00.348075258Z Wrote inspect data to must-gather. 2026-07-21T09:05:00.357232250Z INFO: Getting status/flags from prometheus-k8s-0 2026-07-21T09:05:00.440824244Z INFO: INTERCONNECT MODE 2026-07-21T09:05:00.440862620Z INFO: Gathering ovn-kubernetes DBs 2026-07-21T09:05:00.573277873Z Wrote inspect data to must-gather. 2026-07-21T09:05:00.599138500Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-07-21T09:05:00.604368936Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-07-21T09:05:00.608086443Z INFO: Gathering OVN_Northbound from ovnkube-node-dkcr7... 2026-07-21T09:05:00.608258908Z INFO: Gathering OVN_Northbound from ovnkube-node-s24rm... 2026-07-21T09:05:00.608466203Z INFO: Gathering OVN_Northbound from ovnkube-node-wc4vp... 2026-07-21T09:05:00.608687657Z INFO: Gathering OVN_Southbound from ovnkube-node-dkcr7... 2026-07-21T09:05:00.608975347Z INFO: Gathering OVN_Southbound from ovnkube-node-s24rm... 2026-07-21T09:05:00.609777405Z INFO: Gathering OVN_Southbound from ovnkube-node-wc4vp... 2026-07-21T09:05:00.908272671Z Wrote inspect data to must-gather. 2026-07-21T09:05:00.971278330Z tar: Removing leading `/' from member names 2026-07-21T09:05:00.974748943Z tar: Removing leading `/' from member names 2026-07-21T09:05:01.006717490Z tar: Removing leading `/' from member names 2026-07-21T09:05:01.010106114Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:01.017123787Z tar: Removing leading `/' from member names 2026-07-21T09:05:01.042411687Z tar: Removing leading `/' from member names 2026-07-21T09:05:01.043255749Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-07-21T09:05:01.044739611Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-07-21T09:05:01.046547540Z tar: Removing leading `/' from member names 2026-07-21T09:05:01.178299265Z Wrote inspect data to must-gather. 2026-07-21T09:05:01.265106959Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:01.267280813Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-07-21T09:05:01.345587916Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-07-21T09:05:01.432177197Z Wrote inspect data to must-gather. 2026-07-21T09:05:01.516040156Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:01.536300502Z INFO: Waiting for network log collection to complete ... 2026-07-21T09:05:01.536351254Z INFO: Waiting for ovnk database copies to complete ... 2026-07-21T09:05:01.536837892Z INFO: Copying ovnk databases complete. 2026-07-21T09:05:01.539026987Z 2.7M must-gather/network_logs/ovnk_database_store 2026-07-21T09:05:01.543135062Z ovnk_database_store/ 2026-07-21T09:05:01.543185568Z ovnk_database_store/ovnkube-node-wc4vp_nbdb 2026-07-21T09:05:01.552998591Z ovnk_database_store/ovnkube-node-dkcr7_nbdb 2026-07-21T09:05:01.559921335Z ovnk_database_store/ovnkube-node-s24rm_nbdb 2026-07-21T09:05:01.567800165Z ovnk_database_store/ovnkube-node-wc4vp_sbdb 2026-07-21T09:05:01.584152419Z ovnk_database_store/ovnkube-node-s24rm_sbdb 2026-07-21T09:05:01.599019600Z ovnk_database_store/ovnkube-node-dkcr7_sbdb 2026-07-21T09:05:01.617897702Z INFO: Network log collection complete. 2026-07-21T09:05:01.663468074Z W0721 09:05:01.663420 1511 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-07-21T09:05:01.670832301Z Wrote inspect data to must-gather. 2026-07-21T09:05:01.737709673Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:01.740780676Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-07-21T09:05:01.748633515Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-21T09:05:01.801284335Z INFO: Getting status from alertmanager-main-0 2026-07-21T09:05:01.959276524Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:01.960333218Z Gathering data for ns/openshift-network-console... 2026-07-21T09:05:01.972016945Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-07-21T09:05:01.974276389Z INFO: Fallback to identify the container image from release info 2026-07-21T09:05:02.168508525Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:02.171827700Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-07-21T09:05:02.412584936Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:02.505668118Z Gathering data for ns/openshift-console-operator... 2026-07-21T09:05:02.652124266Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:02.654177772Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-07-21T09:05:02.806316556Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:02.897137948Z Gathering data for ns/openshift-console... 2026-07-21T09:05:03.002256086Z Wrote inspect data to /must-gather/istio. 2026-07-21T09:05:03.023435934Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bde4d3e6601b1a43249dcefbf210ae783590d4ff5957380d16c78b4d391ee9eb 2026-07-21T09:05:03.157146642Z daemonset.apps/perf-node-gather-daemonset created 2026-07-21T09:05:03.300920012Z Waiting for performance profile collector pods to become ready: 1 2026-07-21T09:05:03.476501580Z Gathering data for ns/openshift-cluster-storage-operator... 2026-07-21T09:05:03.723681050Z Done executing Istio gather script 2026-07-21T09:05:04.015601289Z Gathering data for ns/openshift-dns-operator... 2026-07-21T09:05:04.037876949Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-07-21T09:05:04.354954875Z Gathering data for ns/openshift-dns... 2026-07-21T09:05:04.415782802Z Waiting for performance profile collector pods to become ready: 2 2026-07-21T09:05:05.048227766Z Gathering data for ns/openshift-image-registry... 2026-07-21T09:05:05.529918240Z Gathering data for ns/openshift-ingress-operator... 2026-07-21T09:05:05.537350905Z Waiting for performance profile collector pods to become ready: 3 2026-07-21T09:05:05.850093455Z Gathering data for ns/openshift-ingress... 2026-07-21T09:05:06.167260626Z Gathering data for ns/openshift-ingress-canary... 2026-07-21T09:05:06.590298223Z Gathering data for ns/openshift-insights... 2026-07-21T09:05:06.650536219Z Waiting for performance profile collector pods to become ready: 4 2026-07-21T09:05:07.762930162Z Waiting for performance profile collector pods to become ready: 5 2026-07-21T09:05:08.556760767Z Gathering data for ns/openshift-jobset-operator... 2026-07-21T09:05:08.893947035Z Waiting for performance profile collector pods to become ready: 6 2026-07-21T09:05:09.042662594Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-07-21T09:05:09.344665393Z Gathering data for ns/openshift-config... 2026-07-21T09:05:09.622538757Z Gathering data for ns/openshift-config-managed... 2026-07-21T09:05:10.008575972Z Waiting for performance profile collector pods to become ready: 7 2026-07-21T09:05:10.096255159Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-07-21T09:05:10.405440307Z Gathering data for ns/openshift-kube-apiserver... 2026-07-21T09:05:10.675739851Z Gathering data for ns/openshift-kube-controller-manager... 2026-07-21T09:05:11.029159454Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-07-21T09:05:11.135019965Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-07-21T09:05:11.354177678Z Gathering data for ns/openshift-kube-scheduler... 2026-07-21T09:05:11.387781182Z Collecting performance related data for node ip-10-0-132-245.ec2.internal 2026-07-21T09:05:11.397228779Z Collecting performance related data for node ip-10-0-141-18.ec2.internal 2026-07-21T09:05:11.410562582Z Collecting performance related data for node ip-10-0-128-156.ec2.internal 2026-07-21T09:05:11.643464423Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-07-21T09:05:11.979956378Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-07-21T09:05:12.384567628Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-07-21T09:05:12.788256522Z Gathering data for ns/openshift-user-workload-monitoring... 2026-07-21T09:05:13.341111515Z Gathering data for ns/openshift-multus... 2026-07-21T09:05:14.047603310Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-07-21T09:05:15.353094044Z Gathering data for ns/openshift-ovn-kubernetes... 2026-07-21T09:05:16.692698562Z Gathering data for ns/openshift-host-network... 2026-07-21T09:05:17.020611080Z Gathering data for ns/openshift-network-diagnostics... 2026-07-21T09:05:17.714294386Z Gathering data for ns/openshift-network-node-identity... 2026-07-21T09:05:18.119317121Z Gathering data for ns/openshift-network-operator... 2026-07-21T09:05:18.500764604Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-07-21T09:05:18.776479000Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-07-21T09:05:19.052254588Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70 2026-07-21T09:05:19.294815329Z Gathering data for ns/openshift-apiserver-operator... 2026-07-21T09:05:19.588573295Z Gathering data for ns/openshift-apiserver... 2026-07-21T09:05:19.660167447Z Collecting kubelet logs for node ip-10-0-132-245.ec2.internal 2026-07-21T09:05:19.661918806Z Collecting kubelet logs for node ip-10-0-141-18.ec2.internal 2026-07-21T09:05:19.663689841Z Collecting kubelet logs for node ip-10-0-128-156.ec2.internal 2026-07-21T09:05:20.020489424Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-5xdqm namespace 2026-07-21T09:05:20.026803387Z INFO: Node performance data collection complete. 2026-07-21T09:05:20.079760940Z Gathering data for ns/openshift-controller-manager-operator... 2026-07-21T09:05:20.411583486Z Gathering data for ns/openshift-controller-manager... 2026-07-21T09:05:20.698273720Z Gathering data for ns/openshift-cluster-samples-operator... 2026-07-21T09:05:21.349791086Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-07-21T09:05:21.620619287Z Gathering data for ns/openshift-service-ca-operator... 2026-07-21T09:05:21.924132640Z Gathering data for ns/openshift-service-ca... 2026-07-21T09:05:22.281734963Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-07-21T09:05:23.230004916Z Wrote inspect data to must-gather. 2026-07-21T09:05:23.230052885Z error: inspection completed with the errors occurred while gathering data: 2026-07-21T09:05:23.230052885Z skipping gathering secrets/support due to error: secrets "support" not found 2026-07-21T09:05:23.353712051Z error: the server doesn't have a resource type "clusters" 2026-07-21T09:05:23.493190535Z Caches written to disk