2026-07-01T19:03:15.535595706Z [disk usage checker] Started 2026-07-01T19:03:15.538660380Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-07-01T19:03:15.720600705Z Gathering data for ns/openshift-cluster-version... 2026-07-01T19:03:15.840989005Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-07-01T19:03:15.927716956Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-01T19:03:16.008348492Z Gathering data for ns/default... 2026-07-01T19:03:16.286393868Z Gathering data for ns/openshift... 2026-07-01T19:03:16.659441192Z Gathering data for ns/kube-system... 2026-07-01T19:03:17.327321788Z Gathering data for ns/openshift-etcd... 2026-07-01T19:03:17.615658887Z Wrote inspect data to must-gather. 2026-07-01T19:03:17.615718612Z error: inspection completed with the errors occurred while gathering data: 2026-07-01T19:03:17.615718612Z namespaces "assisted-installer" not found 2026-07-01T19:03:17.919726312Z Waiting on subprocesses to finish execution. 2026-07-01T19:03:17.933409435Z INFO: Gathering HAProxy config files 2026-07-01T19:03:17.934605054Z INFO: Collecting host service logs for crio 2026-07-01T19:03:17.935049964Z INFO: Collecting host service logs for kubelet 2026-07-01T19:03:17.935385069Z INFO: Collecting host service logs for rpm-ostreed 2026-07-01T19:03:17.935744646Z INFO: Collecting host service logs for ostree-finalize-staged 2026-07-01T19:03:17.936096445Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-07-01T19:03:17.936446900Z INFO: Collecting host service logs for machine-config-daemon-host 2026-07-01T19:03:17.936919947Z INFO: Collecting host service logs for NetworkManager 2026-07-01T19:03:17.937266626Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-07-01T19:03:17.937329454Z INFO: Collecting host service logs for openvswitch 2026-07-01T19:03:17.937695108Z INFO: Collecting host service logs for ovs-configuration 2026-07-01T19:03:17.938159888Z INFO: Collecting host service logs for ovsdb-server 2026-07-01T19:03:17.938545766Z INFO: Collecting host service logs for ovs-vswitchd 2026-07-01T19:03:17.938921684Z Executing Istio gather script 2026-07-01T19:03:17.939051763Z INFO: Waiting for worker host service log collection to complete ... 2026-07-01T19:03:17.939646695Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-07-01T19:03:17.944057260Z INFO: Gathering machine config daemon's old logs from all nodes 2026-07-01T19:03:18.022706012Z INFO: Waiting for node performance related collection to complete ... 2026-07-01T19:03:18.293194687Z No resources found in openshift-etcd namespace. 2026-07-01T19:03:18.422398309Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-07-01T19:03:18.599668950Z INFO: Found 1 replicas - prometheus-k8s-0 2026-07-01T19:03:18.697533927Z error: the server doesn't have a resource type "performanceprofile" 2026-07-01T19:03:18.791095724Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-07-01T19:03:18.947853666Z INFO: "metallb-operator" not detected. Skipping. 2026-07-01T19:03:19.023522526Z No resources found 2026-07-01T19:03:19.070163707Z INFO: Collecting Insights Archives from insights-operator-5f67b55555-rfsv7 2026-07-01T19:03:19.070163707Z insights-runtime-extractor-dfd5r 2026-07-01T19:03:19.070163707Z insights-runtime-extractor-m979x 2026-07-01T19:03:19.070163707Z insights-runtime-extractor-tdt8g 2026-07-01T19:03:19.191495319Z INFO: "sriov-network-operator" not detected. Skipping. 2026-07-01T19:03:19.313458408Z INFO: Waiting for HAProxy config collection to complete ... 2026-07-01T19:03:19.338771371Z ERROR: No running kube-apiserver pods found 2026-07-01T19:03:19.371259822Z Wrote inspect data to must-gather. 2026-07-01T19:03:19.420126600Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-07-01T19:03:19.430365503Z INFO: Worker host service log collection to complete. 2026-07-01T19:03:19.503813017Z Wrote inspect data to must-gather. 2026-07-01T19:03:19.540339181Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-07-01T19:03:19.540453567Z INFO: on-disk MachineConfig config collection complete. 2026-07-01T19:03:19.808437072Z tar: Removing leading `/' from member names 2026-07-01T19:03:19.818236394Z INFO: HAProxy config collection complete. 2026-07-01T19:03:19.889860025Z INFO: 'previous-logs' folder not found on ip-10-0-128-242.ec2.internal, skipping... 2026-07-01T19:03:20.012916721Z No resources found 2026-07-01T19:03:20.074656920Z error: the server doesn't have a resource type "machineconfigs" 2026-07-01T19:03:20.100618545Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-07-01T19:03:20.100618545Z See 'oc rsync -h' for help and examples 2026-07-01T19:03:20.180958487Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-01T19:03:20.187705977Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-07-01T19:03:20.223612190Z Wrote inspect data to must-gather. 2026-07-01T19:03:20.253635406Z Wrote inspect data to must-gather. 2026-07-01T19:03:20.271786172Z Wrote inspect data to must-gather. 2026-07-01T19:03:20.362560954Z Wrote inspect data to must-gather. 2026-07-01T19:03:20.385481539Z Gathering data for ns/openshift-monitoring... 2026-07-01T19:03:20.399754730Z Wrote inspect data to must-gather. 2026-07-01T19:03:20.497989872Z INFO: 'previous-logs' folder not found on ip-10-0-129-92.ec2.internal, skipping... 2026-07-01T19:03:20.517409486Z error: the server doesn't have a resource type "machineconfigpools" 2026-07-01T19:03:20.555611376Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-07-01T19:03:20.568819326Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-07-01T19:03:20.582789644Z Wrote inspect data to must-gather. 2026-07-01T19:03:20.759632065Z Wrote inspect data to must-gather. 2026-07-01T19:03:20.763445050Z INFO: Getting rules from prometheus-k8s-0 2026-07-01T19:03:20.778388779Z INFO: 'previous-logs' folder not found on ip-10-0-134-213.ec2.internal, skipping... 2026-07-01T19:03:20.778435374Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-07-01T19:03:20.778483767Z INFO: Machine Config Daemon termination log collection complete. 2026-07-01T19:03:20.853073568Z Wrote inspect data to must-gather. 2026-07-01T19:03:20.914807501Z error: the server doesn't have a resource type "kubeletconfigs" 2026-07-01T19:03:21.098939408Z Wrote inspect data to must-gather. 2026-07-01T19:03:21.108598110Z Wrote inspect data to must-gather. 2026-07-01T19:03:21.128002676Z INFO: Getting status/config from prometheus-k8s-0 2026-07-01T19:03:21.313947512Z Wrote inspect data to must-gather. 2026-07-01T19:03:21.374125648Z INFO: INTERCONNECT MODE 2026-07-01T19:03:21.374125648Z INFO: Gathering ovn-kubernetes DBs 2026-07-01T19:03:21.506713351Z Wrote inspect data to must-gather. 2026-07-01T19:03:21.511730441Z INFO: Getting status/flags from prometheus-k8s-0 2026-07-01T19:03:21.536242679Z INFO: Gathering OVN_Northbound from ovnkube-node-225pk... 2026-07-01T19:03:21.536536075Z INFO: Gathering OVN_Northbound from ovnkube-node-hl4w4... 2026-07-01T19:03:21.536828031Z INFO: Gathering OVN_Northbound from ovnkube-node-xk268... 2026-07-01T19:03:21.537127585Z INFO: Gathering OVN_Southbound from ovnkube-node-225pk... 2026-07-01T19:03:21.537415426Z INFO: Gathering OVN_Southbound from ovnkube-node-hl4w4... 2026-07-01T19:03:21.537717870Z INFO: Gathering OVN_Southbound from ovnkube-node-xk268... 2026-07-01T19:03:21.551960414Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-07-01T19:03:21.845998021Z tar: Removing leading `/' from member names 2026-07-01T19:03:21.884096626Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-07-01T19:03:21.886739663Z tar: Removing leading `/' from member names 2026-07-01T19:03:21.893177788Z Wrote inspect data to must-gather. 2026-07-01T19:03:21.893458240Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:21.899049056Z tar: Removing leading `/' from member names 2026-07-01T19:03:21.929152185Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ 2026-07-01T19:03:21.934064916Z tar: Removing leading `/' from member names 2026-07-01T19:03:21.935548878Z tar: Removing leading `/' from member names 2026-07-01T19:03:21.948022744Z tar: Removing leading `/' from member names 2026-07-01T19:03:22.118527795Z Wrote inspect data to must-gather. 2026-07-01T19:03:22.125854164Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:22.129371692Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-07-01T19:03:22.130237357Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-07-01T19:03:22.333863204Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:22.346625565Z Wrote inspect data to must-gather. 2026-07-01T19:03:22.377461404Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-07-01T19:03:22.387332938Z INFO: Waiting for network log collection to complete ... 2026-07-01T19:03:22.387390576Z INFO: Waiting for ovnk database copies to complete ... 2026-07-01T19:03:22.387986066Z INFO: Copying ovnk databases complete. 2026-07-01T19:03:22.389892648Z 2.6M must-gather/network_logs/ovnk_database_store 2026-07-01T19:03:22.392344452Z ovnk_database_store/ 2026-07-01T19:03:22.392344452Z ovnk_database_store/ovnkube-node-xk268_sbdb 2026-07-01T19:03:22.417849866Z ovnk_database_store/ovnkube-node-225pk_sbdb 2026-07-01T19:03:22.439800243Z ovnk_database_store/ovnkube-node-225pk_nbdb 2026-07-01T19:03:22.446112337Z ovnk_database_store/ovnkube-node-xk268_nbdb 2026-07-01T19:03:22.454255759Z ovnk_database_store/ovnkube-node-hl4w4_nbdb 2026-07-01T19:03:22.462595061Z ovnk_database_store/ovnkube-node-hl4w4_sbdb 2026-07-01T19:03:22.484174786Z INFO: Network log collection complete. 2026-07-01T19:03:22.549133454Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:22.551299833Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-07-01T19:03:22.561015337Z W0701 19:03:22.560981 1499 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in '' 2026-07-01T19:03:22.568267033Z Wrote inspect data to must-gather. 2026-07-01T19:03:22.602977558Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-07-01T19:03:22.739180115Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:22.749345057Z INFO: Getting status from alertmanager-main-0 2026-07-01T19:03:22.799789889Z Gathering data for ns/openshift-network-console... 2026-07-01T19:03:22.849213866Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found 2026-07-01T19:03:22.853733282Z INFO: Fallback to identify the container image from release info 2026-07-01T19:03:22.948120799Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:22.951408563Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-07-01T19:03:23.141814961Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:23.228003654Z Gathering data for ns/openshift-console-operator... 2026-07-01T19:03:23.321370970Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:23.323540608Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-07-01T19:03:23.432416961Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2c4f9949a07a5338dd10a5abcb8d6d3f5eebe93333139869f9eec8802800162f 2026-07-01T19:03:23.479918430Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:23.558333598Z daemonset.apps/perf-node-gather-daemonset created 2026-07-01T19:03:23.652281107Z Gathering data for ns/openshift-console... 2026-07-01T19:03:23.675884201Z Wrote inspect data to /must-gather/istio. 2026-07-01T19:03:23.687280013Z Waiting for performance profile collector pods to become ready: 1 2026-07-01T19:03:24.206053371Z Gathering data for ns/openshift-cluster-storage-operator... 2026-07-01T19:03:24.301828599Z Done executing Istio gather script 2026-07-01T19:03:24.669602701Z Gathering data for ns/openshift-dns-operator... 2026-07-01T19:03:24.796612340Z Waiting for performance profile collector pods to become ready: 2 2026-07-01T19:03:24.980003132Z Gathering data for ns/openshift-dns... 2026-07-01T19:03:25.514181257Z Gathering data for ns/openshift-image-registry... 2026-07-01T19:03:25.560958463Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-07-01T19:03:25.907643312Z Waiting for performance profile collector pods to become ready: 3 2026-07-01T19:03:25.983298392Z Gathering data for ns/openshift-ingress-operator... 2026-07-01T19:03:26.273494472Z Gathering data for ns/openshift-ingress... 2026-07-01T19:03:26.564278044Z Gathering data for ns/openshift-ingress-canary... 2026-07-01T19:03:26.962212361Z Gathering data for ns/openshift-insights... 2026-07-01T19:03:27.015620683Z Waiting for performance profile collector pods to become ready: 4 2026-07-01T19:03:28.121163270Z Waiting for performance profile collector pods to become ready: 5 2026-07-01T19:03:28.724228894Z Gathering data for ns/openshift-config... 2026-07-01T19:03:29.014574947Z Gathering data for ns/openshift-config-managed... 2026-07-01T19:03:29.230834415Z Waiting for performance profile collector pods to become ready: 6 2026-07-01T19:03:29.414853456Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-07-01T19:03:29.704780280Z Gathering data for ns/openshift-kube-apiserver... 2026-07-01T19:03:30.002235273Z Gathering data for ns/openshift-kube-controller-manager... 2026-07-01T19:03:30.286573085Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-07-01T19:03:30.359977652Z Waiting for performance profile collector pods to become ready: 7 2026-07-01T19:03:30.543162733Z Gathering data for ns/openshift-kube-scheduler... 2026-07-01T19:03:30.567234588Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-07-01T19:03:30.839775865Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-07-01T19:03:31.108451390Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-07-01T19:03:31.394437549Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-07-01T19:03:31.480364016Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-07-01T19:03:31.708874910Z Collecting performance related data for node ip-10-0-129-92.ec2.internal 2026-07-01T19:03:31.715896215Z Collecting performance related data for node ip-10-0-134-213.ec2.internal 2026-07-01T19:03:31.729829436Z Collecting performance related data for node ip-10-0-128-242.ec2.internal 2026-07-01T19:03:31.752835790Z Gathering data for ns/openshift-user-workload-monitoring... 2026-07-01T19:03:32.320026441Z Gathering data for ns/openshift-multus... 2026-07-01T19:03:33.634072867Z Gathering data for ns/openshift-ovn-kubernetes... 2026-07-01T19:03:34.768529157Z Gathering data for ns/openshift-host-network... 2026-07-01T19:03:35.071165640Z Gathering data for ns/openshift-network-diagnostics... 2026-07-01T19:03:35.572738273Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-07-01T19:03:35.585395161Z Gathering data for ns/openshift-network-node-identity... 2026-07-01T19:03:35.969027648Z Gathering data for ns/openshift-network-operator... 2026-07-01T19:03:36.342648783Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-07-01T19:03:36.597748810Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-07-01T19:03:37.141133039Z Gathering data for ns/openshift-apiserver-operator... 2026-07-01T19:03:37.479803869Z Gathering data for ns/openshift-apiserver... 2026-07-01T19:03:37.827803982Z Gathering data for ns/openshift-controller-manager-operator... 2026-07-01T19:03:38.089262081Z Gathering data for ns/openshift-controller-manager... 2026-07-01T19:03:38.354606324Z Gathering data for ns/openshift-cluster-samples-operator... 2026-07-01T19:03:38.993941786Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-07-01T19:03:39.233118452Z Collecting kubelet logs for node ip-10-0-129-92.ec2.internal 2026-07-01T19:03:39.235414179Z Collecting kubelet logs for node ip-10-0-134-213.ec2.internal 2026-07-01T19:03:39.237560676Z Collecting kubelet logs for node ip-10-0-128-242.ec2.internal 2026-07-01T19:03:39.274524114Z Gathering data for ns/openshift-service-ca-operator... 2026-07-01T19:03:39.571950364Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-rbv4m namespace 2026-07-01T19:03:39.575933917Z INFO: Node performance data collection complete. 2026-07-01T19:03:39.633104721Z Gathering data for ns/openshift-service-ca... 2026-07-01T19:03:40.010717310Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-07-01T19:03:40.578283386Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-07-01T19:03:40.838366521Z Wrote inspect data to must-gather. 2026-07-01T19:03:40.838411151Z error: inspection completed with the errors occurred while gathering data: 2026-07-01T19:03:40.838411151Z skipping gathering secrets/support due to error: secrets "support" not found 2026-07-01T19:03:40.951818345Z error: the server doesn't have a resource type "clusters" 2026-07-01T19:03:41.105144793Z Caches written to disk