2026-10-30T22:44:35.063740704Z [disk usage checker] Started 2026-10-30T22:44:35.067076672Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-10-30T22:44:35.284406018Z Gathering data for ns/openshift-cluster-version... 2026-10-30T22:44:35.429441692Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-30T22:44:35.523339814Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-30T22:44:35.641019010Z Gathering data for ns/default... 2026-10-30T22:44:35.988425441Z Gathering data for ns/openshift... 2026-10-30T22:44:36.462198676Z Gathering data for ns/kube-system... 2026-10-30T22:44:37.443823460Z Gathering data for ns/openshift-etcd... 2026-10-30T22:44:37.820379009Z Wrote inspect data to must-gather. 2026-10-30T22:44:37.820411363Z error: inspection completed with the errors occurred while gathering data: 2026-10-30T22:44:37.820411363Z namespaces "assisted-installer" not found 2026-10-30T22:44:37.951743003Z Waiting on subprocesses to finish execution. 2026-10-30T22:44:37.960458739Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-10-30T22:44:37.966363042Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-10-30T22:44:37.966608417Z INFO: Gathering machine config daemon's old logs from all nodes 2026-10-30T22:44:37.972582491Z Executing Istio gather script 2026-10-30T22:44:37.973097130Z INFO: Gathering HAProxy config files 2026-10-30T22:44:38.002056383Z INFO: Collecting host service logs for crio 2026-10-30T22:44:38.002455971Z INFO: Collecting host service logs for kubelet 2026-10-30T22:44:38.002898871Z INFO: Collecting host service logs for rpm-ostreed 2026-10-30T22:44:38.003612427Z INFO: Collecting host service logs for ostree-finalize-staged 2026-10-30T22:44:38.004301735Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-10-30T22:44:38.004988388Z INFO: Collecting host service logs for machine-config-daemon-host 2026-10-30T22:44:38.005666565Z INFO: Collecting host service logs for NetworkManager 2026-10-30T22:44:38.006941961Z INFO: Collecting host service logs for openvswitch 2026-10-30T22:44:38.007431796Z INFO: Collecting host service logs for ovs-configuration 2026-10-30T22:44:38.008190608Z INFO: Collecting host service logs for ovsdb-server 2026-10-30T22:44:38.008981851Z INFO: Collecting host service logs for ovs-vswitchd 2026-10-30T22:44:38.009756900Z INFO: Waiting for worker host service log collection to complete ... 2026-10-30T22:44:38.013467500Z INFO: Waiting for node performance related collection to complete ... 2026-10-30T22:44:38.516144131Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-10-30T22:44:38.681264404Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-10-30T22:44:38.900213660Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-10-30T22:44:38.900319087Z INFO: on-disk MachineConfig config collection complete. 2026-10-30T22:44:38.926742486Z INFO: "metallb-operator" not detected. Skipping. 2026-10-30T22:44:38.990464421Z INFO: "nfd" not detected. Skipping. 2026-10-30T22:44:39.167313077Z Wrote inspect data to must-gather. 2026-10-30T22:44:39.210280270Z INFO: "sriov-network-operator" not detected. Skipping. 2026-10-30T22:44:39.213619823Z INFO: Collecting Insights Archives from insights-operator-7c4986d449-frqg6 2026-10-30T22:44:39.213664579Z insights-runtime-extractor-flp69 2026-10-30T22:44:39.213700973Z insights-runtime-extractor-gtn7h 2026-10-30T22:44:39.213721139Z insights-runtime-extractor-rgkfs 2026-10-30T22:44:39.237986397Z No resources found 2026-10-30T22:44:39.484081426Z INFO: Found 1 replicas - prometheus-k8s-0 2026-10-30T22:44:39.492581291Z No resources found in openshift-etcd namespace. 2026-10-30T22:44:39.509064410Z INFO: Waiting for HAProxy config collection to complete ... 2026-10-30T22:44:39.669414671Z INFO: Worker host service log collection to complete. 2026-10-30T22:44:39.684473769Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-10-30T22:44:39.684473769Z See 'oc rsync -h' for help and examples 2026-10-30T22:44:39.714451707Z Wrote inspect data to must-gather. 2026-10-30T22:44:39.736278735Z error: the server doesn't have a resource type "performanceprofile" 2026-10-30T22:44:39.861587335Z ERROR: No running kube-apiserver pods found 2026-10-30T22:44:40.047636253Z INFO: HAProxy config collection complete. 2026-10-30T22:44:40.136398457Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-10-30T22:44:40.449211381Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-10-30T22:44:40.520847639Z Wrote inspect data to must-gather. 2026-10-30T22:44:40.544239845Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-30T22:44:40.599532809Z Gathering data for ns/openshift-cloud-credential-operator... 2026-10-30T22:44:40.658121657Z Wrote inspect data to must-gather. 2026-10-30T22:44:40.738373316Z No resources found 2026-10-30T22:44:40.766069296Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-10-30T22:44:40.873916612Z Wrote inspect data to must-gather. 2026-10-30T22:44:40.937714700Z Wrote inspect data to must-gather. 2026-10-30T22:44:40.946600744Z INFO: 'previous-logs' folder not found on ip-10-0-132-252.us-east-2.compute.internal, skipping... 2026-10-30T22:44:40.948245533Z Wrote inspect data to must-gather. 2026-10-30T22:44:40.973644801Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-30T22:44:41.185031158Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-30T22:44:41.204880409Z error: the server doesn't have a resource type "machineconfigs" 2026-10-30T22:44:41.329035019Z INFO: 'previous-logs' folder not found on ip-10-0-137-4.us-east-2.compute.internal, skipping... 2026-10-30T22:44:41.333551129Z Wrote inspect data to must-gather. 2026-10-30T22:44:41.405720159Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-10-30T22:44:41.455190031Z error: the server doesn't have a resource type "machineconfigpools" 2026-10-30T22:44:41.456935742Z INFO: Getting rules from prometheus-k8s-0 2026-10-30T22:44:41.708422126Z Wrote inspect data to must-gather. 2026-10-30T22:44:41.717801337Z INFO: 'previous-logs' folder not found on ip-10-0-140-139.us-east-2.compute.internal, skipping... 2026-10-30T22:44:41.717904672Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-10-30T22:44:41.717966832Z INFO: Machine Config Daemon termination log collection complete. 2026-10-30T22:44:41.769709392Z Gathering data for ns/openshift-monitoring... 2026-10-30T22:44:41.802345392Z Wrote inspect data to must-gather. 2026-10-30T22:44:41.946233942Z INFO: Getting status/config from prometheus-k8s-0 2026-10-30T22:44:41.992455632Z error: the server doesn't have a resource type "kubeletconfigs" 2026-10-30T22:44:42.012713329Z Wrote inspect data to must-gather. 2026-10-30T22:44:42.251513507Z Wrote inspect data to must-gather. 2026-10-30T22:44:42.354120581Z INFO: LEGACY MODE 2026-10-30T22:44:42.354149432Z INFO: Gathering ovn-kubernetes master data 2026-10-30T22:44:42.373067768Z INFO: Getting status/flags from prometheus-k8s-0 2026-10-30T22:44:42.533401824Z Wrote inspect data to must-gather. 2026-10-30T22:44:42.615061610Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-10-30T22:44:42.777851124Z Wrote inspect data to must-gather. 2026-10-30T22:44:42.844004116Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-10-30T22:44:43.040775768Z Inspecting resource crd/backendtlspolicies.gateway.networking.k8s.io 2026-10-30T22:44:43.046736695Z Wrote inspect data to must-gather. 2026-10-30T22:44:43.163409767Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-10-30T22:44:43.263478629Z INFO: Waiting for network log collection to complete ... 2026-10-30T22:44:43.263512029Z INFO: Waiting for ovnk database copies to complete ... 2026-10-30T22:44:43.263940572Z INFO: Copying ovnk databases complete. 2026-10-30T22:44:43.265907491Z du: cannot access 'must-gather/network_logs/ovnk_database_store': No such file or directory 2026-10-30T22:44:43.266477186Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 768 is not a child of this shell 2026-10-30T22:44:43.266510833Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 769 is not a child of this shell 2026-10-30T22:44:43.266533930Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 770 is not a child of this shell 2026-10-30T22:44:43.266556953Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 771 is not a child of this shell 2026-10-30T22:44:43.266578132Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 772 is not a child of this shell 2026-10-30T22:44:43.266600256Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 773 is not a child of this shell 2026-10-30T22:44:43.266622222Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 774 is not a child of this shell 2026-10-30T22:44:43.266644384Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 775 is not a child of this shell 2026-10-30T22:44:43.266666064Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 805 is not a child of this shell 2026-10-30T22:44:43.266688464Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 806 is not a child of this shell 2026-10-30T22:44:43.266710483Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 807 is not a child of this shell 2026-10-30T22:44:43.266731945Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 808 is not a child of this shell 2026-10-30T22:44:43.266753712Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 809 is not a child of this shell 2026-10-30T22:44:43.268125659Z tar: ovnk_database_store: Cannot stat: No such file or directory 2026-10-30T22:44:43.274516093Z tar: Exiting with failure status due to previous errors 2026-10-30T22:44:43.275133668Z INFO: Network log collection complete. 2026-10-30T22:44:43.283555971Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:43.332874062Z Wrote inspect data to must-gather. 2026-10-30T22:44:43.529821688Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:43.532852524Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-10-30T22:44:43.586561795Z INFO: Getting status from alertmanager-main-0 2026-10-30T22:44:43.598820411Z Wrote inspect data to must-gather. 2026-10-30T22:44:43.735901114Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:43.847037784Z Wrote inspect data to must-gather. 2026-10-30T22:44:43.955699726Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:43.958889209Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-10-30T22:44:44.156249714Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:44.181966688Z INFO: Hosted cluster detected, get NTO container image from the TuneD pod 2026-10-30T22:44:44.334732242Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c 2026-10-30T22:44:44.389488215Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:44.393790244Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-10-30T22:44:44.395090811Z Gathering data for ns/openshift-network-console... 2026-10-30T22:44:44.484209961Z daemonset.apps/perf-node-gather-daemonset created 2026-10-30T22:44:44.598779121Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:44.634618918Z Waiting for performance profile collector pods to become ready: 1 2026-10-30T22:44:44.815324275Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:44.818762278Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-10-30T22:44:44.961938948Z Gathering data for ns/openshift-console-operator... 2026-10-30T22:44:45.089648660Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:45.249696467Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-10-30T22:44:45.292065370Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:45.295676261Z Inspecting resource crd/inferencepools.inference.networking.k8s.io 2026-10-30T22:44:45.407638258Z Gathering data for ns/openshift-console... 2026-10-30T22:44:45.470690325Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:45.681480564Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:45.685530283Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io 2026-10-30T22:44:45.779136056Z Waiting for performance profile collector pods to become ready: 2 2026-10-30T22:44:45.877383561Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:45.984243154Z Gathering data for ns/openshift-cluster-storage-operator... 2026-10-30T22:44:46.081528077Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:46.084888655Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-10-30T22:44:46.253897639Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:46.478939484Z Wrote inspect data to /must-gather/istio. 2026-10-30T22:44:46.560713475Z Gathering data for ns/openshift-dns-operator... 2026-10-30T22:44:46.923821411Z Waiting for performance profile collector pods to become ready: 3 2026-10-30T22:44:46.958385669Z Gathering data for ns/openshift-dns... 2026-10-30T22:44:47.363697399Z Done executing Istio gather script 2026-10-30T22:44:47.789961881Z Gathering data for ns/openshift-image-registry... 2026-10-30T22:44:48.064292128Z Waiting for performance profile collector pods to become ready: 4 2026-10-30T22:44:48.346965595Z Gathering data for ns/openshift-ingress-operator... 2026-10-30T22:44:48.688751657Z Gathering data for ns/openshift-ingress... 2026-10-30T22:44:49.061179575Z Gathering data for ns/openshift-ingress-canary... 2026-10-30T22:44:49.181241269Z Waiting for performance profile collector pods to become ready: 5 2026-10-30T22:44:49.559021726Z Gathering data for ns/openshift-insights... 2026-10-30T22:44:50.254947512Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-10-30T22:44:50.314513953Z Waiting for performance profile collector pods to become ready: 6 2026-10-30T22:44:51.460473758Z Waiting for performance profile collector pods to become ready: 7 2026-10-30T22:44:52.279765765Z Gathering data for ns/kserve... 2026-10-30T22:44:52.585195864Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-10-30T22:44:52.845518521Z Collecting performance related data for node ip-10-0-132-252.us-east-2.compute.internal 2026-10-30T22:44:52.852781099Z Collecting performance related data for node ip-10-0-137-4.us-east-2.compute.internal 2026-10-30T22:44:52.861255251Z Collecting performance related data for node ip-10-0-140-139.us-east-2.compute.internal 2026-10-30T22:44:54.247752961Z Gathering data for ns/openshift-config... 2026-10-30T22:44:54.610582440Z Gathering data for ns/openshift-config-managed... 2026-10-30T22:44:55.031115020Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-10-30T22:44:55.259703186Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-10-30T22:44:55.392361107Z Gathering data for ns/openshift-kube-apiserver... 2026-10-30T22:44:55.769931573Z Gathering data for ns/openshift-kube-controller-manager... 2026-10-30T22:44:56.082107424Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-10-30T22:44:56.420353804Z Gathering data for ns/openshift-kube-scheduler... 2026-10-30T22:44:56.707734557Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-10-30T22:44:57.069916273Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-10-30T22:44:57.424265931Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-10-30T22:44:57.750998862Z Gathering data for ns/openshift-user-workload-monitoring... 2026-10-30T22:44:58.260567871Z Gathering data for ns/openshift-multus... 2026-10-30T22:44:59.885052948Z Gathering data for ns/openshift-ovn-kubernetes... 2026-10-30T22:45:00.067962288Z Collecting kubelet logs for node ip-10-0-132-252.us-east-2.compute.internal 2026-10-30T22:45:00.070027724Z Collecting kubelet logs for node ip-10-0-137-4.us-east-2.compute.internal 2026-10-30T22:45:00.072493724Z Collecting kubelet logs for node ip-10-0-140-139.us-east-2.compute.internal 2026-10-30T22:45:00.264670959Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-10-30T22:45:00.491948118Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-s6gzr namespace 2026-10-30T22:45:00.497847329Z INFO: Node performance data collection complete. 2026-10-30T22:45:01.384463074Z Gathering data for ns/openshift-host-network... 2026-10-30T22:45:01.769787524Z Gathering data for ns/openshift-network-diagnostics... 2026-10-30T22:45:02.396064140Z Gathering data for ns/openshift-network-node-identity... 2026-10-30T22:45:02.907750653Z Gathering data for ns/openshift-network-operator... 2026-10-30T22:45:03.312637977Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-10-30T22:45:03.645030324Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-10-30T22:45:04.146897165Z Gathering data for ns/openshift-apiserver-operator... 2026-10-30T22:45:04.452538964Z Gathering data for ns/openshift-apiserver... 2026-10-30T22:45:04.849018968Z Gathering data for ns/openshift-controller-manager-operator... 2026-10-30T22:45:05.136457237Z Gathering data for ns/openshift-controller-manager... 2026-10-30T22:45:05.269202201Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70 2026-10-30T22:45:05.476695222Z Gathering data for ns/openshift-cluster-samples-operator... 2026-10-30T22:45:06.171278143Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-10-30T22:45:06.488761874Z Gathering data for ns/openshift-service-ca-operator... 2026-10-30T22:45:06.816161394Z Gathering data for ns/openshift-service-ca... 2026-10-30T22:45:07.183253984Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-10-30T22:45:08.133739855Z Wrote inspect data to must-gather. 2026-10-30T22:45:08.133785494Z error: inspection completed with the errors occurred while gathering data: 2026-10-30T22:45:08.133785494Z skipping gathering secrets/support due to error: secrets "support" not found 2026-10-30T22:45:08.265030259Z error: the server doesn't have a resource type "clusters" 2026-10-30T22:45:08.413649137Z Caches written to disk