2026-06-14T22:18:15.215972925Z [disk usage checker] Started
2026-06-14T22:18:15.219303000Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-14T22:18:15.404417038Z Gathering data for ns/openshift-cluster-version...
2026-06-14T22:18:15.506054750Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-14T22:18:15.582836415Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-14T22:18:15.652150345Z Gathering data for ns/default...
2026-06-14T22:18:15.909120656Z Gathering data for ns/openshift...
2026-06-14T22:18:16.275215419Z Gathering data for ns/kube-system...
2026-06-14T22:18:16.843591162Z Gathering data for ns/openshift-etcd...
2026-06-14T22:18:17.115758396Z Wrote inspect data to must-gather.
2026-06-14T22:18:17.115790361Z error: inspection completed with the errors occurred while gathering data:
2026-06-14T22:18:17.115790361Z     namespaces "assisted-installer" not found
2026-06-14T22:18:17.660274685Z Waiting on subprocesses to finish execution.
2026-06-14T22:18:17.665197005Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-14T22:18:17.669592121Z INFO: Collecting host service logs for crio
2026-06-14T22:18:17.670103450Z INFO: Collecting host service logs for kubelet
2026-06-14T22:18:17.670439686Z INFO: Collecting host service logs for rpm-ostreed
2026-06-14T22:18:17.670759918Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-14T22:18:17.671122472Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-14T22:18:17.671459312Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-14T22:18:17.671473025Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-14T22:18:17.671800846Z INFO: Collecting host service logs for NetworkManager
2026-06-14T22:18:17.672324014Z INFO: Collecting host service logs for openvswitch
2026-06-14T22:18:17.672689925Z INFO: Collecting host service logs for ovs-configuration
2026-06-14T22:18:17.673034481Z INFO: Collecting host service logs for ovsdb-server
2026-06-14T22:18:17.673358108Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-14T22:18:17.673756647Z INFO: Waiting for worker host service log collection to complete ...
2026-06-14T22:18:17.674747355Z INFO: Gathering HAProxy config files
2026-06-14T22:18:17.686559514Z Executing Istio gather script
2026-06-14T22:18:17.725448550Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-14T22:18:17.742695219Z INFO: Waiting for node performance related collection to complete ...
2026-06-14T22:18:18.401211105Z No resources found in openshift-etcd namespace.
2026-06-14T22:18:18.548568320Z error: the server doesn't have a resource type "performanceprofile"
2026-06-14T22:18:18.660787649Z No resources found
2026-06-14T22:18:18.671852892Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-14T22:18:18.678283607Z INFO: Collecting Insights Archives from insights-operator-5bbd86d6bd-sbmd8
2026-06-14T22:18:18.678283607Z insights-runtime-extractor-9d5zv
2026-06-14T22:18:18.678283607Z insights-runtime-extractor-dz6gt
2026-06-14T22:18:18.678283607Z insights-runtime-extractor-mchkl
2026-06-14T22:18:18.739206330Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-14T22:18:18.784404316Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-14T22:18:18.786221366Z Wrote inspect data to must-gather.
2026-06-14T22:18:18.889519437Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-14T22:18:19.082225538Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-14T22:18:19.082337564Z INFO: on-disk MachineConfig config collection complete.
2026-06-14T22:18:19.131722666Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-14T22:18:19.187453065Z Wrote inspect data to must-gather.
2026-06-14T22:18:19.232916330Z INFO: Worker host service log collection to complete.
2026-06-14T22:18:19.261415182Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-14T22:18:19.261415182Z See 'oc rsync -h' for help and examples
2026-06-14T22:18:19.376804860Z INFO: "metallb-operator" not detected. Skipping.
2026-06-14T22:18:19.490835953Z ERROR: No running kube-apiserver pods found
2026-06-14T22:18:19.492726190Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-14T22:18:19.569866903Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-14T22:18:19.694859783Z Wrote inspect data to must-gather.
2026-06-14T22:18:19.861854025Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-14T22:18:19.884552011Z Wrote inspect data to must-gather.
2026-06-14T22:18:19.913419254Z No resources found
2026-06-14T22:18:19.936838165Z INFO: 'previous-logs' folder not found on ip-10-0-130-84.ec2.internal, skipping...
2026-06-14T22:18:19.937106331Z Wrote inspect data to must-gather.
2026-06-14T22:18:19.986906824Z Gathering data for ns/openshift-monitoring...
2026-06-14T22:18:20.001180664Z Wrote inspect data to must-gather.
2026-06-14T22:18:20.056058387Z tar: Removing leading `/' from member names
2026-06-14T22:18:20.063569654Z INFO: HAProxy config collection complete.
2026-06-14T22:18:20.153212907Z Wrote inspect data to must-gather.
2026-06-14T22:18:20.171592296Z error: the server doesn't have a resource type "machineconfigs"
2026-06-14T22:18:20.226845685Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-14T22:18:20.303488590Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-14T22:18:20.306567766Z INFO: 'previous-logs' folder not found on ip-10-0-132-49.ec2.internal, skipping...
2026-06-14T22:18:20.353150511Z INFO: Getting rules from prometheus-k8s-0
2026-06-14T22:18:20.367088958Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-14T22:18:20.450395567Z Wrote inspect data to must-gather.
2026-06-14T22:18:20.600781665Z INFO: 'previous-logs' folder not found on ip-10-0-140-11.ec2.internal, skipping...
2026-06-14T22:18:20.600898962Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-14T22:18:20.600919320Z INFO: Machine Config Daemon termination log collection complete.
2026-06-14T22:18:20.613259566Z Wrote inspect data to must-gather.
2026-06-14T22:18:20.712100297Z Wrote inspect data to must-gather.
2026-06-14T22:18:20.749215265Z INFO: Getting status/config from prometheus-k8s-0
2026-06-14T22:18:20.777918984Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-14T22:18:20.940963806Z Wrote inspect data to must-gather.
2026-06-14T22:18:20.991981526Z Wrote inspect data to must-gather.
2026-06-14T22:18:21.137673529Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-14T22:18:21.176304807Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-14T22:18:21.214780915Z Wrote inspect data to must-gather.
2026-06-14T22:18:21.220103679Z INFO: INTERCONNECT MODE
2026-06-14T22:18:21.220141293Z INFO: Gathering ovn-kubernetes DBs
2026-06-14T22:18:21.376338205Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-14T22:18:21.379323839Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-14T22:18:21.380540202Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:21.390410804Z INFO: Gathering OVN_Northbound from ovnkube-node-2p8gt...
2026-06-14T22:18:21.390731186Z INFO: Gathering OVN_Northbound from ovnkube-node-nrm5k...
2026-06-14T22:18:21.390997462Z INFO: Gathering OVN_Northbound from ovnkube-node-vtkmj...
2026-06-14T22:18:21.391333916Z INFO: Gathering OVN_Southbound from ovnkube-node-2p8gt...
2026-06-14T22:18:21.391636554Z INFO: Gathering OVN_Southbound from ovnkube-node-nrm5k...
2026-06-14T22:18:21.391902664Z INFO: Gathering OVN_Southbound from ovnkube-node-vtkmj...
2026-06-14T22:18:21.465971952Z Wrote inspect data to must-gather.
2026-06-14T22:18:21.668872086Z tar: Removing leading `/' from member names
2026-06-14T22:18:21.713207598Z tar: Removing leading `/' from member names
2026-06-14T22:18:21.714275179Z tar: Removing leading `/' from member names
2026-06-14T22:18:21.716519316Z tar: Removing leading `/' from member names
2026-06-14T22:18:21.747343072Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:21.748229358Z tar: Removing leading `/' from member names
2026-06-14T22:18:21.752073983Z tar: Removing leading `/' from member names
2026-06-14T22:18:21.752982712Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-14T22:18:21.755400045Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-14T22:18:21.822873418Z Wrote inspect data to must-gather.
2026-06-14T22:18:21.986249584Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:22.020230424Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-14T22:18:22.074539523Z W0614 22:18:22.074495    1436 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-14T22:18:22.080553085Z Wrote inspect data to must-gather.
2026-06-14T22:18:22.202321434Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-14T22:18:22.234909712Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:22.237587991Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-14T22:18:22.237689798Z INFO: Waiting for network log collection to complete ...
2026-06-14T22:18:22.237734626Z INFO: Waiting for ovnk database copies to complete ...
2026-06-14T22:18:22.238221480Z INFO: Copying ovnk databases complete.
2026-06-14T22:18:22.240183279Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-06-14T22:18:22.242989808Z ovnk_database_store/
2026-06-14T22:18:22.242989808Z ovnk_database_store/ovnkube-node-vtkmj_sbdb
2026-06-14T22:18:22.259904734Z ovnk_database_store/ovnkube-node-2p8gt_nbdb
2026-06-14T22:18:22.268031258Z ovnk_database_store/ovnkube-node-nrm5k_nbdb
2026-06-14T22:18:22.274952450Z ovnk_database_store/ovnkube-node-nrm5k_sbdb
2026-06-14T22:18:22.291819375Z ovnk_database_store/ovnkube-node-vtkmj_nbdb
2026-06-14T22:18:22.298938769Z ovnk_database_store/ovnkube-node-2p8gt_sbdb
2026-06-14T22:18:22.319427827Z INFO: Network log collection complete.
2026-06-14T22:18:22.394110271Z Gathering data for ns/openshift-network-console...
2026-06-14T22:18:22.408687404Z Wrote inspect data to must-gather.
2026-06-14T22:18:22.422659586Z INFO: Getting status from alertmanager-main-0
2026-06-14T22:18:22.439521604Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:22.656177883Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:22.659531909Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-14T22:18:22.712140772Z Wrote inspect data to must-gather.
2026-06-14T22:18:22.827605023Z Gathering data for ns/openshift-console-operator...
2026-06-14T22:18:22.881096986Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:22.971954791Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-14T22:18:22.973927945Z INFO: Fallback to identify the container image from release info
2026-06-14T22:18:23.081558782Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:23.084276353Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-14T22:18:23.194629799Z Gathering data for ns/openshift-console...
2026-06-14T22:18:23.240567294Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:23.417459502Z Wrote inspect data to /must-gather/istio.
2026-06-14T22:18:23.680670791Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d66a6b2ec52dede5d83ce04f6abfc519df1fd7dc36248741e03ecb9bf8d1762
2026-06-14T22:18:23.688426685Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-14T22:18:23.828661062Z daemonset.apps/perf-node-gather-daemonset created
2026-06-14T22:18:23.960154716Z Waiting for performance profile collector pods to become ready: 1
2026-06-14T22:18:24.090146470Z Done executing Istio gather script
2026-06-14T22:18:24.193250700Z Gathering data for ns/openshift-dns-operator...
2026-06-14T22:18:24.536736203Z Gathering data for ns/openshift-dns...
2026-06-14T22:18:25.079535453Z Gathering data for ns/openshift-image-registry...
2026-06-14T22:18:25.083770549Z Waiting for performance profile collector pods to become ready: 2
2026-06-14T22:18:25.231769279Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-14T22:18:25.476732838Z Gathering data for ns/openshift-ingress-operator...
2026-06-14T22:18:25.751302762Z Gathering data for ns/openshift-ingress...
2026-06-14T22:18:26.040720164Z Gathering data for ns/openshift-ingress-canary...
2026-06-14T22:18:26.204430222Z Waiting for performance profile collector pods to become ready: 3
2026-06-14T22:18:26.398555317Z Gathering data for ns/openshift-insights...
2026-06-14T22:18:27.310289723Z Waiting for performance profile collector pods to become ready: 4
2026-06-14T22:18:28.131102156Z Gathering data for ns/openshift-config...
2026-06-14T22:18:28.354030225Z Gathering data for ns/openshift-config-managed...
2026-06-14T22:18:28.433428136Z Waiting for performance profile collector pods to become ready: 5
2026-06-14T22:18:28.731511073Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-14T22:18:29.005077552Z Gathering data for ns/openshift-kube-apiserver...
2026-06-14T22:18:29.228988998Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-14T22:18:29.472133170Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-14T22:18:29.556522827Z Waiting for performance profile collector pods to become ready: 6
2026-06-14T22:18:29.723078555Z Gathering data for ns/openshift-kube-scheduler...
2026-06-14T22:18:29.943202373Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-14T22:18:30.200446437Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-14T22:18:30.236556228Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-14T22:18:30.475685031Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-14T22:18:30.663873920Z Waiting for performance profile collector pods to become ready: 7
2026-06-14T22:18:30.756299160Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-14T22:18:31.261433532Z Gathering data for ns/openshift-multus...
2026-06-14T22:18:31.760969571Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-14T22:18:31.987593411Z Collecting performance related data for node ip-10-0-130-84.ec2.internal
2026-06-14T22:18:31.994430993Z Collecting performance related data for node ip-10-0-140-11.ec2.internal
2026-06-14T22:18:32.001443824Z Collecting performance related data for node ip-10-0-132-49.ec2.internal
2026-06-14T22:18:32.616783247Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-14T22:18:33.822104550Z Gathering data for ns/openshift-host-network...
2026-06-14T22:18:34.096898667Z Gathering data for ns/openshift-network-diagnostics...
2026-06-14T22:18:34.600379709Z Gathering data for ns/openshift-network-node-identity...
2026-06-14T22:18:34.959253364Z Gathering data for ns/openshift-network-operator...
2026-06-14T22:18:35.242688810Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-14T22:18:35.294047390Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-14T22:18:35.528700190Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-14T22:18:35.970821801Z Gathering data for ns/openshift-apiserver-operator...
2026-06-14T22:18:36.246671926Z Gathering data for ns/openshift-apiserver...
2026-06-14T22:18:36.594937607Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-14T22:18:36.833229615Z Gathering data for ns/openshift-controller-manager...
2026-06-14T22:18:37.086290767Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-14T22:18:37.691553450Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-14T22:18:37.987443007Z Gathering data for ns/openshift-service-ca-operator...
2026-06-14T22:18:38.273430548Z Gathering data for ns/openshift-service-ca...
2026-06-14T22:18:38.609790394Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-14T22:18:39.559141436Z Wrote inspect data to must-gather.
2026-06-14T22:18:39.559182483Z error: inspection completed with the errors occurred while gathering data:
2026-06-14T22:18:39.559182483Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-14T22:18:39.823324223Z Collecting kubelet logs for node ip-10-0-130-84.ec2.internal
2026-06-14T22:18:39.825140534Z Collecting kubelet logs for node ip-10-0-140-11.ec2.internal
2026-06-14T22:18:39.826796338Z Collecting kubelet logs for node ip-10-0-132-49.ec2.internal
2026-06-14T22:18:40.116676167Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-g5jjb namespace
2026-06-14T22:18:40.121135268Z INFO: Node performance data collection complete.
2026-06-14T22:18:40.248549919Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-14T22:18:40.249602935Z error: the server doesn't have a resource type "clusters"
2026-06-14T22:18:40.406966313Z Caches written to disk