2026-09-17T07:40:26.866410772Z [disk usage checker] Started
2026-09-17T07:40:26.869706063Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:40:27.061827614Z Gathering data for ns/openshift-cluster-version...
2026-09-17T07:40:27.197651480Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T07:40:27.291619638Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T07:40:27.374940075Z Gathering data for ns/default...
2026-09-17T07:40:27.698742879Z Gathering data for ns/openshift...
2026-09-17T07:40:28.188608885Z Gathering data for ns/kube-system...
2026-09-17T07:40:28.902705754Z Gathering data for ns/openshift-etcd...
2026-09-17T07:40:29.209817266Z Wrote inspect data to must-gather.
2026-09-17T07:40:29.209849219Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T07:40:29.209849219Z     namespaces "assisted-installer" not found
2026-09-17T07:40:29.445475845Z Waiting on subprocesses to finish execution.
2026-09-17T07:40:29.455955376Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T07:40:29.456364339Z Executing Istio gather script
2026-09-17T07:40:29.459855410Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T07:40:29.461827234Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T07:40:29.467224699Z INFO: Collecting host service logs for crio
2026-09-17T07:40:29.467479015Z INFO: Collecting host service logs for kubelet
2026-09-17T07:40:29.467833003Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T07:40:29.468123282Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T07:40:29.468626450Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T07:40:29.469006100Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T07:40:29.469357336Z INFO: Collecting host service logs for NetworkManager
2026-09-17T07:40:29.469712474Z INFO: Collecting host service logs for openvswitch
2026-09-17T07:40:29.470122122Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T07:40:29.470577404Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T07:40:29.470951797Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T07:40:29.471377820Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T07:40:29.543076465Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T07:40:29.544289404Z INFO: Gathering HAProxy config files
2026-09-17T07:40:30.055970244Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T07:40:30.215368194Z No resources found
2026-09-17T07:40:30.243993094Z INFO: Collecting Insights Archives from insights-operator-5844b856db-tvlrq
2026-09-17T07:40:30.243993094Z insights-runtime-extractor-2nqfn
2026-09-17T07:40:30.243993094Z insights-runtime-extractor-47gnn
2026-09-17T07:40:30.243993094Z insights-runtime-extractor-j8x88
2026-09-17T07:40:30.385357771Z No resources found in openshift-etcd namespace.
2026-09-17T07:40:30.390854724Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T07:40:30.524435801Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T07:40:30.580074396Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T07:40:30.580074396Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T07:40:30.639840274Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T07:40:30.639931574Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T07:40:30.785536248Z Wrote inspect data to must-gather.
2026-09-17T07:40:30.861222838Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T07:40:30.872303894Z INFO: Worker host service log collection to complete.
2026-09-17T07:40:30.907533567Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T07:40:30.907533567Z See 'oc rsync -h' for help and examples
2026-09-17T07:40:31.077111742Z ERROR: No running kube-apiserver pods found
2026-09-17T07:40:31.088483764Z Wrote inspect data to must-gather.
2026-09-17T07:40:31.289392369Z No resources found
2026-09-17T07:40:31.328979421Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T07:40:31.487727481Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T07:40:31.610099896Z Wrote inspect data to must-gather.
2026-09-17T07:40:31.762103291Z Wrote inspect data to must-gather.
2026-09-17T07:40:31.801096674Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T07:40:31.813895901Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T07:40:31.865994057Z Wrote inspect data to must-gather.
2026-09-17T07:40:31.901194908Z Wrote inspect data to must-gather.
2026-09-17T07:40:31.905528708Z Wrote inspect data to must-gather.
2026-09-17T07:40:31.914877261Z INFO: 'previous-logs' folder not found on ip-10-0-137-175.ec2.internal, skipping...
2026-09-17T07:40:31.919418310Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:40:31.931516541Z Gathering data for ns/openshift-monitoring...
2026-09-17T07:40:32.109962547Z Wrote inspect data to must-gather.
2026-09-17T07:40:32.128020237Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T07:40:32.168199011Z tar: Removing leading `/' from member names
2026-09-17T07:40:32.173096258Z INFO: HAProxy config collection complete.
2026-09-17T07:40:32.247582855Z INFO: 'previous-logs' folder not found on ip-10-0-138-13.ec2.internal, skipping...
2026-09-17T07:40:32.249127790Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T07:40:32.268296017Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T07:40:32.308636903Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T07:40:32.416345221Z Wrote inspect data to must-gather.
2026-09-17T07:40:32.528515748Z INFO: 'previous-logs' folder not found on ip-10-0-142-90.ec2.internal, skipping...
2026-09-17T07:40:32.528619497Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T07:40:32.528675536Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T07:40:32.548982432Z Wrote inspect data to must-gather.
2026-09-17T07:40:32.662483992Z Wrote inspect data to must-gather.
2026-09-17T07:40:32.700762814Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T07:40:32.709137840Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T07:40:32.912372975Z Wrote inspect data to must-gather.
2026-09-17T07:40:32.937551014Z INFO: INTERCONNECT MODE
2026-09-17T07:40:32.937581354Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T07:40:33.082466930Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T07:40:33.112198922Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T07:40:33.114757373Z INFO: Gathering OVN_Northbound from ovnkube-node-4c5c2...
2026-09-17T07:40:33.114965978Z INFO: Gathering OVN_Northbound from ovnkube-node-64lxj...
2026-09-17T07:40:33.115167179Z INFO: Gathering OVN_Northbound from ovnkube-node-b99wz...
2026-09-17T07:40:33.115449737Z INFO: Gathering OVN_Southbound from ovnkube-node-4c5c2...
2026-09-17T07:40:33.115671408Z INFO: Gathering OVN_Southbound from ovnkube-node-64lxj...
2026-09-17T07:40:33.116099595Z INFO: Gathering OVN_Southbound from ovnkube-node-b99wz...
2026-09-17T07:40:33.119307503Z Wrote inspect data to must-gather.
2026-09-17T07:40:33.442445637Z tar: Removing leading `/' from member names
2026-09-17T07:40:33.446133387Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:33.447556979Z tar: Removing leading `/' from member names
2026-09-17T07:40:33.497011706Z tar: Removing leading `/' from member names
2026-09-17T07:40:33.500483236Z tar: Removing leading `/' from member names
2026-09-17T07:40:33.529141701Z tar: Removing leading `/' from member names
2026-09-17T07:40:33.541574957Z Wrote inspect data to must-gather.
2026-09-17T07:40:33.544685103Z tar: Removing leading `/' from member names
2026-09-17T07:40:33.560114920Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T07:40:33.571045415Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T07:40:33.675514061Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:33.678329058Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T07:40:33.778745598Z Wrote inspect data to must-gather.
2026-09-17T07:40:33.818185620Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T07:40:33.907498410Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:34.019844426Z Wrote inspect data to must-gather.
2026-09-17T07:40:34.032828406Z INFO: Waiting for network log collection to complete ...
2026-09-17T07:40:34.032933114Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T07:40:34.033357328Z INFO: Copying ovnk databases complete.
2026-09-17T07:40:34.035070371Z 3.7M	must-gather/network_logs/ovnk_database_store
2026-09-17T07:40:34.037869329Z ovnk_database_store/
2026-09-17T07:40:34.037924805Z ovnk_database_store/ovnkube-node-64lxj_nbdb
2026-09-17T07:40:34.050166143Z ovnk_database_store/ovnkube-node-4c5c2_sbdb
2026-09-17T07:40:34.073249090Z ovnk_database_store/ovnkube-node-b99wz_nbdb
2026-09-17T07:40:34.076394482Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T07:40:34.084102936Z ovnk_database_store/ovnkube-node-4c5c2_nbdb
2026-09-17T07:40:34.092599666Z ovnk_database_store/ovnkube-node-b99wz_sbdb
2026-09-17T07:40:34.116767381Z ovnk_database_store/ovnkube-node-64lxj_sbdb
2026-09-17T07:40:34.134264109Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:34.136449583Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T07:40:34.145120850Z INFO: Network log collection complete.
2026-09-17T07:40:34.247713722Z W0917 07:40:34.247659    1509 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-17T07:40:34.252621469Z Wrote inspect data to must-gather.
2026-09-17T07:40:34.269652800Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T07:40:34.335889803Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:34.457577755Z Gathering data for ns/openshift-network-console...
2026-09-17T07:40:34.476179755Z INFO: Getting status from alertmanager-main-0
2026-09-17T07:40:34.563407187Z Wrote inspect data to must-gather.
2026-09-17T07:40:34.579644895Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:34.583478086Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T07:40:34.797218277Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:34.814336261Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T07:40:34.816759155Z INFO: Fallback to identify the container image from release info
2026-09-17T07:40:34.984120987Z Gathering data for ns/openshift-console-operator...
2026-09-17T07:40:35.007054530Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:35.010242988Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T07:40:35.163326412Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:35.344754252Z Wrote inspect data to /must-gather/istio.
2026-09-17T07:40:35.383551696Z Gathering data for ns/openshift-console...
2026-09-17T07:40:35.420962328Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-17T07:40:35.557116972Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T07:40:35.673870800Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T07:40:35.968944470Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T07:40:36.035740430Z Done executing Istio gather script
2026-09-17T07:40:36.474328246Z Gathering data for ns/openshift-dns-operator...
2026-09-17T07:40:36.791138386Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T07:40:36.797722116Z Gathering data for ns/openshift-dns...
2026-09-17T07:40:36.925651832Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:40:37.353804834Z Gathering data for ns/openshift-image-registry...
2026-09-17T07:40:37.794734504Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T07:40:37.920399165Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T07:40:38.286533256Z Gathering data for ns/openshift-ingress...
2026-09-17T07:40:38.613524024Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T07:40:39.043566474Z Gathering data for ns/openshift-insights...
2026-09-17T07:40:39.047041841Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T07:40:40.159531325Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T07:40:41.052582029Z Gathering data for ns/openshift-config...
2026-09-17T07:40:41.278854299Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T07:40:41.315490742Z Gathering data for ns/openshift-config-managed...
2026-09-17T07:40:41.729732998Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T07:40:41.930265024Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:40:41.991764934Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T07:40:42.250127863Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T07:40:42.390868133Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T07:40:42.526568895Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T07:40:42.872915466Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T07:40:43.190062462Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T07:40:43.483744781Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T07:40:43.507766415Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T07:40:43.755876620Z Collecting performance related data for node ip-10-0-142-90.ec2.internal
2026-09-17T07:40:43.766309459Z Collecting performance related data for node ip-10-0-137-175.ec2.internal
2026-09-17T07:40:43.775317268Z Collecting performance related data for node ip-10-0-138-13.ec2.internal
2026-09-17T07:40:43.828446539Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T07:40:44.237893924Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T07:40:44.876575140Z Gathering data for ns/openshift-multus...
2026-09-17T07:40:46.421886914Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T07:40:46.936214135Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:40:47.703426330Z Gathering data for ns/openshift-host-network...
2026-09-17T07:40:48.027365418Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T07:40:48.576248518Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T07:40:48.988480889Z Gathering data for ns/openshift-network-operator...
2026-09-17T07:40:49.372473782Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T07:40:49.632619761Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T07:40:50.109006394Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T07:40:50.438032648Z Gathering data for ns/openshift-apiserver...
2026-09-17T07:40:50.845306987Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T07:40:51.169849505Z Gathering data for ns/openshift-controller-manager...
2026-09-17T07:40:51.446661088Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T07:40:51.658451139Z Collecting kubelet logs for node ip-10-0-142-90.ec2.internal
2026-09-17T07:40:51.660241089Z Collecting kubelet logs for node ip-10-0-137-175.ec2.internal
2026-09-17T07:40:51.661878595Z Collecting kubelet logs for node ip-10-0-138-13.ec2.internal
2026-09-17T07:40:51.940862208Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-09-17T07:40:52.010735518Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-vh9zj namespace
2026-09-17T07:40:52.017301026Z INFO: Node performance data collection complete.
2026-09-17T07:40:52.166623025Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T07:40:52.478708995Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T07:40:52.813475175Z Gathering data for ns/openshift-service-ca...
2026-09-17T07:40:53.157568705Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T07:40:54.007815539Z Wrote inspect data to must-gather.
2026-09-17T07:40:54.007862275Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T07:40:54.007862275Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T07:40:54.134921612Z error: the server doesn't have a resource type "clusters"
2026-09-17T07:40:54.262803011Z Caches written to disk