2026-07-14T11:38:58.464868600Z [disk usage checker] Started
2026-07-14T11:38:58.468408800Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-14T11:38:58.681928944Z Gathering data for ns/openshift-cluster-version...
2026-07-14T11:38:58.842715191Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-14T11:38:58.960023841Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-14T11:38:59.059247161Z Gathering data for ns/default...
2026-07-14T11:38:59.438779752Z Gathering data for ns/openshift...
2026-07-14T11:38:59.951087172Z Gathering data for ns/kube-system...
2026-07-14T11:39:00.898129775Z Gathering data for ns/openshift-etcd...
2026-07-14T11:39:01.312965291Z Wrote inspect data to must-gather.
2026-07-14T11:39:01.313138789Z error: inspection completed with the errors occurred while gathering data:
2026-07-14T11:39:01.313138789Z     namespaces "assisted-installer" not found
2026-07-14T11:39:01.440758669Z Waiting on subprocesses to finish execution.
2026-07-14T11:39:01.446235595Z INFO: Collecting host service logs for crio
2026-07-14T11:39:01.446502673Z INFO: Collecting host service logs for kubelet
2026-07-14T11:39:01.446849625Z INFO: Collecting host service logs for rpm-ostreed
2026-07-14T11:39:01.447185067Z INFO: Collecting host service logs for ostree-finalize-staged
2026-07-14T11:39:01.447572473Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-07-14T11:39:01.447925116Z INFO: Collecting host service logs for machine-config-daemon-host
2026-07-14T11:39:01.448276163Z INFO: Collecting host service logs for NetworkManager
2026-07-14T11:39:01.448641261Z INFO: Collecting host service logs for openvswitch
2026-07-14T11:39:01.448985305Z INFO: Collecting host service logs for ovs-configuration
2026-07-14T11:39:01.449323614Z INFO: Collecting host service logs for ovsdb-server
2026-07-14T11:39:01.449424971Z INFO: Gathering machine config daemon's old logs from all nodes
2026-07-14T11:39:01.449779990Z INFO: Collecting host service logs for ovs-vswitchd
2026-07-14T11:39:01.450147523Z INFO: Waiting for worker host service log collection to complete ...
2026-07-14T11:39:01.456103388Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-07-14T11:39:01.459114441Z Executing Istio gather script
2026-07-14T11:39:01.460283457Z INFO: Gathering HAProxy config files
2026-07-14T11:39:01.468805625Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-07-14T11:39:01.596870079Z INFO: Waiting for node performance related collection to complete ...
2026-07-14T11:39:01.806200975Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-07-14T11:39:01.952566976Z No resources found in openshift-etcd namespace.
2026-07-14T11:39:02.541316358Z No resources found
2026-07-14T11:39:02.575663868Z INFO: "sriov-network-operator" not detected. Skipping.
2026-07-14T11:39:02.591029851Z INFO: Found 1 replicas - prometheus-k8s-0
2026-07-14T11:39:02.647038805Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-07-14T11:39:02.767965659Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-07-14T11:39:02.768063267Z INFO: on-disk MachineConfig config collection complete.
2026-07-14T11:39:02.968763144Z Wrote inspect data to must-gather.
2026-07-14T11:39:03.084071820Z INFO: "metallb-operator" not detected. Skipping.
2026-07-14T11:39:03.278811919Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-07-14T11:39:03.283431087Z INFO: Collecting Insights Archives from insights-operator-68d9dd94cf-mq4vx
2026-07-14T11:39:03.283431087Z insights-runtime-extractor-2bk9v
2026-07-14T11:39:03.283431087Z insights-runtime-extractor-f75fz
2026-07-14T11:39:03.283431087Z insights-runtime-extractor-x5gtn
2026-07-14T11:39:03.323458804Z INFO: Worker host service log collection to complete.
2026-07-14T11:39:03.418297336Z error: the server doesn't have a resource type "performanceprofile"
2026-07-14T11:39:03.529567006Z Wrote inspect data to must-gather.
2026-07-14T11:39:03.645391494Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-14T11:39:03.768087083Z INFO: Waiting for HAProxy config collection to complete ...
2026-07-14T11:39:03.800312690Z Wrote inspect data to must-gather.
2026-07-14T11:39:03.846079561Z No resources found
2026-07-14T11:39:03.856734349Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-07-14T11:39:03.856734349Z See 'oc rsync -h' for help and examples
2026-07-14T11:39:03.867736185Z Wrote inspect data to must-gather.
2026-07-14T11:39:03.869710285Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-07-14T11:39:03.889346340Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-14T11:39:03.968065341Z Wrote inspect data to must-gather.
2026-07-14T11:39:04.059220543Z Wrote inspect data to must-gather.
2026-07-14T11:39:04.078345617Z INFO: 'previous-logs' folder not found on ip-10-0-135-2.ec2.internal, skipping...
2026-07-14T11:39:04.095965248Z ERROR: No running kube-apiserver pods found
2026-07-14T11:39:04.178146224Z Wrote inspect data to must-gather.
2026-07-14T11:39:04.297666556Z tar: Removing leading `/' from member names
2026-07-14T11:39:04.305430320Z INFO: HAProxy config collection complete.
2026-07-14T11:39:04.406768051Z error: the server doesn't have a resource type "machineconfigs"
2026-07-14T11:39:04.412958333Z Wrote inspect data to must-gather.
2026-07-14T11:39:04.446141562Z INFO: 'previous-logs' folder not found on ip-10-0-139-227.ec2.internal, skipping...
2026-07-14T11:39:04.449296501Z Gathering data for ns/openshift-monitoring...
2026-07-14T11:39:04.565396872Z INFO: Getting rules from prometheus-k8s-0
2026-07-14T11:39:04.631763194Z error: the server doesn't have a resource type "machineconfigpools"
2026-07-14T11:39:04.744794731Z Wrote inspect data to must-gather.
2026-07-14T11:39:04.748912581Z INFO: 'previous-logs' folder not found on ip-10-0-141-230.ec2.internal, skipping...
2026-07-14T11:39:04.748949971Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-07-14T11:39:04.748976394Z INFO: Machine Config Daemon termination log collection complete.
2026-07-14T11:39:04.907152733Z Wrote inspect data to must-gather.
2026-07-14T11:39:05.003897916Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-07-14T11:39:05.021856198Z Wrote inspect data to must-gather.
2026-07-14T11:39:05.096886442Z error: the server doesn't have a resource type "kubeletconfigs"
2026-07-14T11:39:05.120937464Z INFO: Getting status/config from prometheus-k8s-0
2026-07-14T11:39:05.354955848Z INFO: INTERCONNECT MODE
2026-07-14T11:39:05.354989902Z INFO: Gathering ovn-kubernetes DBs
2026-07-14T11:39:05.355452159Z Wrote inspect data to must-gather.
2026-07-14T11:39:05.573884782Z INFO: Gathering OVN_Northbound from ovnkube-node-7nl9h...
2026-07-14T11:39:05.574131617Z INFO: Gathering OVN_Northbound from ovnkube-node-9dd8k...
2026-07-14T11:39:05.574365587Z INFO: Gathering OVN_Northbound from ovnkube-node-gqrcm...
2026-07-14T11:39:05.574696966Z INFO: Gathering OVN_Southbound from ovnkube-node-7nl9h...
2026-07-14T11:39:05.574937848Z INFO: Gathering OVN_Southbound from ovnkube-node-9dd8k...
2026-07-14T11:39:05.575230325Z INFO: Gathering OVN_Southbound from ovnkube-node-gqrcm...
2026-07-14T11:39:05.706491480Z Wrote inspect data to must-gather.
2026-07-14T11:39:05.708405812Z INFO: Getting status/flags from prometheus-k8s-0
2026-07-14T11:39:05.960871155Z tar: Removing leading `/' from member names
2026-07-14T11:39:06.018694097Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-07-14T11:39:06.028997393Z Wrote inspect data to must-gather.
2026-07-14T11:39:06.034057985Z tar: Removing leading `/' from member names
2026-07-14T11:39:06.049755938Z tar: Removing leading `/' from member names
2026-07-14T11:39:06.061936666Z tar: Removing leading `/' from member names
2026-07-14T11:39:06.065740657Z tar: Removing leading `/' from member names
2026-07-14T11:39:06.080390784Z tar: Removing leading `/' from member names
2026-07-14T11:39:06.178764273Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-07-14T11:39:06.255899726Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:06.281135867Z Wrote inspect data to must-gather.
2026-07-14T11:39:06.440654035Z INFO: Waiting for network log collection to complete ...
2026-07-14T11:39:06.440690062Z INFO: Waiting for ovnk database copies to complete ...
2026-07-14T11:39:06.441053566Z INFO: Copying ovnk databases complete.
2026-07-14T11:39:06.442683321Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-07-14T11:39:06.444680631Z ovnk_database_store/
2026-07-14T11:39:06.444680631Z ovnk_database_store/ovnkube-node-9dd8k_sbdb
2026-07-14T11:39:06.462944676Z ovnk_database_store/ovnkube-node-9dd8k_nbdb
2026-07-14T11:39:06.471034542Z ovnk_database_store/ovnkube-node-7nl9h_sbdb
2026-07-14T11:39:06.487037569Z ovnk_database_store/ovnkube-node-gqrcm_sbdb
2026-07-14T11:39:06.488110621Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:06.491484881Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-07-14T11:39:06.504959233Z Wrote inspect data to must-gather.
2026-07-14T11:39:06.505794596Z ovnk_database_store/ovnkube-node-7nl9h_nbdb
2026-07-14T11:39:06.514331125Z ovnk_database_store/ovnkube-node-gqrcm_nbdb
2026-07-14T11:39:06.517802674Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-07-14T11:39:06.525596031Z INFO: Network log collection complete.
2026-07-14T11:39:06.716658334Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:06.727553992Z Wrote inspect data to must-gather.
2026-07-14T11:39:06.869468423Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-07-14T11:39:06.932221303Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:06.934930401Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-07-14T11:39:06.942272320Z Wrote inspect data to must-gather.
2026-07-14T11:39:07.158785620Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:07.260653213Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-07-14T11:39:07.263856888Z INFO: Fallback to identify the container image from release info
2026-07-14T11:39:07.369902037Z INFO: Getting status from alertmanager-main-0
2026-07-14T11:39:07.411496444Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-14T11:39:07.414360756Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:07.416986262Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-07-14T11:39:07.679408597Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:07.835677544Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8d5dc4ea635b13544e6f92103089219e732369ae30557b7beee2e8a11bf500d
2026-07-14T11:39:07.892988181Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:07.895808543Z Inspecting resource crd/inferencemodels.inference.networking.x-k8s.io
2026-07-14T11:39:07.984864565Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-14T11:39:07.994821675Z daemonset.apps/perf-node-gather-daemonset created
2026-07-14T11:39:08.090452775Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:08.155812114Z Waiting for performance profile collector pods to become ready: 1
2026-07-14T11:39:08.205693221Z Gathering data for ns/openshift-network-console...
2026-07-14T11:39:08.308651607Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:08.311924327Z Inspecting resource crd/inferenceobjectives.inference.networking.x-k8s.io
2026-07-14T11:39:08.510857178Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:08.700314934Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-14T11:39:08.738244997Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:08.740847150Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-07-14T11:39:08.767845655Z Gathering data for ns/openshift-console-operator...
2026-07-14T11:39:08.922867634Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:09.131850178Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:09.134658366Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-07-14T11:39:09.257286038Z Gathering data for ns/openshift-console...
2026-07-14T11:39:09.309511708Z Waiting for performance profile collector pods to become ready: 2
2026-07-14T11:39:09.318111779Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:09.522057443Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:09.524677749Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-07-14T11:39:09.704567059Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:09.896254825Z Gathering data for ns/openshift-cluster-storage-operator...
2026-07-14T11:39:09.914452929Z Wrote inspect data to /must-gather/istio.
2026-07-14T11:39:10.456429383Z Gathering data for ns/openshift-dns-operator...
2026-07-14T11:39:10.458638324Z Waiting for performance profile collector pods to become ready: 3
2026-07-14T11:39:10.657776272Z Done executing Istio gather script
2026-07-14T11:39:10.795774363Z Gathering data for ns/openshift-dns...
2026-07-14T11:39:11.443862750Z Gathering data for ns/openshift-image-registry...
2026-07-14T11:39:11.572538889Z Waiting for performance profile collector pods to become ready: 4
2026-07-14T11:39:11.998385411Z Gathering data for ns/openshift-ingress-operator...
2026-07-14T11:39:12.360741986Z Gathering data for ns/openshift-ingress...
2026-07-14T11:39:12.708386123Z Waiting for performance profile collector pods to become ready: 5
2026-07-14T11:39:12.767754885Z Gathering data for ns/openshift-ingress-canary...
2026-07-14T11:39:13.250976929Z Gathering data for ns/openshift-insights...
2026-07-14T11:39:13.704954838Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-14T11:39:13.836565211Z Waiting for performance profile collector pods to become ready: 6
2026-07-14T11:39:14.958080389Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-07-14T11:39:15.243716152Z Collecting performance related data for node ip-10-0-139-227.ec2.internal
2026-07-14T11:39:15.251006030Z Collecting performance related data for node ip-10-0-135-2.ec2.internal
2026-07-14T11:39:15.258325890Z Collecting performance related data for node ip-10-0-141-230.ec2.internal
2026-07-14T11:39:16.447516404Z Gathering data for ns/openshift-config...
2026-07-14T11:39:16.804567883Z Gathering data for ns/openshift-config-managed...
2026-07-14T11:39:17.310944887Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-07-14T11:39:17.658979330Z Gathering data for ns/openshift-kube-apiserver...
2026-07-14T11:39:18.005824647Z Gathering data for ns/openshift-kube-controller-manager...
2026-07-14T11:39:18.366672124Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-07-14T11:39:18.711297768Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-14T11:39:18.735435428Z Gathering data for ns/openshift-kube-scheduler...
2026-07-14T11:39:19.018613042Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-07-14T11:39:19.341902647Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-07-14T11:39:19.701725077Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-07-14T11:39:20.040677008Z Gathering data for ns/openshift-user-workload-monitoring...
2026-07-14T11:39:20.587580301Z Gathering data for ns/openshift-multus...
2026-07-14T11:39:22.038263033Z Gathering data for ns/openshift-ovn-kubernetes...
2026-07-14T11:39:23.316919043Z Gathering data for ns/openshift-host-network...
2026-07-14T11:39:23.667428965Z Gathering data for ns/openshift-network-diagnostics...
2026-07-14T11:39:23.716120036Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-14T11:39:23.751881035Z Collecting kubelet logs for node ip-10-0-139-227.ec2.internal
2026-07-14T11:39:23.753606391Z Collecting kubelet logs for node ip-10-0-135-2.ec2.internal
2026-07-14T11:39:23.755254297Z Collecting kubelet logs for node ip-10-0-141-230.ec2.internal
2026-07-14T11:39:24.120204544Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-rjzdp namespace
2026-07-14T11:39:24.125416121Z INFO: Node performance data collection complete.
2026-07-14T11:39:24.310139166Z Gathering data for ns/openshift-network-node-identity...
2026-07-14T11:39:24.750132366Z Gathering data for ns/openshift-network-operator...
2026-07-14T11:39:25.138409032Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-07-14T11:39:25.410390777Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-07-14T11:39:25.915271052Z Gathering data for ns/openshift-apiserver-operator...
2026-07-14T11:39:26.243449211Z Gathering data for ns/openshift-apiserver...
2026-07-14T11:39:26.691297168Z Gathering data for ns/openshift-controller-manager-operator...
2026-07-14T11:39:27.031033966Z Gathering data for ns/openshift-controller-manager...
2026-07-14T11:39:27.331844658Z Gathering data for ns/openshift-cluster-samples-operator...
2026-07-14T11:39:27.987260047Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-07-14T11:39:28.305971310Z Gathering data for ns/openshift-service-ca-operator...
2026-07-14T11:39:28.645537810Z Gathering data for ns/openshift-service-ca...
2026-07-14T11:39:28.720741739Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-14T11:39:29.121000322Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-07-14T11:39:30.101802688Z Wrote inspect data to must-gather.
2026-07-14T11:39:30.101851654Z error: inspection completed with the errors occurred while gathering data:
2026-07-14T11:39:30.101851654Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-07-14T11:39:30.237151196Z error: the server doesn't have a resource type "clusters"
2026-07-14T11:39:30.350324892Z Caches written to disk