2026-06-15T08:34:55.672263051Z [disk usage checker] Started
2026-06-15T08:34:55.675777274Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T08:34:55.876481112Z Gathering data for ns/openshift-cluster-version...
2026-06-15T08:34:56.032339227Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T08:34:56.140658223Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T08:34:56.225376672Z Gathering data for ns/default...
2026-06-15T08:34:56.564697751Z Gathering data for ns/openshift...
2026-06-15T08:34:57.010120221Z Gathering data for ns/kube-system...
2026-06-15T08:34:57.858017067Z Gathering data for ns/openshift-etcd...
2026-06-15T08:34:58.192384119Z Wrote inspect data to must-gather.
2026-06-15T08:34:58.192420396Z error: inspection completed with the errors occurred while gathering data:
2026-06-15T08:34:58.192420396Z     namespaces "assisted-installer" not found
2026-06-15T08:34:58.282700502Z Waiting on subprocesses to finish execution.
2026-06-15T08:34:58.291292579Z Executing Istio gather script
2026-06-15T08:34:58.294831265Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-15T08:34:58.298224638Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-15T08:34:58.299113458Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-15T08:34:58.300826857Z INFO: Gathering HAProxy config files
2026-06-15T08:34:58.304928708Z INFO: Collecting host service logs for crio
2026-06-15T08:34:58.305221623Z INFO: Collecting host service logs for kubelet
2026-06-15T08:34:58.305526845Z INFO: Collecting host service logs for rpm-ostreed
2026-06-15T08:34:58.305846199Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-15T08:34:58.306117781Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-15T08:34:58.306403490Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-15T08:34:58.306728715Z INFO: Collecting host service logs for NetworkManager
2026-06-15T08:34:58.307047800Z INFO: Collecting host service logs for openvswitch
2026-06-15T08:34:58.307353545Z INFO: Collecting host service logs for ovs-configuration
2026-06-15T08:34:58.307666063Z INFO: Collecting host service logs for ovsdb-server
2026-06-15T08:34:58.308042148Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-15T08:34:58.308617923Z INFO: Waiting for worker host service log collection to complete ...
2026-06-15T08:34:58.399727243Z INFO: Waiting for node performance related collection to complete ...
2026-06-15T08:34:59.047341068Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-15T08:34:59.172374767Z No resources found in openshift-etcd namespace.
2026-06-15T08:34:59.381583123Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-15T08:34:59.409649635Z No resources found
2026-06-15T08:34:59.421097910Z INFO: Collecting Insights Archives from insights-operator-5bbd86d6bd-v5bp6
2026-06-15T08:34:59.421097910Z insights-runtime-extractor-5d2wg
2026-06-15T08:34:59.421097910Z insights-runtime-extractor-dp926
2026-06-15T08:34:59.421097910Z insights-runtime-extractor-pt8fk
2026-06-15T08:34:59.421532914Z INFO: "metallb-operator" not detected. Skipping.
2026-06-15T08:34:59.661373873Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-15T08:34:59.729021277Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-15T08:34:59.729119886Z INFO: on-disk MachineConfig config collection complete.
2026-06-15T08:34:59.742220213Z Wrote inspect data to must-gather.
2026-06-15T08:34:59.767391007Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-15T08:34:59.955409936Z error: the server doesn't have a resource type "performanceprofile"
2026-06-15T08:35:00.000206701Z Wrote inspect data to must-gather.
2026-06-15T08:35:00.032578620Z INFO: Worker host service log collection to complete.
2026-06-15T08:35:00.287972974Z Wrote inspect data to must-gather.
2026-06-15T08:35:00.300038309Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-15T08:35:00.323469741Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-15T08:35:00.446002176Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-15T08:35:00.446002176Z See 'oc rsync -h' for help and examples
2026-06-15T08:35:00.480101635Z Wrote inspect data to must-gather.
2026-06-15T08:35:00.540353287Z No resources found
2026-06-15T08:35:00.561253433Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-15T08:35:00.715171836Z ERROR: No running kube-apiserver pods found
2026-06-15T08:35:00.724183946Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T08:35:00.733828833Z Wrote inspect data to must-gather.
2026-06-15T08:35:00.739955133Z INFO: 'previous-logs' folder not found on ip-10-0-133-140.ec2.internal, skipping...
2026-06-15T08:35:00.742059540Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T08:35:00.768085960Z Gathering data for ns/openshift-monitoring...
2026-06-15T08:35:00.796163888Z Wrote inspect data to must-gather.
2026-06-15T08:35:00.926403204Z Wrote inspect data to must-gather.
2026-06-15T08:35:00.977218552Z tar: Removing leading `/' from member names
2026-06-15T08:35:00.982427659Z INFO: HAProxy config collection complete.
2026-06-15T08:35:01.008946159Z error: the server doesn't have a resource type "machineconfigs"
2026-06-15T08:35:01.096121250Z INFO: Getting rules from prometheus-k8s-0
2026-06-15T08:35:01.101467768Z INFO: 'previous-logs' folder not found on ip-10-0-134-6.ec2.internal, skipping...
2026-06-15T08:35:01.162247368Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-15T08:35:01.195728712Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-15T08:35:01.229033443Z Wrote inspect data to must-gather.
2026-06-15T08:35:01.382294346Z INFO: 'previous-logs' folder not found on ip-10-0-135-160.ec2.internal, skipping...
2026-06-15T08:35:01.382326682Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-15T08:35:01.382335543Z INFO: Machine Config Daemon termination log collection complete.
2026-06-15T08:35:01.431617498Z Wrote inspect data to must-gather.
2026-06-15T08:35:01.497202340Z Wrote inspect data to must-gather.
2026-06-15T08:35:01.578580234Z INFO: Getting status/config from prometheus-k8s-0
2026-06-15T08:35:01.605922226Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-15T08:35:01.735442842Z Wrote inspect data to must-gather.
2026-06-15T08:35:01.825201637Z Wrote inspect data to must-gather.
2026-06-15T08:35:01.904530520Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-15T08:35:02.021468713Z INFO: INTERCONNECT MODE
2026-06-15T08:35:02.021719706Z INFO: Gathering ovn-kubernetes DBs
2026-06-15T08:35:02.030507110Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-15T08:35:02.044392486Z Wrote inspect data to must-gather.
2026-06-15T08:35:02.097230195Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:02.186908721Z INFO: Gathering OVN_Northbound from ovnkube-node-9k4qn...
2026-06-15T08:35:02.187108148Z INFO: Gathering OVN_Northbound from ovnkube-node-fxg72...
2026-06-15T08:35:02.187324950Z INFO: Gathering OVN_Northbound from ovnkube-node-tdv59...
2026-06-15T08:35:02.187599072Z INFO: Gathering OVN_Southbound from ovnkube-node-9k4qn...
2026-06-15T08:35:02.188039336Z INFO: Gathering OVN_Southbound from ovnkube-node-fxg72...
2026-06-15T08:35:02.188299885Z INFO: Gathering OVN_Southbound from ovnkube-node-tdv59...
2026-06-15T08:35:02.307944655Z Wrote inspect data to must-gather.
2026-06-15T08:35:02.334783723Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-15T08:35:02.436602402Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:02.440572231Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-15T08:35:02.523625148Z tar: Removing leading `/' from member names
2026-06-15T08:35:02.602534388Z tar: Removing leading `/' from member names
2026-06-15T08:35:02.637357034Z Wrote inspect data to must-gather.
2026-06-15T08:35:02.638130536Z tar: Removing leading `/' from member names
2026-06-15T08:35:02.638309365Z tar: Removing leading `/' from member names
2026-06-15T08:35:02.649187826Z tar: Removing leading `/' from member names
2026-06-15T08:35:02.679919215Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:02.782321934Z tar: Removing leading `/' from member names
2026-06-15T08:35:02.790213695Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-15T08:35:02.874457955Z Wrote inspect data to must-gather.
2026-06-15T08:35:02.931916517Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:02.934927847Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-15T08:35:03.028102196Z INFO: Waiting for network log collection to complete ...
2026-06-15T08:35:03.028139972Z INFO: Waiting for ovnk database copies to complete ...
2026-06-15T08:35:03.028501378Z INFO: Copying ovnk databases complete.
2026-06-15T08:35:03.030554714Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-06-15T08:35:03.033429597Z ovnk_database_store/
2026-06-15T08:35:03.033481242Z ovnk_database_store/ovnkube-node-fxg72_nbdb
2026-06-15T08:35:03.042701459Z ovnk_database_store/ovnkube-node-9k4qn_nbdb
2026-06-15T08:35:03.049716420Z ovnk_database_store/ovnkube-node-tdv59_nbdb
2026-06-15T08:35:03.058021919Z ovnk_database_store/ovnkube-node-9k4qn_sbdb
2026-06-15T08:35:03.073186843Z ovnk_database_store/ovnkube-node-fxg72_sbdb
2026-06-15T08:35:03.087578509Z ovnk_database_store/ovnkube-node-tdv59_sbdb
2026-06-15T08:35:03.105063229Z INFO: Network log collection complete.
2026-06-15T08:35:03.107975533Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-15T08:35:03.112042881Z Wrote inspect data to must-gather.
2026-06-15T08:35:03.121354978Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:03.322229693Z Wrote inspect data to must-gather.
2026-06-15T08:35:03.327472957Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:03.330959118Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-15T08:35:03.428058201Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T08:35:03.536221359Z INFO: Getting status from alertmanager-main-0
2026-06-15T08:35:03.565123815Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:03.575474930Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-15T08:35:03.577582708Z INFO: Fallback to identify the container image from release info
2026-06-15T08:35:03.780523956Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:03.782904532Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-15T08:35:03.930384288Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:04.068108074Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T08:35:04.118009497Z Wrote inspect data to /must-gather/istio.
2026-06-15T08:35:04.190917054Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d66a6b2ec52dede5d83ce04f6abfc519df1fd7dc36248741e03ecb9bf8d1762
2026-06-15T08:35:04.266452295Z Gathering data for ns/openshift-network-console...
2026-06-15T08:35:04.331282279Z daemonset.apps/perf-node-gather-daemonset created
2026-06-15T08:35:04.474585401Z Waiting for performance profile collector pods to become ready: 1
2026-06-15T08:35:04.825849348Z Done executing Istio gather script
2026-06-15T08:35:04.946878909Z Gathering data for ns/openshift-console-operator...
2026-06-15T08:35:05.418567183Z Gathering data for ns/openshift-console...
2026-06-15T08:35:05.583124866Z Waiting for performance profile collector pods to become ready: 2
2026-06-15T08:35:05.729426693Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T08:35:06.156187186Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-15T08:35:06.705533614Z Waiting for performance profile collector pods to become ready: 3
2026-06-15T08:35:06.843393554Z Gathering data for ns/openshift-dns-operator...
2026-06-15T08:35:07.188481464Z Gathering data for ns/openshift-dns...
2026-06-15T08:35:07.811106579Z Waiting for performance profile collector pods to become ready: 4
2026-06-15T08:35:08.139909760Z Gathering data for ns/openshift-image-registry...
2026-06-15T08:35:08.711037077Z Gathering data for ns/openshift-ingress-operator...
2026-06-15T08:35:08.973391571Z Waiting for performance profile collector pods to become ready: 5
2026-06-15T08:35:09.407897404Z Gathering data for ns/openshift-ingress...
2026-06-15T08:35:09.976265372Z Gathering data for ns/openshift-ingress-canary...
2026-06-15T08:35:10.076934742Z Waiting for performance profile collector pods to become ready: 6
2026-06-15T08:35:10.612224529Z Gathering data for ns/openshift-insights...
2026-06-15T08:35:10.734025410Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T08:35:11.204041470Z Waiting for performance profile collector pods to become ready: 7
2026-06-15T08:35:12.321280657Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-15T08:35:12.550649476Z Collecting performance related data for node ip-10-0-133-140.ec2.internal
2026-06-15T08:35:12.557860363Z Collecting performance related data for node ip-10-0-134-6.ec2.internal
2026-06-15T08:35:12.565499188Z Collecting performance related data for node ip-10-0-135-160.ec2.internal
2026-06-15T08:35:13.351185303Z Gathering data for ns/openshift-config...
2026-06-15T08:35:13.742067520Z Gathering data for ns/openshift-config-managed...
2026-06-15T08:35:14.333712973Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-15T08:35:14.660893191Z Gathering data for ns/openshift-kube-apiserver...
2026-06-15T08:35:14.988789053Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-15T08:35:15.382022330Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-15T08:35:15.740643384Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T08:35:15.765940937Z Gathering data for ns/openshift-kube-scheduler...
2026-06-15T08:35:16.096273846Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-15T08:35:16.411541083Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-15T08:35:16.850727063Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-15T08:35:17.297829186Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-15T08:35:17.976340515Z Gathering data for ns/openshift-multus...
2026-06-15T08:35:20.247153566Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-15T08:35:20.445399348Z Collecting kubelet logs for node ip-10-0-133-140.ec2.internal
2026-06-15T08:35:20.447191694Z Collecting kubelet logs for node ip-10-0-134-6.ec2.internal
2026-06-15T08:35:20.448924156Z Collecting kubelet logs for node ip-10-0-135-160.ec2.internal
2026-06-15T08:35:20.746550080Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T08:35:20.777828624Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-wjh2w namespace
2026-06-15T08:35:20.785472708Z INFO: Node performance data collection complete.
2026-06-15T08:35:22.176010326Z Gathering data for ns/openshift-host-network...
2026-06-15T08:35:22.628598571Z Gathering data for ns/openshift-network-diagnostics...
2026-06-15T08:35:23.323444542Z Gathering data for ns/openshift-network-node-identity...
2026-06-15T08:35:23.831001062Z Gathering data for ns/openshift-network-operator...
2026-06-15T08:35:24.387784539Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-15T08:35:24.863625954Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-15T08:35:25.537301896Z Gathering data for ns/openshift-apiserver-operator...
2026-06-15T08:35:25.752045101Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-15T08:35:25.921913311Z Gathering data for ns/openshift-apiserver...
2026-06-15T08:35:26.385930850Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-15T08:35:26.787095402Z Gathering data for ns/openshift-controller-manager...
2026-06-15T08:35:27.160892759Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-15T08:35:28.012777064Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-15T08:35:28.368656351Z Gathering data for ns/openshift-service-ca-operator...
2026-06-15T08:35:28.714087655Z Gathering data for ns/openshift-service-ca...
2026-06-15T08:35:29.112266465Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-15T08:35:30.186118182Z Wrote inspect data to must-gather.
2026-06-15T08:35:30.186169167Z error: inspection completed with the errors occurred while gathering data:
2026-06-15T08:35:30.186169167Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-15T08:35:30.317227189Z error: the server doesn't have a resource type "clusters"
2026-06-15T08:35:30.384284030Z Caches written to disk