2026-07-31T14:14:36.271279413Z [disk usage checker] Started
2026-07-31T14:14:36.274535019Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:14:36.458578441Z Gathering data for ns/openshift-cluster-version...
2026-07-31T14:14:36.602463060Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-31T14:14:36.693109765Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-31T14:14:36.772610052Z Gathering data for ns/default...
2026-07-31T14:14:37.070760669Z Gathering data for ns/openshift...
2026-07-31T14:14:37.480345780Z Gathering data for ns/kube-system...
2026-07-31T14:14:38.184683101Z Gathering data for ns/openshift-etcd...
2026-07-31T14:14:38.476408363Z Wrote inspect data to must-gather.
2026-07-31T14:14:38.476437345Z error: inspection completed with the errors occurred while gathering data:
2026-07-31T14:14:38.476437345Z     namespaces "assisted-installer" not found
2026-07-31T14:14:38.703362710Z Waiting on subprocesses to finish execution.
2026-07-31T14:14:38.712617155Z INFO: Gathering HAProxy config files
2026-07-31T14:14:38.719228660Z INFO: Gathering machine config daemon's old logs from all nodes
2026-07-31T14:14:38.722495465Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-07-31T14:14:38.722846846Z INFO: Collecting host service logs for crio
2026-07-31T14:14:38.723134716Z Executing Istio gather script
2026-07-31T14:14:38.723192768Z INFO: Collecting host service logs for kubelet
2026-07-31T14:14:38.723475388Z INFO: Collecting host service logs for rpm-ostreed
2026-07-31T14:14:38.723851652Z INFO: Collecting host service logs for ostree-finalize-staged
2026-07-31T14:14:38.724217326Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-07-31T14:14:38.724515016Z INFO: Collecting host service logs for machine-config-daemon-host
2026-07-31T14:14:38.724819049Z INFO: Collecting host service logs for NetworkManager
2026-07-31T14:14:38.725188632Z INFO: Collecting host service logs for openvswitch
2026-07-31T14:14:38.725410589Z INFO: Collecting host service logs for ovs-configuration
2026-07-31T14:14:38.725733877Z INFO: Collecting host service logs for ovsdb-server
2026-07-31T14:14:38.726049161Z INFO: Collecting host service logs for ovs-vswitchd
2026-07-31T14:14:38.726506716Z INFO: Waiting for worker host service log collection to complete ...
2026-07-31T14:14:38.757992497Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-07-31T14:14:38.899358917Z INFO: Waiting for node performance related collection to complete ...
2026-07-31T14:14:39.133516251Z INFO: Collecting Insights Archives from insights-operator-77696685b-6mcbt
2026-07-31T14:14:39.133555595Z insights-runtime-extractor-7q8fp
2026-07-31T14:14:39.133575176Z insights-runtime-extractor-dzld4
2026-07-31T14:14:39.133594133Z insights-runtime-extractor-f9rg4
2026-07-31T14:14:39.318770187Z No resources found
2026-07-31T14:14:39.330801173Z No resources found in openshift-etcd namespace.
2026-07-31T14:14:39.515556967Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-07-31T14:14:39.567363340Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-07-31T14:14:39.567363340Z See 'oc rsync -h' for help and examples
2026-07-31T14:14:39.762998458Z INFO: Found 1 replicas - prometheus-k8s-0
2026-07-31T14:14:39.874922895Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-07-31T14:14:39.884988551Z INFO: "sriov-network-operator" not detected. Skipping.
2026-07-31T14:14:39.988120206Z INFO: "metallb-operator" not detected. Skipping.
2026-07-31T14:14:40.067954019Z error: the server doesn't have a resource type "performanceprofile"
2026-07-31T14:14:40.075664070Z Wrote inspect data to must-gather.
2026-07-31T14:14:40.153303433Z INFO: Worker host service log collection to complete.
2026-07-31T14:14:40.169789800Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-07-31T14:14:40.169822374Z INFO: on-disk MachineConfig config collection complete.
2026-07-31T14:14:40.330532323Z ERROR: No running kube-apiserver pods found
2026-07-31T14:14:40.427077582Z Wrote inspect data to must-gather.
2026-07-31T14:14:40.700269709Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-07-31T14:14:40.716777874Z Wrote inspect data to must-gather.
2026-07-31T14:14:40.810212630Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-07-31T14:14:40.879376568Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-31T14:14:40.917700556Z No resources found
2026-07-31T14:14:40.940123359Z Wrote inspect data to must-gather.
2026-07-31T14:14:40.977893332Z Wrote inspect data to must-gather.
2026-07-31T14:14:40.978398734Z INFO: Waiting for HAProxy config collection to complete ...
2026-07-31T14:14:41.051812153Z Wrote inspect data to must-gather.
2026-07-31T14:14:41.080504543Z Gathering data for ns/openshift-monitoring...
2026-07-31T14:14:41.123038098Z INFO: 'previous-logs' folder not found on ip-10-0-130-105.ec2.internal, skipping...
2026-07-31T14:14:41.164405464Z Wrote inspect data to must-gather.
2026-07-31T14:14:41.282962392Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:14:41.295754133Z tar: Removing leading `/' from member names
2026-07-31T14:14:41.303511121Z INFO: HAProxy config collection complete.
2026-07-31T14:14:41.362306489Z error: the server doesn't have a resource type "machineconfigs"
2026-07-31T14:14:41.391951378Z Wrote inspect data to must-gather.
2026-07-31T14:14:41.429518856Z INFO: 'previous-logs' folder not found on ip-10-0-133-220.ec2.internal, skipping...
2026-07-31T14:14:41.475905573Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-07-31T14:14:41.488281812Z INFO: Getting rules from prometheus-k8s-0
2026-07-31T14:14:41.529310676Z error: the server doesn't have a resource type "machineconfigpools"
2026-07-31T14:14:41.677138308Z Wrote inspect data to must-gather.
2026-07-31T14:14:41.712148379Z INFO: 'previous-logs' folder not found on ip-10-0-140-63.ec2.internal, skipping...
2026-07-31T14:14:41.712187258Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-07-31T14:14:41.712226143Z INFO: Machine Config Daemon termination log collection complete.
2026-07-31T14:14:41.771051222Z Wrote inspect data to must-gather.
2026-07-31T14:14:41.921173789Z Wrote inspect data to must-gather.
2026-07-31T14:14:41.933817371Z error: the server doesn't have a resource type "kubeletconfigs"
2026-07-31T14:14:41.944136676Z INFO: Getting status/config from prometheus-k8s-0
2026-07-31T14:14:42.130540957Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-07-31T14:14:42.142669906Z Wrote inspect data to must-gather.
2026-07-31T14:14:42.193041989Z INFO: INTERCONNECT MODE
2026-07-31T14:14:42.193076235Z INFO: Gathering ovn-kubernetes DBs
2026-07-31T14:14:42.326463768Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:42.344241997Z INFO: Getting status/flags from prometheus-k8s-0
2026-07-31T14:14:42.356313109Z Wrote inspect data to must-gather.
2026-07-31T14:14:42.362701189Z INFO: Gathering OVN_Northbound from ovnkube-node-8s9n4...
2026-07-31T14:14:42.362971152Z INFO: Gathering OVN_Northbound from ovnkube-node-sqlt9...
2026-07-31T14:14:42.363312355Z INFO: Gathering OVN_Northbound from ovnkube-node-ztflv...
2026-07-31T14:14:42.363632950Z INFO: Gathering OVN_Southbound from ovnkube-node-8s9n4...
2026-07-31T14:14:42.363917652Z INFO: Gathering OVN_Southbound from ovnkube-node-sqlt9...
2026-07-31T14:14:42.364231348Z INFO: Gathering OVN_Southbound from ovnkube-node-ztflv...
2026-07-31T14:14:42.684319538Z tar: Removing leading `/' from member names
2026-07-31T14:14:42.686432725Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-07-31T14:14:42.724357347Z tar: Removing leading `/' from member names
2026-07-31T14:14:42.725864831Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:42.732054110Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-07-31T14:14:42.741476414Z tar: Removing leading `/' from member names
2026-07-31T14:14:42.756199829Z tar: Removing leading `/' from member names
2026-07-31T14:14:42.758203983Z tar: Removing leading `/' from member names
2026-07-31T14:14:42.759947735Z tar: Removing leading `/' from member names
2026-07-31T14:14:42.782477277Z Wrote inspect data to must-gather.
2026-07-31T14:14:42.849247058Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-31T14:14:42.970320061Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-07-31T14:14:42.985694793Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:43.014117496Z Wrote inspect data to must-gather.
2026-07-31T14:14:43.180448175Z INFO: Waiting for network log collection to complete ...
2026-07-31T14:14:43.180500025Z INFO: Waiting for ovnk database copies to complete ...
2026-07-31T14:14:43.180997595Z INFO: Copying ovnk databases complete.
2026-07-31T14:14:43.182558178Z 2.4M	must-gather/network_logs/ovnk_database_store
2026-07-31T14:14:43.184921728Z ovnk_database_store/
2026-07-31T14:14:43.184921728Z ovnk_database_store/ovnkube-node-8s9n4_sbdb
2026-07-31T14:14:43.206520634Z ovnk_database_store/ovnkube-node-sqlt9_sbdb
2026-07-31T14:14:43.218163144Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:43.220935014Z ovnk_database_store/ovnkube-node-ztflv_nbdb
2026-07-31T14:14:43.221500957Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-07-31T14:14:43.226649067Z ovnk_database_store/ovnkube-node-ztflv_sbdb
2026-07-31T14:14:43.242385354Z Wrote inspect data to must-gather.
2026-07-31T14:14:43.246429813Z ovnk_database_store/ovnkube-node-sqlt9_nbdb
2026-07-31T14:14:43.247340996Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-07-31T14:14:43.251842492Z ovnk_database_store/ovnkube-node-8s9n4_nbdb
2026-07-31T14:14:43.259796481Z INFO: Network log collection complete.
2026-07-31T14:14:43.422464105Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:43.433522340Z W0731 14:14:43.433484    1492 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-07-31T14:14:43.438441858Z Wrote inspect data to must-gather.
2026-07-31T14:14:43.522025595Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-31T14:14:43.641734623Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:43.644514115Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-07-31T14:14:43.662617284Z INFO: Getting status from alertmanager-main-0
2026-07-31T14:14:43.727924037Z Gathering data for ns/openshift-network-console...
2026-07-31T14:14:43.750019327Z Wrote inspect data to must-gather.
2026-07-31T14:14:43.891564713Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:44.020238900Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-07-31T14:14:44.024260437Z INFO: Fallback to identify the container image from release info
2026-07-31T14:14:44.088008859Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:44.091747224Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-07-31T14:14:44.202076094Z Gathering data for ns/openshift-console-operator...
2026-07-31T14:14:44.255401841Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:44.429908455Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:14:44.559024496Z Gathering data for ns/openshift-console...
2026-07-31T14:14:44.687432806Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f2eb1033f55d7129b37ecfc3e4e9a306e42e5ab3dd7d2fe0ff08c8b45ea2b675
2026-07-31T14:14:44.801501870Z daemonset.apps/perf-node-gather-daemonset created
2026-07-31T14:14:44.930036997Z Waiting for performance profile collector pods to become ready: 1
2026-07-31T14:14:45.080933571Z Gathering data for ns/openshift-cluster-storage-operator...
2026-07-31T14:14:45.083101117Z Done executing Istio gather script
2026-07-31T14:14:45.548224215Z Gathering data for ns/openshift-dns-operator...
2026-07-31T14:14:45.796192298Z Gathering data for ns/openshift-dns...
2026-07-31T14:14:46.035905719Z Waiting for performance profile collector pods to become ready: 2
2026-07-31T14:14:46.291202832Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:14:46.368773996Z Gathering data for ns/openshift-image-registry...
2026-07-31T14:14:46.827654416Z Gathering data for ns/openshift-ingress-operator...
2026-07-31T14:14:47.158297516Z Waiting for performance profile collector pods to become ready: 3
2026-07-31T14:14:47.214326106Z Gathering data for ns/openshift-ingress...
2026-07-31T14:14:47.551497000Z Gathering data for ns/openshift-ingress-canary...
2026-07-31T14:14:47.924765623Z Gathering data for ns/openshift-insights...
2026-07-31T14:14:48.284453334Z Waiting for performance profile collector pods to become ready: 4
2026-07-31T14:14:49.383501739Z Waiting for performance profile collector pods to become ready: 5
2026-07-31T14:14:49.739935345Z Gathering data for ns/openshift-config...
2026-07-31T14:14:49.986546296Z Gathering data for ns/openshift-config-managed...
2026-07-31T14:14:50.364941336Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-07-31T14:14:50.489244353Z Waiting for performance profile collector pods to become ready: 6
2026-07-31T14:14:50.621221980Z Gathering data for ns/openshift-kube-apiserver...
2026-07-31T14:14:50.909734414Z Gathering data for ns/openshift-kube-controller-manager...
2026-07-31T14:14:51.172968850Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-07-31T14:14:51.296172689Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:14:51.431826303Z Gathering data for ns/openshift-kube-scheduler...
2026-07-31T14:14:51.585604860Z Waiting for performance profile collector pods to become ready: 7
2026-07-31T14:14:51.723249999Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-07-31T14:14:51.985024052Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-07-31T14:14:52.293784117Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-07-31T14:14:52.584957873Z Gathering data for ns/openshift-user-workload-monitoring...
2026-07-31T14:14:52.702978099Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-07-31T14:14:52.949885868Z Collecting performance related data for node ip-10-0-140-63.ec2.internal
2026-07-31T14:14:52.956596096Z Collecting performance related data for node ip-10-0-130-105.ec2.internal
2026-07-31T14:14:52.963894151Z Collecting performance related data for node ip-10-0-133-220.ec2.internal
2026-07-31T14:14:53.142490643Z Gathering data for ns/openshift-multus...
2026-07-31T14:14:54.582053603Z Gathering data for ns/openshift-ovn-kubernetes...
2026-07-31T14:14:55.812882642Z Gathering data for ns/openshift-host-network...
2026-07-31T14:14:56.111556898Z Gathering data for ns/openshift-network-diagnostics...
2026-07-31T14:14:56.300830135Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:14:56.605185918Z Gathering data for ns/openshift-network-node-identity...
2026-07-31T14:14:57.042067717Z Gathering data for ns/openshift-network-operator...
2026-07-31T14:14:57.407325956Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-07-31T14:14:57.668625737Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-07-31T14:14:58.135919137Z Gathering data for ns/openshift-apiserver-operator...
2026-07-31T14:14:58.421946756Z Gathering data for ns/openshift-apiserver...
2026-07-31T14:14:58.784508339Z Gathering data for ns/openshift-controller-manager-operator...
2026-07-31T14:14:59.025009848Z Gathering data for ns/openshift-controller-manager...
2026-07-31T14:14:59.267441417Z Gathering data for ns/openshift-cluster-samples-operator...
2026-07-31T14:14:59.902848337Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-07-31T14:15:00.169544544Z Gathering data for ns/openshift-service-ca-operator...
2026-07-31T14:15:00.474076733Z Gathering data for ns/openshift-service-ca...
2026-07-31T14:15:00.606341360Z Collecting kubelet logs for node ip-10-0-140-63.ec2.internal
2026-07-31T14:15:00.608074534Z Collecting kubelet logs for node ip-10-0-130-105.ec2.internal
2026-07-31T14:15:00.609772116Z Collecting kubelet logs for node ip-10-0-133-220.ec2.internal
2026-07-31T14:15:00.869267818Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-07-31T14:15:00.949249828Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-gbtdg namespace
2026-07-31T14:15:00.953904738Z INFO: Node performance data collection complete.
2026-07-31T14:15:01.306107473Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:15:01.717130113Z Wrote inspect data to must-gather.
2026-07-31T14:15:01.717171764Z error: inspection completed with the errors occurred while gathering data:
2026-07-31T14:15:01.717171764Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-07-31T14:15:01.833574744Z error: the server doesn't have a resource type "clusters"
2026-07-31T14:15:01.982806517Z Caches written to disk