2026-09-17T09:55:37.432214971Z [disk usage checker] Started
2026-09-17T09:55:37.436053689Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70
2026-09-17T09:55:37.630051905Z Gathering data for ns/openshift-cluster-version...
2026-09-17T09:55:37.768099287Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T09:55:37.858211694Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T09:55:37.947430465Z Gathering data for ns/default...
2026-09-17T09:55:38.239764067Z Gathering data for ns/openshift...
2026-09-17T09:55:38.667565706Z Gathering data for ns/kube-system...
2026-09-17T09:55:39.390049358Z Gathering data for ns/openshift-etcd...
2026-09-17T09:55:39.694338133Z Wrote inspect data to must-gather.
2026-09-17T09:55:39.694383802Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T09:55:39.694383802Z     namespaces "assisted-installer" not found
2026-09-17T09:55:39.960910364Z Waiting on subprocesses to finish execution.
2026-09-17T09:55:39.967646343Z INFO: Gathering HAProxy config files
2026-09-17T09:55:39.969591173Z INFO: Collecting host service logs for crio
2026-09-17T09:55:39.969883780Z INFO: Collecting host service logs for kubelet
2026-09-17T09:55:39.970199622Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T09:55:39.970515343Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T09:55:39.970841644Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T09:55:39.971255009Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T09:55:39.971577004Z INFO: Collecting host service logs for NetworkManager
2026-09-17T09:55:39.971859248Z INFO: Collecting host service logs for openvswitch
2026-09-17T09:55:39.972153439Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T09:55:39.972450922Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T09:55:39.972708908Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T09:55:39.973152485Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T09:55:39.982237166Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T09:55:39.983628278Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T09:55:39.989231479Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T09:55:40.072085698Z Executing Istio gather script
2026-09-17T09:55:40.304855284Z No resources found in openshift-etcd namespace.
2026-09-17T09:55:40.328380155Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T09:55:40.359460293Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T09:55:40.729190602Z INFO: Collecting Insights Archives from insights-operator-5844b856db-xms7d
2026-09-17T09:55:40.729258238Z insights-runtime-extractor-5ncgb
2026-09-17T09:55:40.729281428Z insights-runtime-extractor-ms45d
2026-09-17T09:55:40.729301149Z insights-runtime-extractor-q2xp7
2026-09-17T09:55:40.754958507Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T09:55:40.862140459Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T09:55:40.937513668Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T09:55:40.937513668Z See 'oc rsync -h' for help and examples
2026-09-17T09:55:41.002040164Z Wrote inspect data to must-gather.
2026-09-17T09:55:41.163748698Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T09:55:41.175530564Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T09:55:41.237465537Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T09:55:41.262433983Z ERROR: No running kube-apiserver pods found
2026-09-17T09:55:41.268583086Z No resources found
2026-09-17T09:55:41.400356624Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T09:55:41.493082030Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T09:55:41.657995898Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T09:55:41.658078439Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T09:55:41.788142535Z INFO: Worker host service log collection to complete.
2026-09-17T09:55:42.072982587Z Gathering data for ns/openshift-monitoring...
2026-09-17T09:55:42.148792800Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T09:55:42.174489249Z No resources found
2026-09-17T09:55:42.281175450Z Wrote inspect data to must-gather.
2026-09-17T09:55:42.398729789Z Wrote inspect data to must-gather.
2026-09-17T09:55:42.410121755Z tar: Removing leading `/' from member names
2026-09-17T09:55:42.419078177Z INFO: HAProxy config collection complete.
2026-09-17T09:55:42.449657182Z Wrote inspect data to must-gather.
2026-09-17T09:55:42.468750444Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70
2026-09-17T09:55:42.483469832Z Wrote inspect data to must-gather.
2026-09-17T09:55:42.484641802Z INFO: 'previous-logs' folder not found on ip-10-0-133-199.ec2.internal, skipping...
2026-09-17T09:55:42.498824695Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T09:55:42.551743020Z Wrote inspect data to must-gather.
2026-09-17T09:55:42.561276038Z Wrote inspect data to must-gather.
2026-09-17T09:55:42.665181731Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T09:55:42.701709382Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T09:55:42.806348243Z INFO: 'previous-logs' folder not found on ip-10-0-135-44.ec2.internal, skipping...
2026-09-17T09:55:42.849113676Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T09:55:42.877956856Z Wrote inspect data to must-gather.
2026-09-17T09:55:42.942307157Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T09:55:43.073816026Z INFO: 'previous-logs' folder not found on ip-10-0-141-190.ec2.internal, skipping...
2026-09-17T09:55:43.073934394Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T09:55:43.074008046Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T09:55:43.085884418Z Wrote inspect data to must-gather.
2026-09-17T09:55:43.133533245Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T09:55:43.143516065Z Wrote inspect data to must-gather.
2026-09-17T09:55:43.243019617Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T09:55:43.369645328Z Wrote inspect data to must-gather.
2026-09-17T09:55:43.451732922Z Wrote inspect data to must-gather.
2026-09-17T09:55:43.508149133Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T09:55:43.678520411Z INFO: INTERCONNECT MODE
2026-09-17T09:55:43.678563142Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T09:55:43.684787512Z Wrote inspect data to must-gather.
2026-09-17T09:55:43.753096759Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T09:55:43.770550233Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T09:55:43.822862917Z INFO: Gathering OVN_Northbound from ovnkube-node-2jdwv...
2026-09-17T09:55:43.823212644Z INFO: Gathering OVN_Northbound from ovnkube-node-fdkb8...
2026-09-17T09:55:43.823496794Z INFO: Gathering OVN_Northbound from ovnkube-node-gn9rh...
2026-09-17T09:55:43.823781571Z INFO: Gathering OVN_Southbound from ovnkube-node-2jdwv...
2026-09-17T09:55:43.824066405Z INFO: Gathering OVN_Southbound from ovnkube-node-fdkb8...
2026-09-17T09:55:43.824328929Z INFO: Gathering OVN_Southbound from ovnkube-node-gn9rh...
2026-09-17T09:55:43.928962660Z Wrote inspect data to must-gather.
2026-09-17T09:55:44.006166828Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T09:55:44.121044185Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T09:55:44.156181982Z tar: Removing leading `/' from member names
2026-09-17T09:55:44.175411668Z tar: Removing leading `/' from member names
2026-09-17T09:55:44.211030536Z tar: Removing leading `/' from member names
2026-09-17T09:55:44.213975023Z tar: Removing leading `/' from member names
2026-09-17T09:55:44.235338203Z tar: Removing leading `/' from member names
2026-09-17T09:55:44.243232541Z tar: Removing leading `/' from member names
2026-09-17T09:55:44.265421331Z Wrote inspect data to must-gather.
2026-09-17T09:55:44.341499866Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:44.406479077Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T09:55:44.487590871Z W0917 09:55:44.487538    1407 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-09-17T09:55:44.495132448Z Wrote inspect data to must-gather.
2026-09-17T09:55:44.576139763Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T09:55:44.605139277Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:44.608194014Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T09:55:44.739527210Z INFO: Waiting for network log collection to complete ...
2026-09-17T09:55:44.739649642Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T09:55:44.740166989Z INFO: Copying ovnk databases complete.
2026-09-17T09:55:44.742193088Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-09-17T09:55:44.746444356Z ovnk_database_store/
2026-09-17T09:55:44.746503619Z ovnk_database_store/ovnkube-node-2jdwv_sbdb
2026-09-17T09:55:44.763172249Z ovnk_database_store/ovnkube-node-gn9rh_nbdb
2026-09-17T09:55:44.773279052Z ovnk_database_store/ovnkube-node-2jdwv_nbdb
2026-09-17T09:55:44.778885492Z ovnk_database_store/ovnkube-node-fdkb8_nbdb
2026-09-17T09:55:44.786652694Z ovnk_database_store/ovnkube-node-fdkb8_sbdb
2026-09-17T09:55:44.803400830Z Gathering data for ns/openshift-network-console...
2026-09-17T09:55:44.806273539Z ovnk_database_store/ovnkube-node-gn9rh_sbdb
2026-09-17T09:55:44.825608500Z Wrote inspect data to must-gather.
2026-09-17T09:55:44.827710548Z INFO: Getting status from alertmanager-main-0
2026-09-17T09:55:44.828407410Z INFO: Network log collection complete.
2026-09-17T09:55:44.838866646Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:45.056587559Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:45.059834551Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T09:55:45.138074997Z Wrote inspect data to must-gather.
2026-09-17T09:55:45.250887937Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:45.289960450Z Gathering data for ns/openshift-console-operator...
2026-09-17T09:55:45.407746056Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T09:55:45.410675110Z INFO: Fallback to identify the container image from release info
2026-09-17T09:55:45.451849905Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:45.453943857Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T09:55:45.651100907Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:45.688777264Z Gathering data for ns/openshift-console...
2026-09-17T09:55:45.830226055Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:45.832352168Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T09:55:45.971279986Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:46.158103510Z Wrote inspect data to /must-gather/istio.
2026-09-17T09:55:46.164075886Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T09:55:46.675350347Z Gathering data for ns/openshift-dns-operator...
2026-09-17T09:55:46.726149164Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-17T09:55:46.801633595Z Done executing Istio gather script
2026-09-17T09:55:46.844446049Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T09:55:46.964057514Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T09:55:47.020541811Z Gathering data for ns/openshift-dns...
2026-09-17T09:55:47.474401514Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70
2026-09-17T09:55:47.740934404Z Gathering data for ns/openshift-image-registry...
2026-09-17T09:55:48.073826375Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T09:55:48.205071614Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T09:55:48.527891896Z Gathering data for ns/openshift-ingress...
2026-09-17T09:55:48.865420130Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T09:55:49.194466277Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T09:55:49.261546383Z Gathering data for ns/openshift-insights...
2026-09-17T09:55:50.292935257Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T09:55:51.137410045Z Gathering data for ns/openshift-jobset-operator...
2026-09-17T09:55:51.401758329Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T09:55:51.917139058Z Gathering data for ns/openshift-config...
2026-09-17T09:55:52.181692724Z Gathering data for ns/openshift-config-managed...
2026-09-17T09:55:52.480551620Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70
2026-09-17T09:55:52.511706904Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T09:55:52.610978221Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T09:55:52.881558679Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T09:55:53.144580712Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T09:55:53.430797273Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T09:55:53.627395535Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T09:55:53.738180049Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T09:55:53.995368084Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T09:55:54.306300524Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T09:55:54.645428592Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T09:55:54.744164029Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T09:55:54.984137143Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T09:55:54.988371317Z Collecting performance related data for node ip-10-0-135-44.ec2.internal
2026-09-17T09:55:54.996021350Z Collecting performance related data for node ip-10-0-133-199.ec2.internal
2026-09-17T09:55:55.006284199Z Collecting performance related data for node ip-10-0-141-190.ec2.internal
2026-09-17T09:55:55.568188985Z Gathering data for ns/openshift-multus...
2026-09-17T09:55:57.098463564Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T09:55:57.485513753Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70
2026-09-17T09:55:58.384582128Z Gathering data for ns/openshift-host-network...
2026-09-17T09:55:58.703523638Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T09:55:59.367904592Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T09:55:59.789151801Z Gathering data for ns/openshift-network-operator...
2026-09-17T09:56:00.186804353Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T09:56:00.455490656Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T09:56:00.993024661Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T09:56:01.284641524Z Gathering data for ns/openshift-apiserver...
2026-09-17T09:56:01.680911159Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T09:56:01.944265390Z Gathering data for ns/openshift-controller-manager...
2026-09-17T09:56:02.220645511Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T09:56:02.490577452Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70
2026-09-17T09:56:02.913070306Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T09:56:03.249582438Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T09:56:03.280514556Z Collecting kubelet logs for node ip-10-0-135-44.ec2.internal
2026-09-17T09:56:03.282568977Z Collecting kubelet logs for node ip-10-0-133-199.ec2.internal
2026-09-17T09:56:03.286194993Z Collecting kubelet logs for node ip-10-0-141-190.ec2.internal
2026-09-17T09:56:03.625507086Z Gathering data for ns/openshift-service-ca...
2026-09-17T09:56:03.629179276Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-pcjl2 namespace
2026-09-17T09:56:03.634297805Z INFO: Node performance data collection complete.
2026-09-17T09:56:04.007856962Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T09:56:04.884977250Z Wrote inspect data to must-gather.
2026-09-17T09:56:04.885210741Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T09:56:04.885210741Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T09:56:05.006007101Z error: the server doesn't have a resource type "clusters"
2026-09-17T09:56:05.135021112Z Caches written to disk