2026-09-17T03:40:45.087698275Z [disk usage checker] Started
2026-09-17T03:40:45.091058965Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T03:40:45.277147883Z Gathering data for ns/openshift-cluster-version...
2026-09-17T03:40:45.421004416Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T03:40:45.508319649Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T03:40:45.587635643Z Gathering data for ns/default...
2026-09-17T03:40:45.863143014Z Gathering data for ns/openshift...
2026-09-17T03:40:46.256527579Z Gathering data for ns/kube-system...
2026-09-17T03:40:46.964215381Z Gathering data for ns/openshift-etcd...
2026-09-17T03:40:47.271171508Z Wrote inspect data to must-gather.
2026-09-17T03:40:47.271244780Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T03:40:47.271244780Z     namespaces "assisted-installer" not found
2026-09-17T03:40:47.566069493Z Waiting on subprocesses to finish execution.
2026-09-17T03:40:47.576399392Z INFO: Gathering HAProxy config files
2026-09-17T03:40:47.578586512Z Executing Istio gather script
2026-09-17T03:40:47.582013202Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T03:40:47.590091058Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T03:40:47.596569455Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T03:40:47.598066003Z INFO: Collecting host service logs for crio
2026-09-17T03:40:47.598458839Z INFO: Collecting host service logs for kubelet
2026-09-17T03:40:47.598790339Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T03:40:47.599118583Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T03:40:47.599440504Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T03:40:47.599759906Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T03:40:47.600062957Z INFO: Collecting host service logs for NetworkManager
2026-09-17T03:40:47.600377345Z INFO: Collecting host service logs for openvswitch
2026-09-17T03:40:47.600690692Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T03:40:47.601010975Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T03:40:47.601344110Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T03:40:47.601721048Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T03:40:47.635794335Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T03:40:48.088470136Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T03:40:48.412849965Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T03:40:48.449266701Z No resources found
2026-09-17T03:40:48.557874333Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T03:40:48.664789592Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T03:40:48.679483137Z INFO: Collecting Insights Archives from insights-operator-5844b856db-5zc2n
2026-09-17T03:40:48.679524774Z insights-runtime-extractor-5tbsh
2026-09-17T03:40:48.679545122Z insights-runtime-extractor-qsdhk
2026-09-17T03:40:48.679564090Z insights-runtime-extractor-swb6z
2026-09-17T03:40:48.701651954Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T03:40:48.768590350Z No resources found in openshift-etcd namespace.
2026-09-17T03:40:48.840636754Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T03:40:49.168023077Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T03:40:49.168380275Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T03:40:49.237495648Z INFO: Worker host service log collection to complete.
2026-09-17T03:40:49.339229030Z Wrote inspect data to must-gather.
2026-09-17T03:40:49.372872312Z Wrote inspect data to must-gather.
2026-09-17T03:40:49.649072530Z Wrote inspect data to must-gather.
2026-09-17T03:40:49.664169837Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T03:40:49.733912042Z Wrote inspect data to must-gather.
2026-09-17T03:40:49.800116617Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T03:40:49.831739072Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T03:40:49.831739072Z See 'oc rsync -h' for help and examples
2026-09-17T03:40:49.913871477Z No resources found
2026-09-17T03:40:49.915460782Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T03:40:49.983596144Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T03:40:49.985256522Z ERROR: No running kube-apiserver pods found
2026-09-17T03:40:50.064833334Z Wrote inspect data to must-gather.
2026-09-17T03:40:50.101926698Z Wrote inspect data to must-gather.
2026-09-17T03:40:50.105002728Z INFO: 'previous-logs' folder not found on ip-10-0-129-170.ec2.internal, skipping...
2026-09-17T03:40:50.111680830Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T03:40:50.114149942Z Wrote inspect data to must-gather.
2026-09-17T03:40:50.179966093Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T03:40:50.339378894Z tar: Removing leading `/' from member names
2026-09-17T03:40:50.344430856Z INFO: HAProxy config collection complete.
2026-09-17T03:40:50.402563893Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T03:40:50.407148504Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T03:40:50.428270613Z Wrote inspect data to must-gather.
2026-09-17T03:40:50.454696087Z INFO: 'previous-logs' folder not found on ip-10-0-139-162.ec2.internal, skipping...
2026-09-17T03:40:50.574627424Z Gathering data for ns/openshift-monitoring...
2026-09-17T03:40:50.649827332Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T03:40:50.675962677Z Wrote inspect data to must-gather.
2026-09-17T03:40:50.732552140Z Wrote inspect data to must-gather.
2026-09-17T03:40:50.744899642Z INFO: 'previous-logs' folder not found on ip-10-0-142-129.ec2.internal, skipping...
2026-09-17T03:40:50.744939392Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T03:40:50.744967949Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T03:40:50.828816842Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T03:40:50.868194077Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T03:40:50.989015056Z Wrote inspect data to must-gather.
2026-09-17T03:40:51.037836083Z Wrote inspect data to must-gather.
2026-09-17T03:40:51.246029409Z Wrote inspect data to must-gather.
2026-09-17T03:40:51.249859541Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T03:40:51.270109366Z INFO: INTERCONNECT MODE
2026-09-17T03:40:51.270148186Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T03:40:51.422579275Z INFO: Gathering OVN_Northbound from ovnkube-node-bsbpp...
2026-09-17T03:40:51.422793583Z INFO: Gathering OVN_Northbound from ovnkube-node-lf6pm...
2026-09-17T03:40:51.423043471Z INFO: Gathering OVN_Northbound from ovnkube-node-z52l4...
2026-09-17T03:40:51.423331824Z INFO: Gathering OVN_Southbound from ovnkube-node-bsbpp...
2026-09-17T03:40:51.423568205Z INFO: Gathering OVN_Southbound from ovnkube-node-lf6pm...
2026-09-17T03:40:51.423869315Z INFO: Gathering OVN_Southbound from ovnkube-node-z52l4...
2026-09-17T03:40:51.458409408Z Wrote inspect data to must-gather.
2026-09-17T03:40:51.484482230Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T03:40:51.488789364Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T03:40:51.717487824Z tar: Removing leading `/' from member names
2026-09-17T03:40:51.730439567Z tar: Removing leading `/' from member names
2026-09-17T03:40:51.732869883Z tar: Removing leading `/' from member names
2026-09-17T03:40:51.738126966Z tar: Removing leading `/' from member names
2026-09-17T03:40:51.749499395Z tar: Removing leading `/' from member names
2026-09-17T03:40:51.750492886Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:51.779932920Z tar: Removing leading `/' from member names
2026-09-17T03:40:51.791811942Z Wrote inspect data to must-gather.
2026-09-17T03:40:51.795085470Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T03:40:51.971990578Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:51.975009978Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T03:40:52.060211370Z Wrote inspect data to must-gather.
2026-09-17T03:40:52.066488225Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T03:40:52.208653399Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:52.220467276Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T03:40:52.224359461Z INFO: Waiting for network log collection to complete ...
2026-09-17T03:40:52.224480871Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T03:40:52.224911625Z INFO: Copying ovnk databases complete.
2026-09-17T03:40:52.226453983Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-09-17T03:40:52.228836313Z ovnk_database_store/
2026-09-17T03:40:52.228881449Z ovnk_database_store/ovnkube-node-lf6pm_sbdb
2026-09-17T03:40:52.251629263Z ovnk_database_store/ovnkube-node-bsbpp_nbdb
2026-09-17T03:40:52.257651075Z ovnk_database_store/ovnkube-node-z52l4_sbdb
2026-09-17T03:40:52.268592593Z Wrote inspect data to must-gather.
2026-09-17T03:40:52.276926531Z ovnk_database_store/ovnkube-node-bsbpp_sbdb
2026-09-17T03:40:52.295546655Z ovnk_database_store/ovnkube-node-z52l4_nbdb
2026-09-17T03:40:52.302467670Z ovnk_database_store/ovnkube-node-lf6pm_nbdb
2026-09-17T03:40:52.312388967Z INFO: Network log collection complete.
2026-09-17T03:40:52.413403707Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:52.416464539Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T03:40:52.453102003Z INFO: Getting status from alertmanager-main-0
2026-09-17T03:40:52.488375258Z Wrote inspect data to must-gather.
2026-09-17T03:40:52.611602977Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:52.738655179Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T03:40:52.740618164Z INFO: Fallback to identify the container image from release info
2026-09-17T03:40:52.807985563Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:52.811513804Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T03:40:52.815851317Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T03:40:52.984489615Z Gathering data for ns/openshift-network-console...
2026-09-17T03:40:53.020071937Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:53.207393873Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:53.209622924Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T03:40:53.332088566Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:667babb345aeb39d2681913fd91a5c163d48d4ab8a3ba0d3156502181ea1177a
2026-09-17T03:40:53.377727229Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:53.411816463Z Gathering data for ns/openshift-console-operator...
2026-09-17T03:40:53.455090235Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T03:40:53.582483503Z Wrote inspect data to /must-gather/istio.
2026-09-17T03:40:53.598418645Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T03:40:53.791288794Z Gathering data for ns/openshift-console...
2026-09-17T03:40:54.237782242Z Done executing Istio gather script
2026-09-17T03:40:54.304266094Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T03:40:54.717558807Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T03:40:54.753114326Z Gathering data for ns/openshift-dns-operator...
2026-09-17T03:40:55.020974947Z Gathering data for ns/openshift-dns...
2026-09-17T03:40:55.121887208Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T03:40:55.575782085Z Gathering data for ns/openshift-image-registry...
2026-09-17T03:40:55.823289569Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T03:40:56.012437484Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T03:40:56.316460110Z Gathering data for ns/openshift-ingress...
2026-09-17T03:40:56.624536072Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T03:40:56.939020092Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T03:40:56.987741854Z Gathering data for ns/openshift-insights...
2026-09-17T03:40:58.039235469Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T03:40:58.746262196Z Gathering data for ns/openshift-jobset-operator...
2026-09-17T03:40:59.150398807Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T03:40:59.528045924Z Gathering data for ns/openshift-config...
2026-09-17T03:40:59.771468303Z Gathering data for ns/openshift-config-managed...
2026-09-17T03:41:00.126131108Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T03:41:00.158726286Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T03:41:00.276011603Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T03:41:00.422444880Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T03:41:00.682187575Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T03:41:00.942669586Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T03:41:01.207726851Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T03:41:01.380493052Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T03:41:01.460804632Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T03:41:01.622280847Z Collecting performance related data for node ip-10-0-142-129.ec2.internal
2026-09-17T03:41:01.631700909Z Collecting performance related data for node ip-10-0-139-162.ec2.internal
2026-09-17T03:41:01.641116494Z Collecting performance related data for node ip-10-0-129-170.ec2.internal
2026-09-17T03:41:01.788811669Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T03:41:02.154422750Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T03:41:02.524075694Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T03:41:03.129332738Z Gathering data for ns/openshift-multus...
2026-09-17T03:41:04.557423390Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T03:41:05.130513796Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T03:41:05.748186376Z Gathering data for ns/openshift-host-network...
2026-09-17T03:41:06.056980309Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T03:41:06.604692569Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T03:41:06.996142749Z Gathering data for ns/openshift-network-operator...
2026-09-17T03:41:07.377142092Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T03:41:07.619976525Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T03:41:08.088072330Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T03:41:08.411018074Z Gathering data for ns/openshift-apiserver...
2026-09-17T03:41:08.807062672Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T03:41:09.066602999Z Gathering data for ns/openshift-controller-manager...
2026-09-17T03:41:09.245655850Z Collecting kubelet logs for node ip-10-0-142-129.ec2.internal
2026-09-17T03:41:09.248657141Z Collecting kubelet logs for node ip-10-0-139-162.ec2.internal
2026-09-17T03:41:09.251494315Z Collecting kubelet logs for node ip-10-0-129-170.ec2.internal
2026-09-17T03:41:09.352496031Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T03:41:09.570895097Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-ffwdb namespace
2026-09-17T03:41:09.576357555Z INFO: Node performance data collection complete.
2026-09-17T03:41:10.004060871Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T03:41:10.134902053Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-09-17T03:41:10.321403600Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T03:41:10.610548371Z Gathering data for ns/openshift-service-ca...
2026-09-17T03:41:10.971983978Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T03:41:11.826854195Z Wrote inspect data to must-gather.
2026-09-17T03:41:11.826899604Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T03:41:11.826899604Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T03:41:11.943835321Z error: the server doesn't have a resource type "clusters"
2026-09-17T03:41:12.068436332Z Caches written to disk