2026-09-17T19:33:03.280206272Z [disk usage checker] Started
2026-09-17T19:33:03.283747349Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T19:33:03.486604534Z Gathering data for ns/openshift-cluster-version...
2026-09-17T19:33:03.623161680Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T19:33:03.716959268Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:33:03.800976213Z Gathering data for ns/default...
2026-09-17T19:33:04.152307708Z Gathering data for ns/openshift...
2026-09-17T19:33:04.639565830Z Gathering data for ns/kube-system...
2026-09-17T19:33:05.334197744Z Gathering data for ns/openshift-etcd...
2026-09-17T19:33:05.644150296Z Wrote inspect data to must-gather.
2026-09-17T19:33:05.644183342Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T19:33:05.644183342Z     namespaces "assisted-installer" not found
2026-09-17T19:33:06.156143820Z Waiting on subprocesses to finish execution.
2026-09-17T19:33:06.167902488Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T19:33:06.168552824Z Executing Istio gather script
2026-09-17T19:33:06.169666020Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T19:33:06.170297989Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T19:33:06.173778565Z INFO: Gathering HAProxy config files
2026-09-17T19:33:06.175566937Z INFO: Collecting host service logs for crio
2026-09-17T19:33:06.176021171Z INFO: Collecting host service logs for kubelet
2026-09-17T19:33:06.176376161Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T19:33:06.176679352Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T19:33:06.177033042Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T19:33:06.177464578Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T19:33:06.177798758Z INFO: Collecting host service logs for NetworkManager
2026-09-17T19:33:06.178289755Z INFO: Collecting host service logs for openvswitch
2026-09-17T19:33:06.178625720Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T19:33:06.178963688Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T19:33:06.179318286Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T19:33:06.179718061Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T19:33:06.324512993Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T19:33:06.893405425Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T19:33:06.961018330Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-kj7p7
2026-09-17T19:33:06.961064648Z insights-runtime-extractor-bljts
2026-09-17T19:33:06.961082198Z insights-runtime-extractor-g429k
2026-09-17T19:33:06.961098918Z insights-runtime-extractor-kff2k
2026-09-17T19:33:07.000346212Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T19:33:07.063765730Z No resources found
2026-09-17T19:33:07.299601228Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T19:33:07.366183361Z ERROR: No running kube-apiserver pods found
2026-09-17T19:33:07.501063115Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T19:33:07.552664737Z No resources found in openshift-etcd namespace.
2026-09-17T19:33:07.560368492Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T19:33:07.560463512Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T19:33:07.583195714Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T19:33:07.583195714Z See 'oc rsync -h' for help and examples
2026-09-17T19:33:07.635543941Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T19:33:07.638738826Z INFO: Worker host service log collection to complete.
2026-09-17T19:33:07.753049658Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T19:33:07.863447715Z INFO: 'previous-logs' folder not found on ip-10-0-131-232.ec2.internal, skipping...
2026-09-17T19:33:07.976322629Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T19:33:08.001957595Z Wrote inspect data to must-gather.
2026-09-17T19:33:08.102023739Z Wrote inspect data to must-gather.
2026-09-17T19:33:08.125029366Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T19:33:08.323913958Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T19:33:08.565949773Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:33:08.606700588Z Gathering data for ns/openshift-monitoring...
2026-09-17T19:33:08.649683375Z Wrote inspect data to must-gather.
2026-09-17T19:33:08.825789149Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T19:33:08.888130502Z tar: Removing leading `/' from member names
2026-09-17T19:33:08.889156417Z INFO: 'previous-logs' folder not found on ip-10-0-138-84.ec2.internal, skipping...
2026-09-17T19:33:08.892009885Z INFO: HAProxy config collection complete.
2026-09-17T19:33:08.912748500Z Wrote inspect data to must-gather.
2026-09-17T19:33:08.926855306Z Wrote inspect data to must-gather.
2026-09-17T19:33:08.964608155Z No resources found
2026-09-17T19:33:09.049809184Z Wrote inspect data to must-gather.
2026-09-17T19:33:09.053283977Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T19:33:09.089822173Z Wrote inspect data to must-gather.
2026-09-17T19:33:09.272732995Z INFO: 'previous-logs' folder not found on ip-10-0-140-225.ec2.internal, skipping...
2026-09-17T19:33:09.272769698Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T19:33:09.272802394Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T19:33:09.287600103Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T19:33:09.331302221Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T19:33:09.413250829Z Wrote inspect data to must-gather.
2026-09-17T19:33:09.560943114Z Wrote inspect data to must-gather.
2026-09-17T19:33:09.687080025Z Wrote inspect data to must-gather.
2026-09-17T19:33:09.749313598Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T19:33:09.817142906Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T19:33:09.989264711Z Wrote inspect data to must-gather.
2026-09-17T19:33:10.045911617Z Wrote inspect data to must-gather.
2026-09-17T19:33:10.116053910Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T19:33:10.308521337Z Wrote inspect data to must-gather.
2026-09-17T19:33:10.359274493Z INFO: INTERCONNECT MODE
2026-09-17T19:33:10.359314577Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T19:33:10.363677527Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T19:33:10.374317697Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T19:33:10.547909303Z INFO: Gathering OVN_Northbound from ovnkube-node-cw78b...
2026-09-17T19:33:10.548226369Z INFO: Gathering OVN_Northbound from ovnkube-node-kdm8s...
2026-09-17T19:33:10.548488120Z INFO: Gathering OVN_Northbound from ovnkube-node-vbxgv...
2026-09-17T19:33:10.548841521Z INFO: Gathering OVN_Southbound from ovnkube-node-cw78b...
2026-09-17T19:33:10.549221797Z INFO: Gathering OVN_Southbound from ovnkube-node-kdm8s...
2026-09-17T19:33:10.549551120Z INFO: Gathering OVN_Southbound from ovnkube-node-vbxgv...
2026-09-17T19:33:10.571436375Z Wrote inspect data to must-gather.
2026-09-17T19:33:10.690225183Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T19:33:10.876170144Z tar: Removing leading `/' from member names
2026-09-17T19:33:10.924630375Z tar: Removing leading `/' from member names
2026-09-17T19:33:10.938661226Z tar: Removing leading `/' from member names
2026-09-17T19:33:10.947234142Z tar: Removing leading `/' from member names
2026-09-17T19:33:10.984699296Z tar: Removing leading `/' from member names
2026-09-17T19:33:11.013722364Z Wrote inspect data to must-gather.
2026-09-17T19:33:11.019925271Z tar: Removing leading `/' from member names
2026-09-17T19:33:11.119234069Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T19:33:11.207405807Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:33:11.328512092Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T19:33:11.382489322Z Wrote inspect data to must-gather.
2026-09-17T19:33:11.439263227Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T19:33:11.455197453Z Gathering data for ns/openshift-network-console...
2026-09-17T19:33:11.572736760Z INFO: Waiting for network log collection to complete ...
2026-09-17T19:33:11.572863104Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T19:33:11.573413244Z INFO: Copying ovnk databases complete.
2026-09-17T19:33:11.576049316Z 3.7M	must-gather/network_logs/ovnk_database_store
2026-09-17T19:33:11.580332935Z ovnk_database_store/
2026-09-17T19:33:11.580332935Z ovnk_database_store/ovnkube-node-vbxgv_nbdb
2026-09-17T19:33:11.583054258Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:11.592506805Z ovnk_database_store/ovnkube-node-vbxgv_sbdb
2026-09-17T19:33:11.617622688Z ovnk_database_store/ovnkube-node-cw78b_sbdb
2026-09-17T19:33:11.643640173Z ovnk_database_store/ovnkube-node-kdm8s_nbdb
2026-09-17T19:33:11.652868423Z ovnk_database_store/ovnkube-node-cw78b_nbdb
2026-09-17T19:33:11.662317744Z ovnk_database_store/ovnkube-node-kdm8s_sbdb
2026-09-17T19:33:11.688760072Z INFO: Network log collection complete.
2026-09-17T19:33:11.741054396Z Wrote inspect data to must-gather.
2026-09-17T19:33:11.857605585Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:11.860617742Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T19:33:11.922193074Z INFO: Getting status from alertmanager-main-0
2026-09-17T19:33:12.071864492Z Gathering data for ns/openshift-console-operator...
2026-09-17T19:33:12.125276990Z Wrote inspect data to must-gather.
2026-09-17T19:33:12.135440392Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:12.370227438Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:12.373275913Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T19:33:12.435554638Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T19:33:12.438639176Z INFO: Fallback to identify the container image from release info
2026-09-17T19:33:12.511789240Z Gathering data for ns/openshift-console...
2026-09-17T19:33:12.589138921Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:12.786198973Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:12.788828613Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T19:33:13.029569266Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:13.036809690Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-17T19:33:13.043234787Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T19:33:13.186535024Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T19:33:13.260820059Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:13.265386170Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-09-17T19:33:13.336330727Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T19:33:13.357058356Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T19:33:13.461621142Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:13.651373167Z Gathering data for ns/openshift-dns-operator...
2026-09-17T19:33:13.706316048Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:13.709212038Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-09-17T19:33:13.891125083Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:13.986428920Z Gathering data for ns/openshift-dns...
2026-09-17T19:33:14.090566367Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:14.093258889Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T19:33:14.265473851Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:14.476020265Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T19:33:14.481944196Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:33:14.665067395Z Gathering data for ns/openshift-image-registry...
2026-09-17T19:33:15.178065207Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T19:33:15.189353283Z Done executing Istio gather script
2026-09-17T19:33:15.503081166Z Gathering data for ns/openshift-ingress...
2026-09-17T19:33:15.618836754Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T19:33:15.844024273Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T19:33:16.222339547Z Gathering data for ns/openshift-insights...
2026-09-17T19:33:16.746586738Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T19:33:17.885039970Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T19:33:18.361939606Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T19:33:18.623903325Z Gathering data for ns/kserve...
2026-09-17T19:33:19.004969850Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T19:33:20.131489574Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T19:33:20.470843539Z Gathering data for ns/openshift-config...
2026-09-17T19:33:20.777189000Z Gathering data for ns/openshift-config-managed...
2026-09-17T19:33:21.267971991Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T19:33:21.312552446Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T19:33:21.559702695Z Collecting performance related data for node ip-10-0-131-232.ec2.internal
2026-09-17T19:33:21.568849090Z Collecting performance related data for node ip-10-0-140-225.ec2.internal
2026-09-17T19:33:21.577778874Z Collecting performance related data for node ip-10-0-138-84.ec2.internal
2026-09-17T19:33:21.687959302Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T19:33:22.045132728Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T19:33:22.427238587Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T19:33:22.824184924Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T19:33:23.197524867Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T19:33:23.366695216Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T19:33:23.513898014Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T19:33:23.882499214Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T19:33:24.259452437Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T19:33:24.855357675Z Gathering data for ns/openshift-multus...
2026-09-17T19:33:26.326229444Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T19:33:27.786323270Z Gathering data for ns/openshift-host-network...
2026-09-17T19:33:28.141138425Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T19:33:28.371427575Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T19:33:28.718126834Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T19:33:29.157801115Z Gathering data for ns/openshift-network-operator...
2026-09-17T19:33:29.570325773Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T19:33:29.834732764Z Collecting kubelet logs for node ip-10-0-131-232.ec2.internal
2026-09-17T19:33:29.836596843Z Collecting kubelet logs for node ip-10-0-140-225.ec2.internal
2026-09-17T19:33:29.838474767Z Collecting kubelet logs for node ip-10-0-138-84.ec2.internal
2026-09-17T19:33:29.895287301Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T19:33:30.213614811Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-n9b8n namespace
2026-09-17T19:33:30.220380932Z INFO: Node performance data collection complete.
2026-09-17T19:33:30.489203527Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T19:33:30.855114646Z Gathering data for ns/openshift-apiserver...
2026-09-17T19:33:31.288423156Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T19:33:31.593913112Z Gathering data for ns/openshift-controller-manager...
2026-09-17T19:33:31.908154579Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T19:33:32.646550751Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T19:33:32.982674762Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T19:33:33.298553625Z Gathering data for ns/openshift-service-ca...
2026-09-17T19:33:33.377092900Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-09-17T19:33:33.677638846Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T19:33:34.572225127Z Wrote inspect data to must-gather.
2026-09-17T19:33:34.572271903Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T19:33:34.572271903Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T19:33:34.704241579Z error: the server doesn't have a resource type "clusters"
2026-09-17T19:33:34.874191082Z Caches written to disk