2026-10-30T18:51:49.240081847Z [disk usage checker] Started
2026-10-30T18:51:49.243980808Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:51:49.468075545Z Gathering data for ns/openshift-cluster-version...
2026-10-30T18:51:49.607748635Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+
2026-10-30T18:51:49.694959022Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-30T18:51:49.783145809Z Gathering data for ns/default...
2026-10-30T18:51:50.072443336Z Gathering data for ns/openshift...
2026-10-30T18:51:50.539502592Z Gathering data for ns/kube-system...
2026-10-30T18:51:51.380650209Z Gathering data for ns/openshift-etcd...
2026-10-30T18:51:51.660413322Z Wrote inspect data to must-gather.
2026-10-30T18:51:51.660444181Z error: inspection completed with the errors occurred while gathering data:
2026-10-30T18:51:51.660444181Z     namespaces "assisted-installer" not found
2026-10-30T18:51:54.248656414Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:51:59.253027843Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:04.257586687Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:09.262063167Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:14.266461853Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:19.270769750Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:24.275204460Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:29.279603923Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:31.506176906Z Waiting on subprocesses to finish execution.
2026-10-30T18:52:31.512913950Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-10-30T18:52:31.514595318Z INFO: Gathering HAProxy config files
2026-10-30T18:52:31.515296163Z INFO: Gathering machine config daemon's old logs from all nodes
2026-10-30T18:52:31.521880306Z Executing Istio gather script
2026-10-30T18:52:31.524093408Z INFO: Collecting host service logs for crio
2026-10-30T18:52:31.524656854Z INFO: Collecting host service logs for kubelet
2026-10-30T18:52:31.525115239Z INFO: Collecting host service logs for rpm-ostreed
2026-10-30T18:52:31.525246589Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-10-30T18:52:31.525532702Z INFO: Collecting host service logs for ostree-finalize-staged
2026-10-30T18:52:31.525926077Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-10-30T18:52:31.526343638Z INFO: Collecting host service logs for machine-config-daemon-host
2026-10-30T18:52:31.526709696Z INFO: Collecting host service logs for NetworkManager
2026-10-30T18:52:31.527104685Z INFO: Collecting host service logs for openvswitch
2026-10-30T18:52:31.527431847Z INFO: Collecting host service logs for ovs-configuration
2026-10-30T18:52:31.527820217Z INFO: Collecting host service logs for ovsdb-server
2026-10-30T18:52:31.528273562Z INFO: Collecting host service logs for ovs-vswitchd
2026-10-30T18:52:31.528539332Z INFO: Waiting for node performance related collection to complete ...
2026-10-30T18:52:31.528700936Z INFO: Waiting for worker host service log collection to complete ...
2026-10-30T18:52:32.310455396Z INFO: "metallb-operator" not detected. Skipping.
2026-10-30T18:52:32.426218077Z error: the server doesn't have a resource type "performanceprofile"
2026-10-30T18:52:32.491644345Z No resources found
2026-10-30T18:52:32.755271391Z INFO: Found 1 replicas - prometheus-k8s-0
2026-10-30T18:52:32.910296008Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-10-30T18:52:32.986849579Z INFO: Collecting Insights Archives from insights-operator-7c4986d449-shm69
2026-10-30T18:52:32.986913979Z insights-runtime-extractor-cxfnh
2026-10-30T18:52:32.986937591Z insights-runtime-extractor-pbjgc
2026-10-30T18:52:32.986966915Z insights-runtime-extractor-xxqpw
2026-10-30T18:52:33.074709784Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-10-30T18:52:33.222782186Z No resources found in openshift-etcd namespace.
2026-10-30T18:52:33.225102541Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-10-30T18:52:33.225193403Z INFO: on-disk MachineConfig config collection complete.
2026-10-30T18:52:33.386624190Z No resources found
2026-10-30T18:52:33.450562363Z Wrote inspect data to must-gather.
2026-10-30T18:52:33.460699046Z INFO: "nfd" not detected. Skipping.
2026-10-30T18:52:33.493649769Z INFO: Waiting for HAProxy config collection to complete ...
2026-10-30T18:52:33.584831638Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-30T18:52:33.712775285Z Wrote inspect data to must-gather.
2026-10-30T18:52:33.770094260Z ERROR: No running kube-apiserver pods found
2026-10-30T18:52:33.797304812Z Wrote inspect data to must-gather.
2026-10-30T18:52:33.886675224Z Wrote inspect data to must-gather.
2026-10-30T18:52:33.896090718Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-10-30T18:52:33.912409113Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-10-30T18:52:33.912409113Z See 'oc rsync -h' for help and examples
2026-10-30T18:52:33.966122903Z Wrote inspect data to must-gather.
2026-10-30T18:52:34.025617070Z tar: Removing leading `/' from member names
2026-10-30T18:52:34.031751693Z INFO: HAProxy config collection complete.
2026-10-30T18:52:34.052276295Z Wrote inspect data to must-gather.
2026-10-30T18:52:34.066849036Z Wrote inspect data to must-gather.
2026-10-30T18:52:34.136384340Z error: the server doesn't have a resource type "machineconfigs"
2026-10-30T18:52:34.285095211Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:34.311968305Z error: the server doesn't have a resource type "machineconfigpools"
2026-10-30T18:52:34.316009545Z Wrote inspect data to must-gather.
2026-10-30T18:52:34.466634349Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-10-30T18:52:34.543075303Z Wrote inspect data to must-gather.
2026-10-30T18:52:34.554856774Z Wrote inspect data to must-gather.
2026-10-30T18:52:34.690020911Z error: the server doesn't have a resource type "kubeletconfigs"
2026-10-30T18:52:34.791469721Z Wrote inspect data to must-gather.
2026-10-30T18:52:34.880783174Z Wrote inspect data to must-gather.
2026-10-30T18:52:35.045410263Z INFO: LEGACY MODE
2026-10-30T18:52:35.045447146Z INFO: Gathering ovn-kubernetes master data
2026-10-30T18:52:35.086064714Z Wrote inspect data to must-gather.
2026-10-30T18:52:35.286822048Z Wrote inspect data to must-gather.
2026-10-30T18:52:35.410661428Z Inspecting resource crd/backendtlspolicies.gateway.networking.k8s.io
2026-10-30T18:52:35.593874780Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:52:35.692997316Z INFO: Waiting for network log collection to complete ...
2026-10-30T18:52:35.693037709Z INFO: Waiting for ovnk database copies to complete ...
2026-10-30T18:52:35.765649687Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:52:35.768382014Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-10-30T18:52:35.906069069Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:52:36.064917122Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:52:36.067586759Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-10-30T18:52:36.223092715Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:52:36.380718686Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:52:36.383281930Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-10-30T18:52:39.289787931Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:42.012295894Z error: Get "https://172.31.0.1:443/api/v1/nodes?labelSelector=node-role.kubernetes.io%2Fmaster": net/http: TLS handshake timeout
2026-10-30T18:52:42.653714595Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:52:42.656045622Z INFO: "sriov-network-operator" not detected. Skipping.
2026-10-30T18:52:43.044594636Z error: Get "https://172.31.0.1:443/api/v1/nodes?labelSelector=node-role.kubernetes.io%2Fmaster": net/http: TLS handshake timeout
2026-10-30T18:52:43.047303669Z INFO: Worker host service log collection to complete.
2026-10-30T18:52:43.732544889Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:52:43.812046562Z INFO: 'previous-logs' folder not found on ip-10-0-131-7.us-east-2.compute.internal, skipping...
2026-10-30T18:52:43.822239413Z E1030 18:52:43.822199     697 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://172.31.0.1:443/api?timeout=32s\": net/http: TLS handshake timeout"
2026-10-30T18:52:43.928563124Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:52:43.931429321Z /usr/bin/monitoring_common.sh: line 15: READY_PROM_PODS[0]: unbound variable
2026-10-30T18:52:43.933884074Z Wrote inspect data to must-gather.
2026-10-30T18:52:43.935022942Z INFO: Getting alertmanagers from 
2026-10-30T18:52:43.937397695Z INFO: Copying ovnk databases complete.
2026-10-30T18:52:43.938883060Z du: cannot access 'must-gather/network_logs/ovnk_database_store': No such file or directory
2026-10-30T18:52:43.939426857Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 686 is not a child of this shell
2026-10-30T18:52:43.939426857Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 687 is not a child of this shell
2026-10-30T18:52:43.939426857Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 688 is not a child of this shell
2026-10-30T18:52:43.939426857Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 689 is not a child of this shell
2026-10-30T18:52:43.939426857Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 690 is not a child of this shell
2026-10-30T18:52:43.939454878Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 691 is not a child of this shell
2026-10-30T18:52:43.939454878Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 692 is not a child of this shell
2026-10-30T18:52:43.939454878Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 693 is not a child of this shell
2026-10-30T18:52:43.939454878Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 708 is not a child of this shell
2026-10-30T18:52:43.939454878Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 709 is not a child of this shell
2026-10-30T18:52:43.939454878Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 710 is not a child of this shell
2026-10-30T18:52:43.939454878Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 711 is not a child of this shell
2026-10-30T18:52:43.939454878Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 712 is not a child of this shell
2026-10-30T18:52:43.943357691Z tar: ovnk_database_store: Cannot stat: No such file or directory
2026-10-30T18:52:43.946926231Z tar: Exiting with failure status due to previous errors
2026-10-30T18:52:43.947514174Z INFO: Network log collection complete.
2026-10-30T18:52:44.008009744Z INFO: 'previous-logs' folder not found on ip-10-0-137-242.us-east-2.compute.internal, skipping...
2026-10-30T18:52:44.202202554Z INFO: 'previous-logs' folder not found on ip-10-0-141-76.us-east-2.compute.internal, skipping...
2026-10-30T18:52:44.202257443Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-10-30T18:52:44.202257443Z INFO: Machine Config Daemon termination log collection complete.
2026-10-30T18:52:44.294142612Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:45.392716742Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:52:45.556910268Z Wrote inspect data to must-gather.
2026-10-30T18:52:45.721378648Z Wrote inspect data to must-gather.
2026-10-30T18:52:45.880787422Z Wrote inspect data to must-gather.
2026-10-30T18:52:46.101976248Z INFO: Hosted cluster detected, get NTO container image from the TuneD pod
2026-10-30T18:52:46.208728947Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c
2026-10-30T18:52:46.309769548Z daemonset.apps/perf-node-gather-daemonset created
2026-10-30T18:52:46.466910177Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:52:49.298555078Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:54.109634257Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:52:54.112290868Z /usr/bin/monitoring_common.sh: line 15: READY_PROM_PODS[0]: unbound variable
2026-10-30T18:52:54.115782368Z INFO: Getting rules from 
2026-10-30T18:52:54.303111859Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:52:54.306419489Z INFO: Getting status/config from prometheus-k8s-0
2026-10-30T18:52:54.592937405Z INFO: Getting status/flags from prometheus-k8s-0
2026-10-30T18:52:54.749358285Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-10-30T18:52:54.910100284Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-10-30T18:52:56.406484800Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:52:56.409141101Z Daemonset perf-node-gather-daemonset ready  out of 
2026-10-30T18:52:56.553384265Z E1030 18:52:56.553334    1523 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://172.31.0.1:443/api?timeout=32s\": net/http: TLS handshake timeout"
2026-10-30T18:52:56.622489993Z Collecting performance related data for node ip-10-0-141-76.us-east-2.compute.internal
2026-10-30T18:52:56.625985420Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:52:56.628766757Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-10-30T18:52:56.630407087Z Collecting performance related data for node ip-10-0-137-242.us-east-2.compute.internal
2026-10-30T18:52:56.637409833Z Collecting performance related data for node ip-10-0-131-7.us-east-2.compute.internal
2026-10-30T18:52:56.843644674Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:52:57.023862396Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:52:57.026528314Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-10-30T18:52:59.307629226Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:04.312071746Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:05.104885553Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-10-30T18:53:06.952612980Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:53:07.108421356Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:53:09.316486383Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:14.321127143Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:15.371749854Z INFO: Getting status from alertmanager-main-0
2026-10-30T18:53:17.211543475Z E1030 18:53:17.211501    1832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://172.31.0.1:443/api?timeout=32s\": net/http: TLS handshake timeout"
2026-10-30T18:53:17.292299070Z Wrote inspect data to /must-gather/istio.
2026-10-30T18:53:19.325628798Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:24.329942847Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:27.685423271Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:53:27.743486829Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-30T18:53:27.991949465Z Done executing Istio gather script
2026-10-30T18:53:29.334368943Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:34.338883329Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:39.343334471Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:44.347667233Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:49.352127782Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:54.356549356Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:53:59.360943563Z [disk usage checker] Volume usage percentage: current = 9 ; allowed = 70
2026-10-30T18:54:02.169921547Z error while getting pods list: Get "https://172.31.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dip-10-0-141-76.us-east-2.compute.internal%2Cstatus.phase%3DRunning": net/http: TLS handshake timeout
2026-10-30T18:54:02.172331564Z command terminated with exit code 1
2026-10-30T18:54:02.177420172Z Collecting kubelet logs for node ip-10-0-141-76.us-east-2.compute.internal
2026-10-30T18:54:02.179210949Z Collecting kubelet logs for node ip-10-0-137-242.us-east-2.compute.internal
2026-10-30T18:54:02.180921010Z Collecting kubelet logs for node ip-10-0-131-7.us-east-2.compute.internal
2026-10-30T18:54:02.527739765Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-n5nx5 namespace
2026-10-30T18:54:02.533260460Z INFO: Node performance data collection complete.
2026-10-30T18:54:02.665222873Z error: the server doesn't have a resource type "clusters"
2026-10-30T18:54:02.699634834Z Caches written to disk