2026-09-17T19:39:49.092256041Z [disk usage checker] Started
2026-09-17T19:39:49.095619862Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T19:39:49.313228909Z Gathering data for ns/openshift-cluster-version...
2026-09-17T19:39:49.452260813Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T19:39:49.543366251Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:39:49.631666894Z Gathering data for ns/default...
2026-09-17T19:39:49.939163060Z Gathering data for ns/openshift...
2026-09-17T19:39:50.350456221Z Gathering data for ns/kube-system...
2026-09-17T19:39:51.078409947Z Gathering data for ns/openshift-etcd...
2026-09-17T19:39:51.431482447Z Wrote inspect data to must-gather.
2026-09-17T19:39:51.431512862Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T19:39:51.431512862Z     namespaces "assisted-installer" not found
2026-09-17T19:39:51.677056971Z Waiting on subprocesses to finish execution.
2026-09-17T19:39:51.683510847Z INFO: Gathering HAProxy config files
2026-09-17T19:39:51.692080664Z Executing Istio gather script
2026-09-17T19:39:51.703948174Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-17T19:39:51.705329721Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-17T19:39:51.710933693Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-17T19:39:51.717902747Z INFO: Collecting host service logs for crio
2026-09-17T19:39:51.718276833Z INFO: Collecting host service logs for kubelet
2026-09-17T19:39:51.718637904Z INFO: Collecting host service logs for rpm-ostreed
2026-09-17T19:39:51.719059620Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-17T19:39:51.719400785Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-17T19:39:51.719756137Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-17T19:39:51.720079886Z INFO: Collecting host service logs for NetworkManager
2026-09-17T19:39:51.720420725Z INFO: Collecting host service logs for openvswitch
2026-09-17T19:39:51.720765327Z INFO: Collecting host service logs for ovs-configuration
2026-09-17T19:39:51.721112611Z INFO: Collecting host service logs for ovsdb-server
2026-09-17T19:39:51.721442642Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-17T19:39:51.721875390Z INFO: Waiting for worker host service log collection to complete ...
2026-09-17T19:39:51.729632366Z INFO: Waiting for node performance related collection to complete ...
2026-09-17T19:39:52.588234073Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-17T19:39:52.648551487Z INFO: "metallb-operator" not detected. Skipping.
2026-09-17T19:39:52.656481655Z No resources found
2026-09-17T19:39:52.821263065Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-9g97z
2026-09-17T19:39:52.821320139Z insights-runtime-extractor-gml75
2026-09-17T19:39:52.821339485Z insights-runtime-extractor-tvjpf
2026-09-17T19:39:52.821359532Z insights-runtime-extractor-xvb8p
2026-09-17T19:39:52.824878940Z No resources found in openshift-etcd namespace.
2026-09-17T19:39:52.839929901Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-17T19:39:52.840079960Z INFO: on-disk MachineConfig config collection complete.
2026-09-17T19:39:52.947474434Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-17T19:39:53.011682976Z Wrote inspect data to must-gather.
2026-09-17T19:39:53.321383564Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-17T19:39:53.347738480Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-17T19:39:53.509359209Z Wrote inspect data to must-gather.
2026-09-17T19:39:53.517555003Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-17T19:39:53.582257044Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:39:53.627941339Z Wrote inspect data to must-gather.
2026-09-17T19:39:53.654312805Z error: the server doesn't have a resource type "performanceprofile"
2026-09-17T19:39:53.666101523Z INFO: Worker host service log collection to complete.
2026-09-17T19:39:53.674114857Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-17T19:39:53.705865216Z Wrote inspect data to must-gather.
2026-09-17T19:39:53.738963179Z No resources found
2026-09-17T19:39:53.870856494Z Wrote inspect data to must-gather.
2026-09-17T19:39:53.933202965Z ERROR: No running kube-apiserver pods found
2026-09-17T19:39:54.002220253Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-17T19:39:54.002220253Z See 'oc rsync -h' for help and examples
2026-09-17T19:39:54.053988452Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-17T19:39:54.113315623Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T19:39:54.153954428Z INFO: 'previous-logs' folder not found on ip-10-0-133-193.ec2.internal, skipping...
2026-09-17T19:39:54.219153679Z Wrote inspect data to must-gather.
2026-09-17T19:39:54.227665526Z tar: Removing leading `/' from member names
2026-09-17T19:39:54.231261601Z INFO: HAProxy config collection complete.
2026-09-17T19:39:54.237933633Z Wrote inspect data to must-gather.
2026-09-17T19:39:54.258366237Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-17T19:39:54.366212251Z Wrote inspect data to must-gather.
2026-09-17T19:39:54.377982510Z Gathering data for ns/openshift-monitoring...
2026-09-17T19:39:54.438383567Z error: the server doesn't have a resource type "machineconfigs"
2026-09-17T19:39:54.468767759Z INFO: 'previous-logs' folder not found on ip-10-0-137-32.ec2.internal, skipping...
2026-09-17T19:39:54.560609800Z INFO: Getting rules from prometheus-k8s-0
2026-09-17T19:39:54.634885877Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-17T19:39:54.658513067Z Wrote inspect data to must-gather.
2026-09-17T19:39:54.732491166Z INFO: 'previous-logs' folder not found on ip-10-0-140-6.ec2.internal, skipping...
2026-09-17T19:39:54.732576156Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-17T19:39:54.732613005Z INFO: Machine Config Daemon termination log collection complete.
2026-09-17T19:39:54.865125625Z Wrote inspect data to must-gather.
2026-09-17T19:39:54.917195535Z Wrote inspect data to must-gather.
2026-09-17T19:39:54.991833087Z INFO: Getting status/config from prometheus-k8s-0
2026-09-17T19:39:55.031096075Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-17T19:39:55.205639920Z INFO: INTERCONNECT MODE
2026-09-17T19:39:55.205639920Z INFO: Gathering ovn-kubernetes DBs
2026-09-17T19:39:55.248070662Z Wrote inspect data to must-gather.
2026-09-17T19:39:55.296897451Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-17T19:39:55.381100163Z INFO: Gathering OVN_Northbound from ovnkube-node-7bphs...
2026-09-17T19:39:55.381324526Z INFO: Gathering OVN_Northbound from ovnkube-node-tzqrz...
2026-09-17T19:39:55.381532733Z INFO: Gathering OVN_Northbound from ovnkube-node-x6bkg...
2026-09-17T19:39:55.381835794Z INFO: Gathering OVN_Southbound from ovnkube-node-7bphs...
2026-09-17T19:39:55.382081163Z INFO: Gathering OVN_Southbound from ovnkube-node-tzqrz...
2026-09-17T19:39:55.382363541Z INFO: Gathering OVN_Southbound from ovnkube-node-x6bkg...
2026-09-17T19:39:55.409166885Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-17T19:39:55.517169997Z Wrote inspect data to must-gather.
2026-09-17T19:39:55.605749048Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:55.704355107Z tar: Removing leading `/' from member names
2026-09-17T19:39:55.736266392Z tar: Removing leading `/' from member names
2026-09-17T19:39:55.737146096Z tar: Removing leading `/' from member names
2026-09-17T19:39:55.794964401Z tar: Removing leading `/' from member names
2026-09-17T19:39:55.800030328Z tar: Removing leading `/' from member names
2026-09-17T19:39:55.830748970Z Wrote inspect data to must-gather.
2026-09-17T19:39:55.830748970Z tar: Removing leading `/' from member names
2026-09-17T19:39:55.831816824Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-17T19:39:55.869134239Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:55.871524785Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-17T19:39:56.077502340Z Wrote inspect data to must-gather.
2026-09-17T19:39:56.099052089Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-17T19:39:56.109367772Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:56.237599936Z INFO: Waiting for network log collection to complete ...
2026-09-17T19:39:56.237630432Z INFO: Waiting for ovnk database copies to complete ...
2026-09-17T19:39:56.238036368Z INFO: Copying ovnk databases complete.
2026-09-17T19:39:56.240100080Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-09-17T19:39:56.242407210Z ovnk_database_store/
2026-09-17T19:39:56.242407210Z ovnk_database_store/ovnkube-node-7bphs_nbdb
2026-09-17T19:39:56.245199238Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-17T19:39:56.248464019Z ovnk_database_store/ovnkube-node-7bphs_sbdb
2026-09-17T19:39:56.262050598Z ovnk_database_store/ovnkube-node-tzqrz_sbdb
2026-09-17T19:39:56.279838823Z ovnk_database_store/ovnkube-node-x6bkg_nbdb
2026-09-17T19:39:56.286023682Z ovnk_database_store/ovnkube-node-tzqrz_nbdb
2026-09-17T19:39:56.291539739Z ovnk_database_store/ovnkube-node-x6bkg_sbdb
2026-09-17T19:39:56.305847864Z Wrote inspect data to must-gather.
2026-09-17T19:39:56.309217630Z INFO: Network log collection complete.
2026-09-17T19:39:56.327749653Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:56.330218586Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-17T19:39:56.407996635Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-17T19:39:56.530104076Z Wrote inspect data to must-gather.
2026-09-17T19:39:56.531685245Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:56.737231740Z Wrote inspect data to must-gather.
2026-09-17T19:39:56.743813702Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:56.746394472Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-17T19:39:56.815910842Z INFO: Getting status from alertmanager-main-0
2026-09-17T19:39:56.969508481Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-17T19:39:56.987463264Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:57.002314510Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-17T19:39:57.004384771Z INFO: Fallback to identify the container image from release info
2026-09-17T19:39:57.156532591Z Gathering data for ns/openshift-network-console...
2026-09-17T19:39:57.182042575Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:57.184671499Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-17T19:39:57.340753197Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:57.535273979Z Wrote inspect data to /must-gather/istio.
2026-09-17T19:39:57.601980644Z Gathering data for ns/openshift-console-operator...
2026-09-17T19:39:57.637431718Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-17T19:39:57.769041346Z daemonset.apps/perf-node-gather-daemonset created
2026-09-17T19:39:57.909549381Z Waiting for performance profile collector pods to become ready: 1
2026-09-17T19:39:58.050009051Z Gathering data for ns/openshift-console...
2026-09-17T19:39:58.256694471Z Done executing Istio gather script
2026-09-17T19:39:58.573115454Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-17T19:39:59.029187529Z Waiting for performance profile collector pods to become ready: 2
2026-09-17T19:39:59.118047824Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T19:39:59.136203322Z Gathering data for ns/openshift-dns-operator...
2026-09-17T19:39:59.543825099Z Gathering data for ns/openshift-dns...
2026-09-17T19:40:00.150105148Z Waiting for performance profile collector pods to become ready: 3
2026-09-17T19:40:00.184688015Z Gathering data for ns/openshift-image-registry...
2026-09-17T19:40:00.677432443Z Gathering data for ns/openshift-ingress-operator...
2026-09-17T19:40:01.012855312Z Gathering data for ns/openshift-ingress...
2026-09-17T19:40:01.270513934Z Waiting for performance profile collector pods to become ready: 4
2026-09-17T19:40:01.391928341Z Gathering data for ns/openshift-ingress-canary...
2026-09-17T19:40:01.845594222Z Gathering data for ns/openshift-insights...
2026-09-17T19:40:02.393094913Z Waiting for performance profile collector pods to become ready: 5
2026-09-17T19:40:03.508740090Z Waiting for performance profile collector pods to become ready: 6
2026-09-17T19:40:03.951439343Z Gathering data for ns/openshift-config...
2026-09-17T19:40:04.126002849Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T19:40:04.237694948Z Gathering data for ns/openshift-config-managed...
2026-09-17T19:40:04.635885363Z Waiting for performance profile collector pods to become ready: 7
2026-09-17T19:40:04.685838134Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-17T19:40:04.982765809Z Gathering data for ns/openshift-kube-apiserver...
2026-09-17T19:40:05.312400384Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-17T19:40:05.695935261Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-17T19:40:05.766795626Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-17T19:40:06.006811662Z Collecting performance related data for node ip-10-0-133-193.ec2.internal
2026-09-17T19:40:06.018928035Z Collecting performance related data for node ip-10-0-140-6.ec2.internal
2026-09-17T19:40:06.024977016Z Collecting performance related data for node ip-10-0-137-32.ec2.internal
2026-09-17T19:40:06.113851540Z Gathering data for ns/openshift-kube-scheduler...
2026-09-17T19:40:06.493737438Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-17T19:40:06.911109528Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-17T19:40:07.365623968Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-17T19:40:07.876401382Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-17T19:40:08.481087548Z Gathering data for ns/openshift-multus...
2026-09-17T19:40:09.132710440Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T19:40:10.175214274Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-17T19:40:11.560224203Z Gathering data for ns/openshift-host-network...
2026-09-17T19:40:11.897950321Z Gathering data for ns/openshift-network-diagnostics...
2026-09-17T19:40:12.466238009Z Gathering data for ns/openshift-network-node-identity...
2026-09-17T19:40:12.935007898Z Gathering data for ns/openshift-network-operator...
2026-09-17T19:40:13.345483554Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-17T19:40:13.640900204Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-17T19:40:14.109940998Z Collecting kubelet logs for node ip-10-0-133-193.ec2.internal
2026-09-17T19:40:14.111668123Z Collecting kubelet logs for node ip-10-0-140-6.ec2.internal
2026-09-17T19:40:14.113513547Z Collecting kubelet logs for node ip-10-0-137-32.ec2.internal
2026-09-17T19:40:14.139493651Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-17T19:40:14.177940164Z Gathering data for ns/openshift-apiserver-operator...
2026-09-17T19:40:14.452240505Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-phksr namespace
2026-09-17T19:40:14.458644859Z INFO: Node performance data collection complete.
2026-09-17T19:40:14.561071587Z Gathering data for ns/openshift-apiserver...
2026-09-17T19:40:15.014769443Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-17T19:40:15.305648973Z Gathering data for ns/openshift-controller-manager...
2026-09-17T19:40:15.646898326Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-17T19:40:16.337237664Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-17T19:40:16.665698148Z Gathering data for ns/openshift-service-ca-operator...
2026-09-17T19:40:16.994224070Z Gathering data for ns/openshift-service-ca...
2026-09-17T19:40:17.424996395Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-17T19:40:18.354018713Z Wrote inspect data to must-gather.
2026-09-17T19:40:18.354070087Z error: inspection completed with the errors occurred while gathering data:
2026-09-17T19:40:18.354070087Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-17T19:40:18.480570656Z error: the server doesn't have a resource type "clusters"
2026-09-17T19:40:18.603194426Z Caches written to disk