2026-10-31T14:54:52.307641971Z [disk usage checker] Started
2026-10-31T14:54:52.311325164Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:54:53.217398714Z Gathering data for ns/openshift-cluster-version...
2026-10-31T14:54:54.115386921Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+
2026-10-31T14:54:54.662431408Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-31T14:54:55.164280388Z Gathering data for ns/default...
2026-10-31T14:54:57.007092980Z Gathering data for ns/openshift...
2026-10-31T14:54:57.315957474Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:54:58.775850758Z Waiting on subprocesses to finish execution.
2026-10-31T14:54:58.783384305Z INFO: Gathering HAProxy config files
2026-10-31T14:54:58.790807834Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-10-31T14:54:58.792527808Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-10-31T14:54:58.798414352Z INFO: Gathering machine config daemon's old logs from all nodes
2026-10-31T14:54:58.799667236Z Executing Istio gather script
2026-10-31T14:54:58.804191985Z INFO: Collecting host service logs for crio
2026-10-31T14:54:58.804520850Z INFO: Collecting host service logs for kubelet
2026-10-31T14:54:58.804800506Z INFO: Collecting host service logs for rpm-ostreed
2026-10-31T14:54:58.805087885Z INFO: Collecting host service logs for ostree-finalize-staged
2026-10-31T14:54:58.805397056Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-10-31T14:54:58.805726495Z INFO: Collecting host service logs for machine-config-daemon-host
2026-10-31T14:54:58.806101805Z INFO: Collecting host service logs for NetworkManager
2026-10-31T14:54:58.806407722Z INFO: Collecting host service logs for openvswitch
2026-10-31T14:54:58.806697843Z INFO: Collecting host service logs for ovs-configuration
2026-10-31T14:54:58.806995602Z INFO: Collecting host service logs for ovsdb-server
2026-10-31T14:54:58.807332602Z INFO: Collecting host service logs for ovs-vswitchd
2026-10-31T14:54:58.807678438Z INFO: Waiting for worker host service log collection to complete ...
2026-10-31T14:54:58.957632795Z INFO: Waiting for node performance related collection to complete ...
2026-10-31T14:54:59.009432485Z Gathering data for ns/kube-system...
2026-10-31T14:54:59.634977955Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-10-31T14:54:59.756714932Z INFO: "metallb-operator" not detected. Skipping.
2026-10-31T14:54:59.806944166Z INFO: Found 1 replicas - prometheus-k8s-0
2026-10-31T14:54:59.992992158Z Wrote inspect data to must-gather.
2026-10-31T14:55:00.098434280Z No resources found
2026-10-31T14:55:00.102182203Z INFO: "sriov-network-operator" not detected. Skipping.
2026-10-31T14:55:00.166095154Z No resources found in openshift-etcd namespace.
2026-10-31T14:55:00.201175021Z INFO: Collecting Insights Archives from insights-operator-7c4986d449-bxzpg
2026-10-31T14:55:00.201263785Z insights-runtime-extractor-5ltdb
2026-10-31T14:55:00.201308550Z insights-runtime-extractor-fsgr7
2026-10-31T14:55:00.201308550Z insights-runtime-extractor-zk96p
2026-10-31T14:55:00.203756707Z INFO: "nfd" not detected. Skipping.
2026-10-31T14:55:00.206795537Z INFO: Worker host service log collection to complete.
2026-10-31T14:55:00.236336294Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-10-31T14:55:00.236437682Z INFO: on-disk MachineConfig config collection complete.
2026-10-31T14:55:00.238482845Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-10-31T14:55:00.325410648Z error: the server doesn't have a resource type "performanceprofile"
2026-10-31T14:55:00.438959042Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-10-31T14:55:00.495207626Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-10-31T14:55:00.495207626Z See 'oc rsync -h' for help and examples
2026-10-31T14:55:00.612619634Z INFO: Waiting for HAProxy config collection to complete ...
2026-10-31T14:55:00.766670915Z ERROR: No running kube-apiserver pods found
2026-10-31T14:55:01.084347159Z Wrote inspect data to must-gather.
2026-10-31T14:55:01.132871877Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-10-31T14:55:01.137797230Z No resources found
2026-10-31T14:55:01.148742075Z INFO: 'previous-logs' folder not found on ip-10-0-129-227.us-west-2.compute.internal, skipping...
2026-10-31T14:55:01.170879758Z Wrote inspect data to must-gather.
2026-10-31T14:55:01.383384298Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-31T14:55:01.480820338Z Wrote inspect data to must-gather.
2026-10-31T14:55:01.504427930Z Wrote inspect data to must-gather.
2026-10-31T14:55:01.559958997Z Wrote inspect data to must-gather.
2026-10-31T14:55:01.568719452Z INFO: 'previous-logs' folder not found on ip-10-0-139-23.us-west-2.compute.internal, skipping...
2026-10-31T14:55:01.589371103Z Wrote inspect data to must-gather.
2026-10-31T14:55:01.665127196Z error: the server doesn't have a resource type "machineconfigs"
2026-10-31T14:55:01.672888091Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-10-31T14:55:01.872479739Z tar: Removing leading `/' from member names
2026-10-31T14:55:01.939277455Z INFO: 'previous-logs' folder not found on ip-10-0-141-83.us-west-2.compute.internal, skipping...
2026-10-31T14:55:01.939417862Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-10-31T14:55:01.939487835Z INFO: Machine Config Daemon termination log collection complete.
2026-10-31T14:55:01.964593221Z INFO: HAProxy config collection complete.
2026-10-31T14:55:02.012608908Z Wrote inspect data to must-gather.
2026-10-31T14:55:02.088080824Z error: the server doesn't have a resource type "machineconfigpools"
2026-10-31T14:55:02.313769213Z INFO: Getting rules from prometheus-k8s-0
2026-10-31T14:55:02.321114260Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:02.498847241Z Inspecting resource crd/backendtlspolicies.gateway.networking.k8s.io
2026-10-31T14:55:02.573354277Z Wrote inspect data to must-gather.
2026-10-31T14:55:02.680972844Z Wrote inspect data to must-gather.
2026-10-31T14:55:02.981412837Z error: the server doesn't have a resource type "kubeletconfigs"
2026-10-31T14:55:02.982586115Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:03.307529716Z Wrote inspect data to must-gather.
2026-10-31T14:55:03.371952368Z Wrote inspect data to must-gather.
2026-10-31T14:55:03.389643017Z Gathering data for ns/openshift-cloud-credential-operator...
2026-10-31T14:55:03.576609977Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:03.579352333Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-10-31T14:55:03.790760609Z Wrote inspect data to must-gather.
2026-10-31T14:55:03.802944286Z INFO: Getting status/config from prometheus-k8s-0
2026-10-31T14:55:03.974315654Z INFO: LEGACY MODE
2026-10-31T14:55:03.974355494Z INFO: Gathering ovn-kubernetes master data
2026-10-31T14:55:04.029448407Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:04.160053653Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+
2026-10-31T14:55:04.185825710Z Wrote inspect data to must-gather.
2026-10-31T14:55:04.620083544Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:04.623334493Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-10-31T14:55:04.670407390Z Wrote inspect data to must-gather.
2026-10-31T14:55:04.754287322Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-31T14:55:05.066121104Z Wrote inspect data to must-gather.
2026-10-31T14:55:05.158476506Z INFO: Getting status/flags from prometheus-k8s-0
2026-10-31T14:55:05.168584243Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:05.499830410Z Wrote inspect data to must-gather.
2026-10-31T14:55:05.811910366Z INFO: Waiting for network log collection to complete ...
2026-10-31T14:55:05.811948883Z INFO: Waiting for ovnk database copies to complete ...
2026-10-31T14:55:05.812411141Z INFO: Copying ovnk databases complete.
2026-10-31T14:55:05.814178114Z du: cannot access 'must-gather/network_logs/ovnk_database_store': No such file or directory
2026-10-31T14:55:05.815091253Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 756 is not a child of this shell
2026-10-31T14:55:05.815133133Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 757 is not a child of this shell
2026-10-31T14:55:05.815158614Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 759 is not a child of this shell
2026-10-31T14:55:05.815182153Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 761 is not a child of this shell
2026-10-31T14:55:05.815203914Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 762 is not a child of this shell
2026-10-31T14:55:05.815244884Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 763 is not a child of this shell
2026-10-31T14:55:05.815280703Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 765 is not a child of this shell
2026-10-31T14:55:05.815321466Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 766 is not a child of this shell
2026-10-31T14:55:05.815321466Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 784 is not a child of this shell
2026-10-31T14:55:05.815321466Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 785 is not a child of this shell
2026-10-31T14:55:05.815321466Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 786 is not a child of this shell
2026-10-31T14:55:05.815321466Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 789 is not a child of this shell
2026-10-31T14:55:05.815321466Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 794 is not a child of this shell
2026-10-31T14:55:05.819000664Z tar: ovnk_database_store: Cannot stat: No such file or directory
2026-10-31T14:55:05.822711419Z tar: Exiting with failure status due to previous errors
2026-10-31T14:55:05.823311873Z INFO: Network log collection complete.
2026-10-31T14:55:05.844725044Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:05.847489561Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-10-31T14:55:05.918789902Z Wrote inspect data to must-gather.
2026-10-31T14:55:06.034229001Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-10-31T14:55:06.328242298Z Gathering data for ns/openshift-monitoring...
2026-10-31T14:55:06.371423096Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:06.694253886Z INFO: Hosted cluster detected, get NTO container image from the TuneD pod
2026-10-31T14:55:06.852933240Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-10-31T14:55:06.997826017Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:07.001382959Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-10-31T14:55:07.063367542Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c
2026-10-31T14:55:07.096611080Z Gathering data for ns/openshift-etcd...
2026-10-31T14:55:07.325702216Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:07.429408579Z daemonset.apps/perf-node-gather-daemonset created
2026-10-31T14:55:07.503776560Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:07.675853627Z Waiting for performance profile collector pods to become ready: 1
2026-10-31T14:55:07.946365892Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-10-31T14:55:08.122770271Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:08.125236744Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-10-31T14:55:08.550066278Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:08.935785653Z Waiting for performance profile collector pods to become ready: 2
2026-10-31T14:55:08.945600306Z Wrote inspect data to must-gather.
2026-10-31T14:55:08.945641389Z error: inspection completed with the errors occurred while gathering data:
2026-10-31T14:55:08.945641389Z     namespaces "assisted-installer" not found
2026-10-31T14:55:09.139960602Z INFO: Getting status from alertmanager-main-0
2026-10-31T14:55:09.158470446Z Wrote inspect data to /must-gather/istio.
2026-10-31T14:55:10.197997275Z Waiting for performance profile collector pods to become ready: 3
2026-10-31T14:55:10.863109562Z Done executing Istio gather script
2026-10-31T14:55:11.454232492Z Waiting for performance profile collector pods to become ready: 4
2026-10-31T14:55:12.330413167Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:12.693612422Z Waiting for performance profile collector pods to become ready: 5
2026-10-31T14:55:13.946123923Z Waiting for performance profile collector pods to become ready: 6
2026-10-31T14:55:15.187254752Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-10-31T14:55:15.757902666Z Collecting performance related data for node ip-10-0-139-23.us-west-2.compute.internal
2026-10-31T14:55:15.765058386Z Collecting performance related data for node ip-10-0-141-83.us-west-2.compute.internal
2026-10-31T14:55:15.772547758Z Collecting performance related data for node ip-10-0-129-227.us-west-2.compute.internal
2026-10-31T14:55:17.335045478Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:22.339703569Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:26.842867688Z Gathering data for ns/openshift-network-console...
2026-10-31T14:55:27.344326106Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:28.931588878Z Collecting kubelet logs for node ip-10-0-139-23.us-west-2.compute.internal
2026-10-31T14:55:28.933540928Z Collecting kubelet logs for node ip-10-0-141-83.us-west-2.compute.internal
2026-10-31T14:55:28.935620298Z Collecting kubelet logs for node ip-10-0-129-227.us-west-2.compute.internal
2026-10-31T14:55:29.473085310Z Gathering data for ns/openshift-console-operator...
2026-10-31T14:55:29.778738648Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-cb6qf namespace
2026-10-31T14:55:29.834072626Z INFO: Node performance data collection complete.
2026-10-31T14:55:31.660500447Z Gathering data for ns/openshift-console...
2026-10-31T14:55:32.348931364Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:34.724172736Z Gathering data for ns/openshift-cluster-storage-operator...
2026-10-31T14:55:37.353478925Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:37.827034334Z Gathering data for ns/openshift-dns-operator...
2026-10-31T14:55:39.879402805Z Gathering data for ns/openshift-dns...
2026-10-31T14:55:42.358054916Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:45.808756725Z Gathering data for ns/openshift-image-registry...
2026-10-31T14:55:47.362756148Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:49.368521007Z Gathering data for ns/openshift-ingress-operator...
2026-10-31T14:55:51.342526465Z Gathering data for ns/openshift-ingress...
2026-10-31T14:55:52.367647111Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:55:53.716537263Z Gathering data for ns/openshift-ingress-canary...
2026-10-31T14:55:56.919995707Z Gathering data for ns/openshift-insights...
2026-10-31T14:55:57.372270402Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:02.376891489Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:04.941434132Z Gathering data for ns/openshift-config...
2026-10-31T14:56:06.758367038Z Gathering data for ns/openshift-config-managed...
2026-10-31T14:56:07.381506866Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:08.750154351Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-10-31T14:56:10.566910965Z Gathering data for ns/openshift-kube-apiserver...
2026-10-31T14:56:12.382572964Z Gathering data for ns/openshift-kube-controller-manager...
2026-10-31T14:56:12.386082083Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:14.214446070Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-10-31T14:56:16.152453014Z Gathering data for ns/openshift-kube-scheduler...
2026-10-31T14:56:17.390729209Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:17.967439890Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-10-31T14:56:19.907483156Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-10-31T14:56:22.396184088Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:22.567329660Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-10-31T14:56:24.808365714Z Gathering data for ns/openshift-user-workload-monitoring...
2026-10-31T14:56:27.401111464Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:27.504509007Z Gathering data for ns/openshift-multus...
2026-10-31T14:56:32.405714184Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:37.410332707Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:42.414985639Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:43.765846005Z Gathering data for ns/openshift-ovn-kubernetes...
2026-10-31T14:56:47.419617079Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:52.424226327Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:57.047260474Z Gathering data for ns/openshift-host-network...
2026-10-31T14:56:57.428747420Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:56:59.146301990Z Gathering data for ns/openshift-network-diagnostics...
2026-10-31T14:57:02.433366678Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:57:03.696724118Z Gathering data for ns/openshift-network-node-identity...
2026-10-31T14:57:06.736315376Z Gathering data for ns/openshift-network-operator...
2026-10-31T14:57:07.438002501Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:57:09.869138674Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-10-31T14:57:11.757508564Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-10-31T14:57:12.442660251Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:57:15.297492280Z Gathering data for ns/openshift-apiserver-operator...
2026-10-31T14:57:17.149370300Z Gathering data for ns/openshift-apiserver...
2026-10-31T14:57:17.447292229Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:57:19.697953179Z Gathering data for ns/openshift-controller-manager-operator...
2026-10-31T14:57:21.513967883Z Gathering data for ns/openshift-controller-manager...
2026-10-31T14:57:22.451874019Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:57:23.392609287Z Gathering data for ns/openshift-cluster-samples-operator...
2026-10-31T14:57:26.496995007Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-10-31T14:57:27.456515746Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:57:28.372533130Z Gathering data for ns/openshift-service-ca-operator...
2026-10-31T14:57:30.603947193Z Gathering data for ns/openshift-service-ca...
2026-10-31T14:57:32.461139209Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:57:33.196476902Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-10-31T14:57:37.465793070Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-10-31T14:57:39.196906593Z Wrote inspect data to must-gather.
2026-10-31T14:57:39.196951405Z error: inspection completed with the errors occurred while gathering data:
2026-10-31T14:57:39.196951405Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-10-31T14:57:39.599382998Z error: the server doesn't have a resource type "clusters"
2026-10-31T14:57:39.634435591Z Caches written to disk