2026-10-31T08:14:06.862674900Z [disk usage checker] Started
2026-10-31T08:14:06.866261861Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:07.801217430Z Gathering data for ns/openshift-cluster-version...
2026-10-31T08:14:08.660066423Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+
2026-10-31T08:14:09.185061274Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-31T08:14:09.671646871Z Gathering data for ns/default...
2026-10-31T08:14:11.437987231Z Gathering data for ns/openshift...
2026-10-31T08:14:11.870984137Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:13.312163063Z Gathering data for ns/kube-system...
2026-10-31T08:14:13.560050010Z Waiting on subprocesses to finish execution.
2026-10-31T08:14:13.569008522Z INFO: Gathering machine config daemon's old logs from all nodes
2026-10-31T08:14:13.573641392Z INFO: Gathering HAProxy config files
2026-10-31T08:14:13.574613710Z Executing Istio gather script
2026-10-31T08:14:13.575468503Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-10-31T08:14:13.578882031Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-10-31T08:14:13.594825176Z INFO: Collecting host service logs for crio
2026-10-31T08:14:13.595224547Z INFO: Collecting host service logs for kubelet
2026-10-31T08:14:13.595604853Z INFO: Collecting host service logs for rpm-ostreed
2026-10-31T08:14:13.596003277Z INFO: Collecting host service logs for ostree-finalize-staged
2026-10-31T08:14:13.596341833Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-10-31T08:14:13.596750824Z INFO: Collecting host service logs for machine-config-daemon-host
2026-10-31T08:14:13.597219377Z INFO: Collecting host service logs for NetworkManager
2026-10-31T08:14:13.597617809Z INFO: Collecting host service logs for openvswitch
2026-10-31T08:14:13.597951420Z INFO: Collecting host service logs for ovs-configuration
2026-10-31T08:14:13.598288987Z INFO: Collecting host service logs for ovsdb-server
2026-10-31T08:14:13.598649252Z INFO: Collecting host service logs for ovs-vswitchd
2026-10-31T08:14:13.599032088Z INFO: Waiting for worker host service log collection to complete ...
2026-10-31T08:14:13.638347800Z INFO: Waiting for node performance related collection to complete ...
2026-10-31T08:14:14.290945768Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-10-31T08:14:14.291029029Z INFO: on-disk MachineConfig config collection complete.
2026-10-31T08:14:14.437898395Z INFO: "metallb-operator" not detected. Skipping.
2026-10-31T08:14:14.519748332Z INFO: Found 1 replicas - prometheus-k8s-0
2026-10-31T08:14:14.521093018Z No resources found
2026-10-31T08:14:14.537876989Z Wrote inspect data to must-gather.
2026-10-31T08:14:14.681119308Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-10-31T08:14:14.876580676Z error: the server doesn't have a resource type "performanceprofile"
2026-10-31T08:14:15.042481437Z INFO: Collecting Insights Archives from insights-operator-7c4986d449-twnp7
2026-10-31T08:14:15.042552687Z insights-runtime-extractor-77rkv
2026-10-31T08:14:15.042576611Z insights-runtime-extractor-fd9xj
2026-10-31T08:14:15.042598719Z insights-runtime-extractor-tfhdf
2026-10-31T08:14:15.062926557Z INFO: "nfd" not detected. Skipping.
2026-10-31T08:14:15.064421735Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-10-31T08:14:15.068862967Z No resources found in openshift-etcd namespace.
2026-10-31T08:14:15.143308467Z INFO: Worker host service log collection to complete.
2026-10-31T08:14:15.161427758Z INFO: "sriov-network-operator" not detected. Skipping.
2026-10-31T08:14:15.437587570Z INFO: Waiting for HAProxy config collection to complete ...
2026-10-31T08:14:15.458495753Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-10-31T08:14:15.640218475Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-10-31T08:14:15.640218475Z See 'oc rsync -h' for help and examples
2026-10-31T08:14:15.829907206Z INFO: 'previous-logs' folder not found on ip-10-0-130-190.us-west-1.compute.internal, skipping...
2026-10-31T08:14:15.876646615Z Wrote inspect data to must-gather.
2026-10-31T08:14:15.879167290Z Wrote inspect data to must-gather.
2026-10-31T08:14:15.935436427Z No resources found
2026-10-31T08:14:15.975542141Z Wrote inspect data to must-gather.
2026-10-31T08:14:15.998955026Z ERROR: No running kube-apiserver pods found
2026-10-31T08:14:16.119283646Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-10-31T08:14:16.231231365Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-31T08:14:16.331206952Z error: the server doesn't have a resource type "machineconfigs"
2026-10-31T08:14:16.374515532Z INFO: 'previous-logs' folder not found on ip-10-0-131-248.us-west-1.compute.internal, skipping...
2026-10-31T08:14:16.396048093Z Wrote inspect data to must-gather.
2026-10-31T08:14:16.411415551Z Wrote inspect data to must-gather.
2026-10-31T08:14:16.587813059Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-10-31T08:14:16.591238247Z Wrote inspect data to must-gather.
2026-10-31T08:14:16.606317483Z tar: Removing leading `/' from member names
2026-10-31T08:14:16.660381871Z INFO: HAProxy config collection complete.
2026-10-31T08:14:16.681902090Z error: the server doesn't have a resource type "machineconfigpools"
2026-10-31T08:14:16.783314267Z INFO: 'previous-logs' folder not found on ip-10-0-137-71.us-west-1.compute.internal, skipping...
2026-10-31T08:14:16.783383435Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-10-31T08:14:16.783383435Z INFO: Machine Config Daemon termination log collection complete.
2026-10-31T08:14:16.787976900Z Wrote inspect data to must-gather.
2026-10-31T08:14:16.876306894Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:17.125515448Z Wrote inspect data to must-gather.
2026-10-31T08:14:17.243112068Z INFO: Getting rules from prometheus-k8s-0
2026-10-31T08:14:17.496793275Z Inspecting resource crd/backendtlspolicies.gateway.networking.k8s.io
2026-10-31T08:14:17.499947572Z Wrote inspect data to must-gather.
2026-10-31T08:14:17.551433071Z error: the server doesn't have a resource type "kubeletconfigs"
2026-10-31T08:14:18.095606580Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:18.098616718Z Wrote inspect data to must-gather.
2026-10-31T08:14:18.156274241Z Wrote inspect data to must-gather.
2026-10-31T08:14:18.514938068Z Wrote inspect data to must-gather.
2026-10-31T08:14:18.670892466Z INFO: Getting status/config from prometheus-k8s-0
2026-10-31T08:14:18.784853346Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:18.787575455Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-10-31T08:14:18.837792543Z INFO: LEGACY MODE
2026-10-31T08:14:18.837835435Z INFO: Gathering ovn-kubernetes master data
2026-10-31T08:14:18.856580458Z Gathering data for ns/openshift-cloud-credential-operator...
2026-10-31T08:14:18.942327811Z Wrote inspect data to must-gather.
2026-10-31T08:14:19.237664383Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:19.366425741Z Wrote inspect data to must-gather.
2026-10-31T08:14:19.616970988Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+
2026-10-31T08:14:19.917024592Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:19.920828674Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-10-31T08:14:19.922613661Z Wrote inspect data to must-gather.
2026-10-31T08:14:20.099412765Z INFO: Getting status/flags from prometheus-k8s-0
2026-10-31T08:14:20.206970269Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-31T08:14:20.487496501Z Wrote inspect data to must-gather.
2026-10-31T08:14:20.499412734Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:20.904567190Z INFO: Waiting for network log collection to complete ...
2026-10-31T08:14:20.904624405Z INFO: Waiting for ovnk database copies to complete ...
2026-10-31T08:14:20.905132308Z INFO: Copying ovnk databases complete.
2026-10-31T08:14:20.907032214Z du: cannot access 'must-gather/network_logs/ovnk_database_store': No such file or directory
2026-10-31T08:14:20.907771557Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 731 is not a child of this shell
2026-10-31T08:14:20.907827677Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 732 is not a child of this shell
2026-10-31T08:14:20.907854837Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 733 is not a child of this shell
2026-10-31T08:14:20.907878702Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 734 is not a child of this shell
2026-10-31T08:14:20.907901490Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 735 is not a child of this shell
2026-10-31T08:14:20.907926635Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 736 is not a child of this shell
2026-10-31T08:14:20.907949399Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 737 is not a child of this shell
2026-10-31T08:14:20.907991170Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 738 is not a child of this shell
2026-10-31T08:14:20.907991170Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 760 is not a child of this shell
2026-10-31T08:14:20.907991170Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 761 is not a child of this shell
2026-10-31T08:14:20.907991170Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 762 is not a child of this shell
2026-10-31T08:14:20.907991170Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 763 is not a child of this shell
2026-10-31T08:14:20.907991170Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 764 is not a child of this shell
2026-10-31T08:14:20.911246906Z tar: ovnk_database_store: Cannot stat: No such file or directory
2026-10-31T08:14:20.917402751Z tar: Exiting with failure status due to previous errors
2026-10-31T08:14:20.917934117Z INFO: Network log collection complete.
2026-10-31T08:14:20.940471379Z Wrote inspect data to must-gather.
2026-10-31T08:14:21.018928168Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-10-31T08:14:21.178288599Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:21.180677516Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-10-31T08:14:21.248581357Z Gathering data for ns/openshift-etcd...
2026-10-31T08:14:21.694694082Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:21.739172637Z INFO: Hosted cluster detected, get NTO container image from the TuneD pod
2026-10-31T08:14:21.765093576Z Gathering data for ns/openshift-monitoring...
2026-10-31T08:14:21.881285806Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:21.916534362Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-10-31T08:14:22.100087142Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c
2026-10-31T08:14:22.315710178Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:22.318414861Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-10-31T08:14:22.454681447Z daemonset.apps/perf-node-gather-daemonset created
2026-10-31T08:14:22.713796277Z Waiting for performance profile collector pods to become ready: 1
2026-10-31T08:14:22.851965540Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:23.043599807Z Wrote inspect data to must-gather.
2026-10-31T08:14:23.043643037Z error: inspection completed with the errors occurred while gathering data:
2026-10-31T08:14:23.043643037Z     namespaces "assisted-installer" not found
2026-10-31T08:14:23.082996895Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-10-31T08:14:23.526840182Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:23.529278605Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-10-31T08:14:23.914628461Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:23.964426980Z Waiting for performance profile collector pods to become ready: 2
2026-10-31T08:14:24.319148188Z INFO: Getting status from alertmanager-main-0
2026-10-31T08:14:24.527801369Z Wrote inspect data to /must-gather/istio.
2026-10-31T08:14:25.218758879Z Waiting for performance profile collector pods to become ready: 3
2026-10-31T08:14:26.392100940Z Done executing Istio gather script
2026-10-31T08:14:26.467755710Z Waiting for performance profile collector pods to become ready: 4
2026-10-31T08:14:26.886151021Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:27.718940815Z Waiting for performance profile collector pods to become ready: 5
2026-10-31T08:14:28.972484461Z Waiting for performance profile collector pods to become ready: 6
2026-10-31T08:14:30.224557519Z Waiting for performance profile collector pods to become ready: 7
2026-10-31T08:14:31.477372185Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-10-31T08:14:31.890823155Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:32.042661336Z Collecting performance related data for node ip-10-0-130-190.us-west-1.compute.internal
2026-10-31T08:14:32.049781860Z Collecting performance related data for node ip-10-0-131-248.us-west-1.compute.internal
2026-10-31T08:14:32.057254332Z Collecting performance related data for node ip-10-0-137-71.us-west-1.compute.internal
2026-10-31T08:14:36.895512666Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:41.901465640Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:42.807281168Z Gathering data for ns/openshift-network-console...
2026-10-31T08:14:43.106818193Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-31T08:14:45.412760529Z Gathering data for ns/openshift-console-operator...
2026-10-31T08:14:46.906561740Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:47.666989465Z Gathering data for ns/openshift-console...
2026-10-31T08:14:50.814053770Z Gathering data for ns/openshift-cluster-storage-operator...
2026-10-31T08:14:51.911341428Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:53.912142935Z Gathering data for ns/openshift-dns-operator...
2026-10-31T08:14:55.964472266Z Gathering data for ns/openshift-dns...
2026-10-31T08:14:56.916070510Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:14:57.993376797Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-31T08:14:59.596858877Z Unable to connect to the server: net/http: TLS handshake timeout
2026-10-31T08:15:01.920748663Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:01.966906215Z Gathering data for ns/openshift-image-registry...
2026-10-31T08:15:04.714809754Z Collecting kubelet logs for node ip-10-0-130-190.us-west-1.compute.internal
2026-10-31T08:15:04.716656474Z Collecting kubelet logs for node ip-10-0-131-248.us-west-1.compute.internal
2026-10-31T08:15:04.718873377Z Collecting kubelet logs for node ip-10-0-137-71.us-west-1.compute.internal
2026-10-31T08:15:05.583054675Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-wn8tk namespace
2026-10-31T08:15:05.601946807Z Gathering data for ns/openshift-ingress-operator...
2026-10-31T08:15:05.637417178Z INFO: Node performance data collection complete.
2026-10-31T08:15:06.925732657Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:07.569946636Z Gathering data for ns/openshift-ingress...
2026-10-31T08:15:09.933947998Z Gathering data for ns/openshift-ingress-canary...
2026-10-31T08:15:11.930551943Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:13.144979169Z Gathering data for ns/openshift-insights...
2026-10-31T08:15:16.935222572Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:21.265118290Z Gathering data for ns/openshift-jobset-operator...
2026-10-31T08:15:21.939985445Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:24.388747062Z Gathering data for ns/openshift-config...
2026-10-31T08:15:26.190829816Z Gathering data for ns/openshift-config-managed...
2026-10-31T08:15:26.944734926Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:28.166702564Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-10-31T08:15:29.964681563Z Gathering data for ns/openshift-kube-apiserver...
2026-10-31T08:15:31.771259098Z Gathering data for ns/openshift-kube-controller-manager...
2026-10-31T08:15:31.949456992Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:33.593938458Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-10-31T08:15:35.518331671Z Gathering data for ns/openshift-kube-scheduler...
2026-10-31T08:15:36.954150101Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:37.314942591Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-10-31T08:15:39.235834554Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-10-31T08:15:41.904707266Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-10-31T08:15:41.959116506Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:44.141654242Z Gathering data for ns/openshift-user-workload-monitoring...
2026-10-31T08:15:46.808481371Z Gathering data for ns/openshift-multus...
2026-10-31T08:15:46.963951992Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:51.968652651Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:15:56.973321586Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:01.978028329Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:03.466335977Z Gathering data for ns/openshift-ovn-kubernetes...
2026-10-31T08:16:06.982751179Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:11.987541752Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:16.992179989Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:17.041018129Z Gathering data for ns/openshift-host-network...
2026-10-31T08:16:19.127689064Z Gathering data for ns/openshift-network-diagnostics...
2026-10-31T08:16:21.996921040Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:23.677490867Z Gathering data for ns/openshift-network-node-identity...
2026-10-31T08:16:26.684084363Z Gathering data for ns/openshift-network-operator...
2026-10-31T08:16:27.001677715Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:29.828256830Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-10-31T08:16:31.619461863Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-10-31T08:16:32.006435500Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:35.151725679Z Gathering data for ns/openshift-apiserver-operator...
2026-10-31T08:16:36.970327315Z Gathering data for ns/openshift-apiserver...
2026-10-31T08:16:37.011086257Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:39.475305528Z Gathering data for ns/openshift-controller-manager-operator...
2026-10-31T08:16:41.277052017Z Gathering data for ns/openshift-controller-manager...
2026-10-31T08:16:42.015832132Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:43.137827643Z Gathering data for ns/openshift-cluster-samples-operator...
2026-10-31T08:16:46.243687866Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-10-31T08:16:47.020469170Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:48.110821079Z Gathering data for ns/openshift-service-ca-operator...
2026-10-31T08:16:50.345677506Z Gathering data for ns/openshift-service-ca...
2026-10-31T08:16:52.025165363Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:52.928339328Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-10-31T08:16:57.029890978Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-10-31T08:16:59.002829604Z Wrote inspect data to must-gather.
2026-10-31T08:16:59.002877234Z error: inspection completed with the errors occurred while gathering data:
2026-10-31T08:16:59.002877234Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-10-31T08:16:59.428583949Z error: the server doesn't have a resource type "clusters"
2026-10-31T08:16:59.486167538Z Caches written to disk