2026-10-30T09:36:26.933613804Z [disk usage checker] Started
2026-10-30T09:36:26.936716071Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:36:27.287824946Z Gathering data for ns/openshift-cluster-version...
2026-10-30T09:36:27.586432767Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+
2026-10-30T09:36:27.779068911Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-30T09:36:27.960964040Z Gathering data for ns/default...
2026-10-30T09:36:28.663897479Z Gathering data for ns/openshift...
2026-10-30T09:36:29.427652473Z Gathering data for ns/kube-system...
2026-10-30T09:36:30.332201004Z Waiting on subprocesses to finish execution.
2026-10-30T09:36:30.339361361Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-10-30T09:36:30.341345808Z INFO: Collecting host service logs for crio
2026-10-30T09:36:30.341704017Z INFO: Collecting host service logs for kubelet
2026-10-30T09:36:30.342048558Z INFO: Collecting host service logs for rpm-ostreed
2026-10-30T09:36:30.342691187Z INFO: Collecting host service logs for ostree-finalize-staged
2026-10-30T09:36:30.343033822Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-10-30T09:36:30.343359593Z INFO: Collecting host service logs for machine-config-daemon-host
2026-10-30T09:36:30.343787654Z INFO: Collecting host service logs for NetworkManager
2026-10-30T09:36:30.344052032Z INFO: Gathering machine config daemon's old logs from all nodes
2026-10-30T09:36:30.344130900Z INFO: Collecting host service logs for openvswitch
2026-10-30T09:36:30.344443644Z INFO: Collecting host service logs for ovs-configuration
2026-10-30T09:36:30.344792780Z INFO: Collecting host service logs for ovsdb-server
2026-10-30T09:36:30.345210084Z INFO: Collecting host service logs for ovs-vswitchd
2026-10-30T09:36:30.345700734Z INFO: Waiting for worker host service log collection to complete ...
2026-10-30T09:36:30.351394444Z INFO: Gathering HAProxy config files
2026-10-30T09:36:30.355328377Z Executing Istio gather script
2026-10-30T09:36:30.361074057Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-10-30T09:36:30.396354644Z INFO: Waiting for node performance related collection to complete ...
2026-10-30T09:36:31.155977827Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-10-30T09:36:31.156062692Z INFO: on-disk MachineConfig config collection complete.
2026-10-30T09:36:31.260058064Z INFO: "nfd" not detected. Skipping.
2026-10-30T09:36:31.280205559Z INFO: "sriov-network-operator" not detected. Skipping.
2026-10-30T09:36:31.324942476Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-10-30T09:36:31.342923602Z INFO: Collecting Insights Archives from insights-operator-7c4986d449-572z5
2026-10-30T09:36:31.342923602Z insights-runtime-extractor-bkxmc
2026-10-30T09:36:31.342923602Z insights-runtime-extractor-lw5vx
2026-10-30T09:36:31.342923602Z insights-runtime-extractor-sc6t9
2026-10-30T09:36:31.390817717Z error: the server doesn't have a resource type "performanceprofile"
2026-10-30T09:36:31.411984772Z INFO: Found 1 replicas - prometheus-k8s-0
2026-10-30T09:36:31.463149090Z No resources found in openshift-etcd namespace.
2026-10-30T09:36:31.476689934Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-10-30T09:36:31.662643314Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-10-30T09:36:31.662643314Z See 'oc rsync -h' for help and examples
2026-10-30T09:36:31.895590261Z ERROR: No running kube-apiserver pods found
2026-10-30T09:36:31.951557222Z INFO: Worker host service log collection to complete.
2026-10-30T09:36:31.967136666Z No resources found
2026-10-30T09:36:32.060275965Z Wrote inspect data to must-gather.
2026-10-30T09:36:32.098114222Z Wrote inspect data to must-gather.
2026-10-30T09:36:32.117081018Z INFO: "metallb-operator" not detected. Skipping.
2026-10-30T09:36:32.160045162Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:36:32.247874734Z INFO: Waiting for HAProxy config collection to complete ...
2026-10-30T09:36:32.486184900Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-10-30T09:36:32.500802401Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-30T09:36:32.627801778Z Wrote inspect data to must-gather.
2026-10-30T09:36:32.680660946Z Wrote inspect data to must-gather.
2026-10-30T09:36:32.712809321Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-10-30T09:36:32.775766221Z No resources found
2026-10-30T09:36:32.788629335Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-10-30T09:36:32.877074937Z tar: Removing leading `/' from member names
2026-10-30T09:36:32.880233624Z Wrote inspect data to must-gather.
2026-10-30T09:36:32.899915989Z INFO: HAProxy config collection complete.
2026-10-30T09:36:32.956316111Z INFO: 'previous-logs' folder not found on ip-10-0-128-151.ec2.internal, skipping...
2026-10-30T09:36:32.960706356Z Gathering data for ns/openshift-etcd...
2026-10-30T09:36:32.976019159Z Wrote inspect data to must-gather.
2026-10-30T09:36:33.041881396Z Wrote inspect data to must-gather.
2026-10-30T09:36:33.053508185Z error: the server doesn't have a resource type "machineconfigs"
2026-10-30T09:36:33.261060959Z INFO: 'previous-logs' folder not found on ip-10-0-133-126.ec2.internal, skipping...
2026-10-30T09:36:33.274565329Z error: the server doesn't have a resource type "machineconfigpools"
2026-10-30T09:36:33.321173194Z INFO: Getting rules from prometheus-k8s-0
2026-10-30T09:36:33.400086471Z Wrote inspect data to must-gather.
2026-10-30T09:36:33.504624998Z Gathering data for ns/openshift-cloud-credential-operator...
2026-10-30T09:36:33.580611988Z INFO: 'previous-logs' folder not found on ip-10-0-138-184.ec2.internal, skipping...
2026-10-30T09:36:33.580728945Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-10-30T09:36:33.580789168Z INFO: Machine Config Daemon termination log collection complete.
2026-10-30T09:36:33.600712848Z Wrote inspect data to must-gather.
2026-10-30T09:36:33.779808663Z Wrote inspect data to must-gather.
2026-10-30T09:36:33.801839339Z Wrote inspect data to must-gather.
2026-10-30T09:36:33.801873977Z error: inspection completed with the errors occurred while gathering data:
2026-10-30T09:36:33.801873977Z     namespaces "assisted-installer" not found
2026-10-30T09:36:33.827059925Z error: the server doesn't have a resource type "kubeletconfigs"
2026-10-30T09:36:33.841244337Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+
2026-10-30T09:36:33.845513219Z Inspecting resource crd/backendtlspolicies.gateway.networking.k8s.io
2026-10-30T09:36:33.988153881Z INFO: Getting status/config from prometheus-k8s-0
2026-10-30T09:36:34.072450403Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-10-30T09:36:34.120759006Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:34.140234352Z Wrote inspect data to must-gather.
2026-10-30T09:36:34.142165623Z Wrote inspect data to must-gather.
2026-10-30T09:36:34.412144116Z Wrote inspect data to must-gather.
2026-10-30T09:36:34.454457242Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:34.457998398Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-10-30T09:36:34.527701802Z INFO: LEGACY MODE
2026-10-30T09:36:34.527810421Z INFO: Gathering ovn-kubernetes master data
2026-10-30T09:36:34.624702801Z INFO: Getting status/flags from prometheus-k8s-0
2026-10-30T09:36:34.704406650Z Wrote inspect data to must-gather.
2026-10-30T09:36:34.724744236Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:34.794984985Z Gathering data for ns/openshift-monitoring...
2026-10-30T09:36:34.965813716Z Wrote inspect data to must-gather.
2026-10-30T09:36:34.974435896Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-10-30T09:36:35.037684086Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:35.041185459Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-10-30T09:36:35.211004768Z Wrote inspect data to must-gather.
2026-10-30T09:36:35.310433455Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:35.345219133Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-10-30T09:36:35.473558801Z Wrote inspect data to must-gather.
2026-10-30T09:36:35.550288316Z INFO: Waiting for network log collection to complete ...
2026-10-30T09:36:35.550320925Z INFO: Waiting for ovnk database copies to complete ...
2026-10-30T09:36:35.550761925Z INFO: Copying ovnk databases complete.
2026-10-30T09:36:35.552553581Z du: cannot access 'must-gather/network_logs/ovnk_database_store': No such file or directory
2026-10-30T09:36:35.553028430Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 771 is not a child of this shell
2026-10-30T09:36:35.553028430Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 772 is not a child of this shell
2026-10-30T09:36:35.553028430Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 773 is not a child of this shell
2026-10-30T09:36:35.553028430Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 775 is not a child of this shell
2026-10-30T09:36:35.553045083Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 776 is not a child of this shell
2026-10-30T09:36:35.553045083Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 777 is not a child of this shell
2026-10-30T09:36:35.553045083Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 779 is not a child of this shell
2026-10-30T09:36:35.553045083Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 780 is not a child of this shell
2026-10-30T09:36:35.553045083Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 784 is not a child of this shell
2026-10-30T09:36:35.553045083Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 785 is not a child of this shell
2026-10-30T09:36:35.553045083Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 786 is not a child of this shell
2026-10-30T09:36:35.553056988Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 787 is not a child of this shell
2026-10-30T09:36:35.553056988Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 788 is not a child of this shell
2026-10-30T09:36:35.555786879Z tar: ovnk_database_store: Cannot stat: No such file or directory
2026-10-30T09:36:35.558984338Z tar: Exiting with failure status due to previous errors
2026-10-30T09:36:35.559725997Z INFO: Network log collection complete.
2026-10-30T09:36:35.610214207Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:35.612731497Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-10-30T09:36:35.711270882Z Wrote inspect data to must-gather.
2026-10-30T09:36:35.801906183Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-10-30T09:36:35.862658314Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:36.083440876Z INFO: Hosted cluster detected, get NTO container image from the TuneD pod
2026-10-30T09:36:36.148727975Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:36.151014839Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-10-30T09:36:36.251921187Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c
2026-10-30T09:36:36.318435618Z INFO: Getting status from alertmanager-main-0
2026-10-30T09:36:36.416361056Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:36.418468727Z daemonset.apps/perf-node-gather-daemonset created
2026-10-30T09:36:36.571288466Z Waiting for performance profile collector pods to become ready: 1
2026-10-30T09:36:36.694359095Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:36.696790828Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-10-30T09:36:36.892093567Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:37.163959072Z Wrote inspect data to /must-gather/istio.
2026-10-30T09:36:37.170584108Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:36:37.712899311Z Waiting for performance profile collector pods to become ready: 2
2026-10-30T09:36:38.077084228Z Done executing Istio gather script
2026-10-30T09:36:38.850382929Z Waiting for performance profile collector pods to become ready: 3
2026-10-30T09:36:39.980807919Z Waiting for performance profile collector pods to become ready: 4
2026-10-30T09:36:41.117142072Z Waiting for performance profile collector pods to become ready: 5
2026-10-30T09:36:41.714913720Z Gathering data for ns/openshift-network-console...
2026-10-30T09:36:42.175116324Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:36:42.258313065Z Waiting for performance profile collector pods to become ready: 6
2026-10-30T09:36:42.680376153Z Gathering data for ns/openshift-console-operator...
2026-10-30T09:36:43.399508160Z Waiting for performance profile collector pods to become ready: 7
2026-10-30T09:36:43.549523584Z Gathering data for ns/openshift-console...
2026-10-30T09:36:44.542185463Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-10-30T09:36:44.715969107Z Gathering data for ns/openshift-cluster-storage-operator...
2026-10-30T09:36:44.839689571Z Collecting performance related data for node ip-10-0-133-126.ec2.internal
2026-10-30T09:36:44.846315647Z Collecting performance related data for node ip-10-0-128-151.ec2.internal
2026-10-30T09:36:44.853165015Z Collecting performance related data for node ip-10-0-138-184.ec2.internal
2026-10-30T09:36:45.980879275Z Gathering data for ns/openshift-dns-operator...
2026-10-30T09:36:46.781069766Z Gathering data for ns/openshift-dns...
2026-10-30T09:36:47.179367930Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:36:48.891205579Z Gathering data for ns/openshift-image-registry...
2026-10-30T09:36:50.181091350Z Gathering data for ns/openshift-ingress-operator...
2026-10-30T09:36:50.932862048Z Gathering data for ns/openshift-ingress...
2026-10-30T09:36:51.809946197Z Gathering data for ns/openshift-ingress-canary...
2026-10-30T09:36:52.183892440Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:36:52.910860684Z Collecting kubelet logs for node ip-10-0-133-126.ec2.internal
2026-10-30T09:36:52.912595942Z Collecting kubelet logs for node ip-10-0-128-151.ec2.internal
2026-10-30T09:36:52.914420221Z Collecting kubelet logs for node ip-10-0-138-184.ec2.internal
2026-10-30T09:36:52.944154881Z Gathering data for ns/openshift-insights...
2026-10-30T09:36:53.361224878Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-mftfx namespace
2026-10-30T09:36:53.381775815Z INFO: Node performance data collection complete.
2026-10-30T09:36:56.590666892Z Gathering data for ns/openshift-config...
2026-10-30T09:36:57.188248066Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:36:57.267582974Z Gathering data for ns/openshift-config-managed...
2026-10-30T09:36:58.071412463Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-10-30T09:36:58.746021176Z Gathering data for ns/openshift-kube-apiserver...
2026-10-30T09:36:59.446687563Z Gathering data for ns/openshift-kube-controller-manager...
2026-10-30T09:37:00.180756345Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-10-30T09:37:00.897348205Z Gathering data for ns/openshift-kube-scheduler...
2026-10-30T09:37:01.565421720Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-10-30T09:37:02.194464115Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:37:02.283077392Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-10-30T09:37:03.223835668Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-10-30T09:37:04.053686690Z Gathering data for ns/openshift-user-workload-monitoring...
2026-10-30T09:37:05.096873864Z Gathering data for ns/openshift-multus...
2026-10-30T09:37:07.199211131Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:37:10.660946362Z Gathering data for ns/openshift-ovn-kubernetes...
2026-10-30T09:37:12.203707862Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:37:15.066005656Z Gathering data for ns/openshift-host-network...
2026-10-30T09:37:15.820028145Z Gathering data for ns/openshift-network-diagnostics...
2026-10-30T09:37:17.208140820Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:37:17.376582531Z Gathering data for ns/openshift-network-node-identity...
2026-10-30T09:37:18.446087544Z Gathering data for ns/openshift-network-operator...
2026-10-30T09:37:19.511390504Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-10-30T09:37:20.156781373Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-10-30T09:37:21.417760812Z Gathering data for ns/openshift-apiserver-operator...
2026-10-30T09:37:22.083604311Z Gathering data for ns/openshift-apiserver...
2026-10-30T09:37:22.212592099Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:37:22.986788238Z Gathering data for ns/openshift-controller-manager-operator...
2026-10-30T09:37:23.623274396Z Gathering data for ns/openshift-controller-manager...
2026-10-30T09:37:24.283341984Z Gathering data for ns/openshift-cluster-samples-operator...
2026-10-30T09:37:25.551881650Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-10-30T09:37:26.229775002Z Gathering data for ns/openshift-service-ca-operator...
2026-10-30T09:37:27.016070409Z Gathering data for ns/openshift-service-ca...
2026-10-30T09:37:27.219464628Z [disk usage checker] Volume usage percentage: current = 8 ; allowed = 70
2026-10-30T09:37:27.923975212Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-10-30T09:37:30.108844882Z Wrote inspect data to must-gather.
2026-10-30T09:37:30.108887187Z error: inspection completed with the errors occurred while gathering data:
2026-10-30T09:37:30.108887187Z     [skipping gathering secrets/support due to error: secrets "support" not found, skipping gathering daemonsets.apps/ovn-ipsec-containerized due to error: daemonsets.apps "ovn-ipsec-containerized" not found]
2026-10-30T09:37:30.306128151Z error: the server doesn't have a resource type "clusters"
2026-10-30T09:37:30.379075285Z Caches written to disk