2026-06-02T17:14:35.643223369Z [disk usage checker] Started
2026-06-02T17:14:35.646991983Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T17:14:35.857024044Z Gathering data for ns/openshift-cluster-version...
2026-06-02T17:14:36.003673834Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T17:14:36.111189687Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T17:14:36.190968974Z Gathering data for ns/default...
2026-06-02T17:14:36.492237559Z Gathering data for ns/openshift...
2026-06-02T17:14:36.909302326Z Gathering data for ns/kube-system...
2026-06-02T17:14:37.772099220Z Gathering data for ns/openshift-etcd...
2026-06-02T17:14:37.921356885Z Waiting on subprocesses to finish execution.
2026-06-02T17:14:37.929974704Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T17:14:37.937109818Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T17:14:37.937441454Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T17:14:37.937513553Z INFO: Gathering HAProxy config files
2026-06-02T17:14:37.954975111Z INFO: Collecting host service logs for crio
2026-06-02T17:14:37.955302922Z INFO: Collecting host service logs for kubelet
2026-06-02T17:14:37.955616554Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T17:14:37.955959418Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T17:14:37.956260569Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T17:14:37.956554916Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T17:14:37.956879201Z INFO: Collecting host service logs for NetworkManager
2026-06-02T17:14:37.957179245Z INFO: Collecting host service logs for openvswitch
2026-06-02T17:14:37.957479182Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T17:14:37.957811025Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T17:14:37.958111683Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T17:14:37.958458445Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T17:14:38.001168498Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T17:14:38.474476990Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T17:14:38.550079985Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T17:14:38.558185807Z Wrote inspect data to must-gather.
2026-06-02T17:14:38.558220516Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T17:14:38.558220516Z     namespaces "assisted-installer" not found
2026-06-02T17:14:38.589514765Z No resources found in openshift-etcd namespace.
2026-06-02T17:14:39.040021884Z Wrote inspect data to must-gather.
2026-06-02T17:14:39.046313631Z No resources found
2026-06-02T17:14:39.075918051Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T17:14:39.102601961Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T17:14:39.102689968Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T17:14:39.153803500Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-zlpj4
2026-06-02T17:14:39.153856064Z insights-runtime-extractor-c6qxb
2026-06-02T17:14:39.153876678Z insights-runtime-extractor-fmnmz
2026-06-02T17:14:39.153909920Z insights-runtime-extractor-h6nqf
2026-06-02T17:14:39.250467447Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T17:14:39.301549643Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T17:14:39.307133807Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T17:14:39.343954617Z ERROR: No running kube-apiserver pods found
2026-06-02T17:14:39.350930571Z INFO: Worker host service log collection to complete.
2026-06-02T17:14:39.387080697Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T17:14:39.799087167Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T17:14:39.844319946Z Gathering data for ns/openshift-monitoring...
2026-06-02T17:14:39.906431395Z Wrote inspect data to must-gather.
2026-06-02T17:14:39.915922971Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T17:14:39.915922971Z See 'oc rsync -h' for help and examples
2026-06-02T17:14:39.917611278Z tar: Removing leading `/' from member names
2026-06-02T17:14:39.923850726Z INFO: HAProxy config collection complete.
2026-06-02T17:14:40.059370435Z Wrote inspect data to must-gather.
2026-06-02T17:14:40.140960029Z No resources found
2026-06-02T17:14:40.149687610Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T17:14:40.184203091Z Wrote inspect data to must-gather.
2026-06-02T17:14:40.285373176Z Wrote inspect data to must-gather.
2026-06-02T17:14:40.287898036Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T17:14:40.307706573Z Wrote inspect data to must-gather.
2026-06-02T17:14:40.319272024Z Wrote inspect data to must-gather.
2026-06-02T17:14:40.344201375Z INFO: 'previous-logs' folder not found on ip-10-0-135-235.ec2.internal, skipping...
2026-06-02T17:14:40.466994025Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T17:14:40.551961641Z Wrote inspect data to must-gather.
2026-06-02T17:14:40.552122465Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T17:14:40.609824634Z INFO: 'previous-logs' folder not found on ip-10-0-136-147.ec2.internal, skipping...
2026-06-02T17:14:40.657675371Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T17:14:40.695877237Z Wrote inspect data to must-gather.
2026-06-02T17:14:40.797328325Z Wrote inspect data to must-gather.
2026-06-02T17:14:40.864796234Z INFO: 'previous-logs' folder not found on ip-10-0-141-142.ec2.internal, skipping...
2026-06-02T17:14:40.864835764Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T17:14:40.864843287Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T17:14:40.898726530Z Wrote inspect data to must-gather.
2026-06-02T17:14:40.948784795Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T17:14:41.058725709Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T17:14:41.068837341Z Wrote inspect data to must-gather.
2026-06-02T17:14:41.268299039Z Wrote inspect data to must-gather.
2026-06-02T17:14:41.350609521Z INFO: INTERCONNECT MODE
2026-06-02T17:14:41.350650862Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T17:14:41.359669329Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T17:14:41.451171274Z Wrote inspect data to must-gather.
2026-06-02T17:14:41.505770327Z INFO: Gathering OVN_Northbound from ovnkube-node-47xpb...
2026-06-02T17:14:41.505989408Z INFO: Gathering OVN_Northbound from ovnkube-node-crb89...
2026-06-02T17:14:41.506187446Z INFO: Gathering OVN_Northbound from ovnkube-node-mvqgl...
2026-06-02T17:14:41.506499992Z INFO: Gathering OVN_Southbound from ovnkube-node-47xpb...
2026-06-02T17:14:41.506674913Z INFO: Gathering OVN_Southbound from ovnkube-node-crb89...
2026-06-02T17:14:41.507095767Z INFO: Gathering OVN_Southbound from ovnkube-node-mvqgl...
2026-06-02T17:14:41.639115664Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T17:14:41.778313188Z Wrote inspect data to must-gather.
2026-06-02T17:14:41.822573621Z tar: Removing leading `/' from member names
2026-06-02T17:14:41.846871159Z tar: Removing leading `/' from member names
2026-06-02T17:14:41.846979144Z tar: Removing leading `/' from member names
2026-06-02T17:14:41.850271016Z tar: Removing leading `/' from member names
2026-06-02T17:14:41.893088425Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T17:14:41.918360746Z tar: Removing leading `/' from member names
2026-06-02T17:14:41.939572229Z tar: Removing leading `/' from member names
2026-06-02T17:14:41.991231156Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T17:14:42.018392982Z Wrote inspect data to must-gather.
2026-06-02T17:14:42.240983027Z Wrote inspect data to must-gather.
2026-06-02T17:14:42.298250966Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T17:14:42.323207892Z INFO: Waiting for network log collection to complete ...
2026-06-02T17:14:42.323249270Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T17:14:42.323633521Z INFO: Copying ovnk databases complete.
2026-06-02T17:14:42.325758003Z 2.7M	must-gather/network_logs/ovnk_database_store
2026-06-02T17:14:42.328329997Z ovnk_database_store/
2026-06-02T17:14:42.328329997Z ovnk_database_store/ovnkube-node-mvqgl_nbdb
2026-06-02T17:14:42.336106292Z ovnk_database_store/ovnkube-node-crb89_nbdb
2026-06-02T17:14:42.347208320Z ovnk_database_store/ovnkube-node-crb89_sbdb
2026-06-02T17:14:42.362342214Z ovnk_database_store/ovnkube-node-mvqgl_sbdb
2026-06-02T17:14:42.378960365Z ovnk_database_store/ovnkube-node-47xpb_nbdb
2026-06-02T17:14:42.386986449Z ovnk_database_store/ovnkube-node-47xpb_sbdb
2026-06-02T17:14:42.409699518Z INFO: Network log collection complete.
2026-06-02T17:14:42.448932472Z W0602 17:14:42.448886    1375 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-02T17:14:42.456085510Z Wrote inspect data to must-gather.
2026-06-02T17:14:42.534185955Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T17:14:42.675762191Z INFO: Getting status from alertmanager-main-0
2026-06-02T17:14:42.718089029Z Gathering data for ns/openshift-network-console...
2026-06-02T17:14:42.718224604Z Wrote inspect data to must-gather.
2026-06-02T17:14:42.955526204Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T17:14:42.959957784Z INFO: Fallback to identify the container image from release info
2026-06-02T17:14:43.205709805Z Gathering data for ns/openshift-console-operator...
2026-06-02T17:14:43.587057309Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T17:14:43.610274085Z Gathering data for ns/openshift-console...
2026-06-02T17:14:43.699327263Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T17:14:43.823386853Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T17:14:44.113755174Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T17:14:44.567759133Z Gathering data for ns/openshift-dns-operator...
2026-06-02T17:14:44.879078635Z Gathering data for ns/openshift-dns...
2026-06-02T17:14:44.941454257Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T17:14:45.631412116Z Gathering data for ns/openshift-image-registry...
2026-06-02T17:14:45.662881466Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T17:14:46.068684747Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T17:14:46.186350255Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T17:14:46.540560743Z Gathering data for ns/openshift-ingress...
2026-06-02T17:14:46.901067472Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T17:14:47.173249418Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T17:14:47.383784875Z Gathering data for ns/openshift-insights...
2026-06-02T17:14:48.296419179Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T17:14:49.410908426Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T17:14:49.746608820Z Gathering data for ns/openshift-jobset-operator...
2026-06-02T17:14:50.538890466Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T17:14:50.612089619Z Gathering data for ns/openshift-config...
2026-06-02T17:14:50.672686810Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T17:14:50.972004913Z Gathering data for ns/openshift-config-managed...
2026-06-02T17:14:51.464097295Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T17:14:51.653666982Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T17:14:51.783887826Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T17:14:51.920501544Z Collecting performance related data for node ip-10-0-135-235.ec2.internal
2026-06-02T17:14:51.927815014Z Collecting performance related data for node ip-10-0-136-147.ec2.internal
2026-06-02T17:14:51.935139988Z Collecting performance related data for node ip-10-0-141-142.ec2.internal
2026-06-02T17:14:52.139500680Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T17:14:52.616429747Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T17:14:53.050008181Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T17:14:53.401958068Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T17:14:53.841081228Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T17:14:54.204922693Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T17:14:54.580748698Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T17:14:55.102920381Z Gathering data for ns/openshift-multus...
2026-06-02T17:14:55.678118569Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T17:14:56.685071226Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T17:14:58.848560771Z Gathering data for ns/openshift-host-network...
2026-06-02T17:14:59.250468166Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T17:14:59.983262501Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T17:15:00.286180814Z Collecting kubelet logs for node ip-10-0-135-235.ec2.internal
2026-06-02T17:15:00.288187779Z Collecting kubelet logs for node ip-10-0-136-147.ec2.internal
2026-06-02T17:15:00.290058261Z Collecting kubelet logs for node ip-10-0-141-142.ec2.internal
2026-06-02T17:15:00.470469906Z Gathering data for ns/openshift-network-operator...
2026-06-02T17:15:00.611657016Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T17:15:00.616592421Z INFO: Node performance data collection complete.
2026-06-02T17:15:00.685172355Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T17:15:00.948714565Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T17:15:01.199573288Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T17:15:01.715835889Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T17:15:02.047180396Z Gathering data for ns/openshift-apiserver...
2026-06-02T17:15:02.480292753Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T17:15:02.750235779Z Gathering data for ns/openshift-controller-manager...
2026-06-02T17:15:03.075654622Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T17:15:03.742063533Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T17:15:04.004576100Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T17:15:04.329187510Z Gathering data for ns/openshift-service-ca...
2026-06-02T17:15:04.700308942Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T17:15:05.691271895Z [disk usage checker] Volume usage percentage: current = 12 ; allowed = 70
2026-06-02T17:15:05.722912050Z Wrote inspect data to must-gather.
2026-06-02T17:15:05.722957846Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T17:15:05.722957846Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T17:15:05.852239621Z error: the server doesn't have a resource type "clusters"
2026-06-02T17:15:05.988206836Z Caches written to disk