2026-04-17T00:00:57.890237041Z [disk usage checker] Started
2026-04-17T00:00:57.922441640Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-17T00:00:58.117288035Z Gathering data for ns/openshift-cluster-version...
2026-04-17T00:00:58.278010994Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-17T00:00:58.366378826Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T00:00:58.461490594Z Gathering data for ns/default...
2026-04-17T00:00:58.819356839Z Gathering data for ns/openshift...
2026-04-17T00:00:59.336080181Z Gathering data for ns/kube-system...
2026-04-17T00:01:00.185368483Z Gathering data for ns/openshift-etcd...
2026-04-17T00:01:00.390187634Z Waiting on subprocesses to finish execution.
2026-04-17T00:01:00.401036088Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-17T00:01:00.411329351Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-17T00:01:00.420186361Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-17T00:01:00.450338707Z INFO: Gathering HAProxy config files
2026-04-17T00:01:00.456373016Z INFO: Collecting host service logs for crio
2026-04-17T00:01:00.456906933Z INFO: Collecting host service logs for kubelet
2026-04-17T00:01:00.457238534Z INFO: Collecting host service logs for rpm-ostreed
2026-04-17T00:01:00.457550092Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-17T00:01:00.457890780Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-17T00:01:00.458229861Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-17T00:01:00.458550410Z INFO: Collecting host service logs for NetworkManager
2026-04-17T00:01:00.458881124Z INFO: Collecting host service logs for openvswitch
2026-04-17T00:01:00.459196194Z INFO: Collecting host service logs for ovs-configuration
2026-04-17T00:01:00.459531912Z INFO: Collecting host service logs for ovsdb-server
2026-04-17T00:01:00.459911622Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-17T00:01:00.460290472Z INFO: Waiting for worker host service log collection to complete ...
2026-04-17T00:01:00.505283191Z INFO: Waiting for node performance related collection to complete ...
2026-04-17T00:01:00.859293552Z No resources found
2026-04-17T00:01:01.031178002Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-69rmt
2026-04-17T00:01:01.031224247Z insights-runtime-extractor-cw66v
2026-04-17T00:01:01.031242572Z insights-runtime-extractor-n9vr7
2026-04-17T00:01:01.031260152Z insights-runtime-extractor-xdd9t
2026-04-17T00:01:01.098501576Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-17T00:01:01.113148173Z No resources found in openshift-etcd namespace.
2026-04-17T00:01:01.187930083Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-17T00:01:01.246378790Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-17T00:01:01.427737836Z error: the server doesn't have a resource type "performanceprofile"
2026-04-17T00:01:01.556734953Z Wrote inspect data to must-gather.
2026-04-17T00:01:01.556920001Z error: inspection completed with the errors occurred while gathering data:
2026-04-17T00:01:01.556920001Z     namespaces "assisted-installer" not found
2026-04-17T00:01:01.581520013Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-17T00:01:01.581520013Z See 'oc rsync -h' for help and examples
2026-04-17T00:01:01.584089698Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-17T00:01:01.584175129Z INFO: on-disk MachineConfig config collection complete.
2026-04-17T00:01:01.601208278Z INFO: "metallb-operator" not detected. Skipping.
2026-04-17T00:01:01.673804587Z ERROR: No running kube-apiserver pods found
2026-04-17T00:01:01.853945638Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-17T00:01:01.930920426Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-17T00:01:01.983199259Z Wrote inspect data to must-gather.
2026-04-17T00:01:02.053040887Z INFO: Worker host service log collection to complete.
2026-04-17T00:01:02.517444708Z No resources found
2026-04-17T00:01:02.745896385Z Wrote inspect data to must-gather.
2026-04-17T00:01:02.772295744Z Wrote inspect data to must-gather.
2026-04-17T00:01:02.776293792Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-17T00:01:02.789541395Z Wrote inspect data to must-gather.
2026-04-17T00:01:02.836021525Z INFO: 'previous-logs' folder not found on ip-10-0-131-43.ec2.internal, skipping...
2026-04-17T00:01:03.030684032Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-17T00:01:03.033544759Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-17T00:01:03.100440092Z Wrote inspect data to must-gather.
2026-04-17T00:01:03.179878409Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T00:01:03.212547061Z Wrote inspect data to must-gather.
2026-04-17T00:01:03.325104955Z INFO: Getting rules from prometheus-k8s-0
2026-04-17T00:01:03.342650958Z error: the server doesn't have a resource type "machineconfigs"
2026-04-17T00:01:03.438211727Z tar: Removing leading `/' from member names
2026-04-17T00:01:03.447746296Z INFO: HAProxy config collection complete.
2026-04-17T00:01:03.516532771Z INFO: 'previous-logs' folder not found on ip-10-0-136-147.ec2.internal, skipping...
2026-04-17T00:01:03.662011599Z Gathering data for ns/kuadrant-system...
2026-04-17T00:01:03.672391070Z Wrote inspect data to must-gather.
2026-04-17T00:01:03.675391665Z Wrote inspect data to must-gather.
2026-04-17T00:01:03.893667926Z INFO: Getting status/config from prometheus-k8s-0
2026-04-17T00:01:03.908811121Z INFO: 'previous-logs' folder not found on ip-10-0-136-153.ec2.internal, skipping...
2026-04-17T00:01:03.908917779Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-17T00:01:03.908970105Z INFO: Machine Config Daemon termination log collection complete.
2026-04-17T00:01:03.995876638Z Wrote inspect data to must-gather.
2026-04-17T00:01:04.067022107Z Wrote inspect data to must-gather.
2026-04-17T00:01:04.242080413Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-17T00:01:04.451882970Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-17T00:01:04.460918250Z Wrote inspect data to must-gather.
2026-04-17T00:01:04.586582032Z Wrote inspect data to must-gather.
2026-04-17T00:01:04.737496132Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-17T00:01:04.783388705Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-17T00:01:04.869139333Z INFO: INTERCONNECT MODE
2026-04-17T00:01:04.869225834Z INFO: Gathering ovn-kubernetes DBs
2026-04-17T00:01:04.907253517Z Wrote inspect data to must-gather.
2026-04-17T00:01:05.046201522Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-17T00:01:05.067595458Z INFO: Gathering OVN_Northbound from ovnkube-node-5pn57...
2026-04-17T00:01:05.067945309Z INFO: Gathering OVN_Northbound from ovnkube-node-jvvbp...
2026-04-17T00:01:05.068247871Z INFO: Gathering OVN_Northbound from ovnkube-node-md28x...
2026-04-17T00:01:05.068555975Z INFO: Gathering OVN_Southbound from ovnkube-node-5pn57...
2026-04-17T00:01:05.068848470Z INFO: Gathering OVN_Southbound from ovnkube-node-jvvbp...
2026-04-17T00:01:05.069121055Z INFO: Gathering OVN_Southbound from ovnkube-node-md28x...
2026-04-17T00:01:05.241474054Z Wrote inspect data to must-gather.
2026-04-17T00:01:05.412038957Z tar: Removing leading `/' from member names
2026-04-17T00:01:05.467799039Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T00:01:05.527543192Z tar: Removing leading `/' from member names
2026-04-17T00:01:05.532752898Z tar: Removing leading `/' from member names
2026-04-17T00:01:05.532752898Z tar: Removing leading `/' from member names
2026-04-17T00:01:05.543212579Z tar: Removing leading `/' from member names
2026-04-17T00:01:05.601263193Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-17T00:01:05.628848471Z tar: Removing leading `/' from member names
2026-04-17T00:01:05.754179209Z Gathering data for ns/openshift-monitoring...
2026-04-17T00:01:05.778780193Z Wrote inspect data to must-gather.
2026-04-17T00:01:06.102366279Z INFO: Getting status from alertmanager-main-0
2026-04-17T00:01:06.162302200Z Wrote inspect data to must-gather.
2026-04-17T00:01:06.256483508Z INFO: Waiting for network log collection to complete ...
2026-04-17T00:01:06.256537668Z INFO: Waiting for ovnk database copies to complete ...
2026-04-17T00:01:06.257141268Z INFO: Copying ovnk databases complete.
2026-04-17T00:01:06.259388647Z 4.2M	must-gather/network_logs/ovnk_database_store
2026-04-17T00:01:06.261945518Z ovnk_database_store/
2026-04-17T00:01:06.262220584Z ovnk_database_store/ovnkube-node-md28x_sbdb
2026-04-17T00:01:06.289949839Z ovnk_database_store/ovnkube-node-md28x_nbdb
2026-04-17T00:01:06.303148407Z ovnk_database_store/ovnkube-node-jvvbp_nbdb
2026-04-17T00:01:06.315642688Z ovnk_database_store/ovnkube-node-jvvbp_sbdb
2026-04-17T00:01:06.342265539Z ovnk_database_store/ovnkube-node-5pn57_sbdb
2026-04-17T00:01:06.373290907Z ovnk_database_store/ovnkube-node-5pn57_nbdb
2026-04-17T00:01:06.390015133Z INFO: Network log collection complete.
2026-04-17T00:01:06.557470974Z Wrote inspect data to must-gather.
2026-04-17T00:01:06.868940709Z Wrote inspect data to must-gather.
2026-04-17T00:01:07.166459598Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-17T00:01:07.173170726Z INFO: Fallback to identify the container image from release info
2026-04-17T00:01:07.806366543Z Gathering data for ns/openshift-network-console...
2026-04-17T00:01:08.063224116Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-17T00:01:08.283225215Z Gathering data for ns/openshift-console-operator...
2026-04-17T00:01:08.716073894Z Gathering data for ns/openshift-console...
2026-04-17T00:01:08.719492407Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-17T00:01:08.859334833Z daemonset.apps/perf-node-gather-daemonset created
2026-04-17T00:01:09.008546114Z Waiting for performance profile collector pods to become ready: 1
2026-04-17T00:01:09.296692479Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-17T00:01:09.728972753Z Wrote inspect data to must-gather.
2026-04-17T00:01:09.730855600Z Gathering data for ns/openshift-dns-operator...
2026-04-17T00:01:10.038613176Z Gathering data for ns/openshift-dns...
2026-04-17T00:01:10.129799237Z Waiting for performance profile collector pods to become ready: 2
2026-04-17T00:01:10.648981588Z Gathering data for ns/openshift-image-registry...
2026-04-17T00:01:11.162135341Z Gathering data for ns/openshift-ingress-operator...
2026-04-17T00:01:11.270274585Z Waiting for performance profile collector pods to become ready: 3
2026-04-17T00:01:11.528562316Z Gathering data for ns/openshift-ingress...
2026-04-17T00:01:12.223188274Z Gathering data for ns/openshift-ingress-canary...
2026-04-17T00:01:12.419498695Z Waiting for performance profile collector pods to become ready: 4
2026-04-17T00:01:12.699040904Z Gathering data for ns/openshift-insights...
2026-04-17T00:01:13.067691603Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-17T00:01:13.527088391Z Waiting for performance profile collector pods to become ready: 5
2026-04-17T00:01:14.639395012Z Waiting for performance profile collector pods to become ready: 6
2026-04-17T00:01:14.712955950Z Gathering data for ns/opendatahub...
2026-04-17T00:01:15.753040151Z Waiting for performance profile collector pods to become ready: 7
2026-04-17T00:01:16.068170314Z Gathering data for ns/openshift-lws-operator...
2026-04-17T00:01:16.870625115Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-17T00:01:17.110540128Z Collecting performance related data for node ip-10-0-131-43.ec2.internal
2026-04-17T00:01:17.117354511Z Collecting performance related data for node ip-10-0-136-147.ec2.internal
2026-04-17T00:01:17.125284111Z Collecting performance related data for node ip-10-0-136-153.ec2.internal
2026-04-17T00:01:17.322545611Z Gathering data for ns/openshift-config...
2026-04-17T00:01:17.792406672Z Gathering data for ns/openshift-config-managed...
2026-04-17T00:01:18.075210171Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-17T00:01:18.362454115Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-17T00:01:18.733439258Z Gathering data for ns/openshift-kube-apiserver...
2026-04-17T00:01:19.039521066Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-17T00:01:19.362922225Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-17T00:01:19.742114344Z Gathering data for ns/openshift-kube-scheduler...
2026-04-17T00:01:20.094096252Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-17T00:01:20.456247326Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-17T00:01:20.870074408Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-17T00:01:21.206648148Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-17T00:01:21.793158449Z Gathering data for ns/openshift-multus...
2026-04-17T00:01:23.081098750Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-17T00:01:23.313441102Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-17T00:01:24.757221047Z Gathering data for ns/openshift-host-network...
2026-04-17T00:01:25.124668640Z Gathering data for ns/openshift-network-diagnostics...
2026-04-17T00:01:25.374848217Z Collecting kubelet logs for node ip-10-0-131-43.ec2.internal
2026-04-17T00:01:25.377726140Z Collecting kubelet logs for node ip-10-0-136-147.ec2.internal
2026-04-17T00:01:25.379409983Z Collecting kubelet logs for node ip-10-0-136-153.ec2.internal
2026-04-17T00:01:25.774719880Z Gathering data for ns/openshift-network-node-identity...
2026-04-17T00:01:25.776196163Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-17T00:01:25.780499078Z INFO: Node performance data collection complete.
2026-04-17T00:01:26.263646382Z Gathering data for ns/openshift-network-operator...
2026-04-17T00:01:26.645113587Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-17T00:01:26.932364271Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-17T00:01:27.403114341Z Gathering data for ns/openshift-apiserver-operator...
2026-04-17T00:01:27.737160014Z Gathering data for ns/openshift-apiserver...
2026-04-17T00:01:28.086825024Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-17T00:01:28.198179175Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-17T00:01:28.474035150Z Gathering data for ns/openshift-controller-manager...
2026-04-17T00:01:28.764640386Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-17T00:01:29.420588442Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-17T00:01:29.760210284Z Gathering data for ns/openshift-service-ca-operator...
2026-04-17T00:01:30.087854610Z Gathering data for ns/openshift-service-ca...
2026-04-17T00:01:30.473954273Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-17T00:01:31.456057732Z Wrote inspect data to must-gather.
2026-04-17T00:01:31.456104297Z error: inspection completed with the errors occurred while gathering data:
2026-04-17T00:01:31.456104297Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-17T00:01:31.592010088Z error: the server doesn't have a resource type "clusters"
2026-04-17T00:01:32.015745452Z Caches written to disk