2026-04-20T21:12:01.501062083Z [disk usage checker] Started
2026-04-20T21:12:01.504457544Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-20T21:12:01.713479828Z Gathering data for ns/openshift-cluster-version...
2026-04-20T21:12:01.844530426Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-20T21:12:01.924643445Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-20T21:12:02.004276582Z Gathering data for ns/default...
2026-04-20T21:12:02.314276099Z Gathering data for ns/openshift...
2026-04-20T21:12:02.736986116Z Gathering data for ns/kube-system...
2026-04-20T21:12:03.435194833Z Gathering data for ns/openshift-etcd...
2026-04-20T21:12:03.721075368Z Wrote inspect data to must-gather.
2026-04-20T21:12:03.721112748Z error: inspection completed with the errors occurred while gathering data:
2026-04-20T21:12:03.721112748Z     namespaces "assisted-installer" not found
2026-04-20T21:12:03.882384253Z Waiting on subprocesses to finish execution.
2026-04-20T21:12:03.891562863Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-20T21:12:03.894548261Z INFO: Gathering HAProxy config files
2026-04-20T21:12:03.906110053Z INFO: Collecting host service logs for crio
2026-04-20T21:12:03.906401794Z INFO: Collecting host service logs for kubelet
2026-04-20T21:12:03.906686240Z INFO: Collecting host service logs for rpm-ostreed
2026-04-20T21:12:03.906985420Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-20T21:12:03.907474363Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-20T21:12:03.907835673Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-20T21:12:03.908159661Z INFO: Collecting host service logs for NetworkManager
2026-04-20T21:12:03.908479936Z INFO: Collecting host service logs for openvswitch
2026-04-20T21:12:03.908851468Z INFO: Collecting host service logs for ovs-configuration
2026-04-20T21:12:03.909227785Z INFO: Collecting host service logs for ovsdb-server
2026-04-20T21:12:03.909573828Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-20T21:12:03.909991591Z INFO: Waiting for worker host service log collection to complete ...
2026-04-20T21:12:03.914877255Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-20T21:12:03.917069835Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-20T21:12:04.033744825Z INFO: Waiting for node performance related collection to complete ...
2026-04-20T21:12:04.502147968Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-7pjcj
2026-04-20T21:12:04.502205006Z insights-runtime-extractor-7n2qv
2026-04-20T21:12:04.502229649Z insights-runtime-extractor-9v4hs
2026-04-20T21:12:04.502249754Z insights-runtime-extractor-hmlx5
2026-04-20T21:12:04.843040717Z No resources found in openshift-etcd namespace.
2026-04-20T21:12:04.850052673Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-20T21:12:04.909125457Z error: the server doesn't have a resource type "performanceprofile"
2026-04-20T21:12:04.924057688Z ERROR: No running kube-apiserver pods found
2026-04-20T21:12:04.930980040Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-20T21:12:05.098266595Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-20T21:12:05.098356080Z INFO: on-disk MachineConfig config collection complete.
2026-04-20T21:12:05.138768077Z Wrote inspect data to must-gather.
2026-04-20T21:12:05.236097561Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-20T21:12:05.260401144Z No resources found
2026-04-20T21:12:05.296095645Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-20T21:12:05.296095645Z See 'oc rsync -h' for help and examples
2026-04-20T21:12:05.328668408Z Wrote inspect data to must-gather.
2026-04-20T21:12:05.358979822Z INFO: Worker host service log collection to complete.
2026-04-20T21:12:05.380934882Z INFO: "metallb-operator" not detected. Skipping.
2026-04-20T21:12:05.476014027Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-20T21:12:05.530719554Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-20T21:12:05.747013964Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-20T21:12:05.803349190Z Wrote inspect data to must-gather.
2026-04-20T21:12:05.898948851Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-20T21:12:05.975499383Z Wrote inspect data to must-gather.
2026-04-20T21:12:06.053206210Z INFO: 'previous-logs' folder not found on ip-10-0-139-59.ec2.internal, skipping...
2026-04-20T21:12:06.128985390Z Wrote inspect data to must-gather.
2026-04-20T21:12:06.157479310Z No resources found
2026-04-20T21:12:06.169416012Z Gathering data for ns/openshift-monitoring...
2026-04-20T21:12:06.185823942Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-20T21:12:06.200375373Z Wrote inspect data to must-gather.
2026-04-20T21:12:06.262410771Z Wrote inspect data to must-gather.
2026-04-20T21:12:06.264574469Z tar: Removing leading `/' from member names
2026-04-20T21:12:06.270186144Z INFO: HAProxy config collection complete.
2026-04-20T21:12:06.375082054Z error: the server doesn't have a resource type "machineconfigs"
2026-04-20T21:12:06.395346649Z INFO: 'previous-logs' folder not found on ip-10-0-140-155.ec2.internal, skipping...
2026-04-20T21:12:06.489769160Z INFO: Getting rules from prometheus-k8s-0
2026-04-20T21:12:06.513386503Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-20T21:12:06.552013553Z Wrote inspect data to must-gather.
2026-04-20T21:12:06.608179588Z Wrote inspect data to must-gather.
2026-04-20T21:12:06.666499939Z INFO: 'previous-logs' folder not found on ip-10-0-143-23.ec2.internal, skipping...
2026-04-20T21:12:06.666602997Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-20T21:12:06.666658871Z INFO: Machine Config Daemon termination log collection complete.
2026-04-20T21:12:06.791261743Z Wrote inspect data to must-gather.
2026-04-20T21:12:06.824338124Z Wrote inspect data to must-gather.
2026-04-20T21:12:06.897006452Z INFO: Getting status/config from prometheus-k8s-0
2026-04-20T21:12:06.977330897Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-20T21:12:07.041165656Z Wrote inspect data to must-gather.
2026-04-20T21:12:07.185960818Z Wrote inspect data to must-gather.
2026-04-20T21:12:07.304673702Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-20T21:12:07.329090787Z INFO: INTERCONNECT MODE
2026-04-20T21:12:07.329118324Z INFO: Gathering ovn-kubernetes DBs
2026-04-20T21:12:07.404163508Z Wrote inspect data to must-gather.
2026-04-20T21:12:07.508068746Z INFO: Gathering OVN_Northbound from ovnkube-node-5k984...
2026-04-20T21:12:07.508307932Z INFO: Gathering OVN_Northbound from ovnkube-node-8fzv6...
2026-04-20T21:12:07.508558680Z INFO: Gathering OVN_Northbound from ovnkube-node-z55qt...
2026-04-20T21:12:07.508880516Z INFO: Gathering OVN_Southbound from ovnkube-node-5k984...
2026-04-20T21:12:07.509147661Z INFO: Gathering OVN_Southbound from ovnkube-node-8fzv6...
2026-04-20T21:12:07.509422824Z INFO: Gathering OVN_Southbound from ovnkube-node-z55qt...
2026-04-20T21:12:07.627187434Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-20T21:12:07.653868318Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-20T21:12:07.752186019Z Wrote inspect data to must-gather.
2026-04-20T21:12:07.822462250Z tar: Removing leading `/' from member names
2026-04-20T21:12:07.854843144Z tar: Removing leading `/' from member names
2026-04-20T21:12:07.864051486Z tar: Removing leading `/' from member names
2026-04-20T21:12:07.875538283Z tar: Removing leading `/' from member names
2026-04-20T21:12:07.875630402Z tar: Removing leading `/' from member names
2026-04-20T21:12:07.878039724Z tar: Removing leading `/' from member names
2026-04-20T21:12:07.994921097Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-20T21:12:08.001301902Z Wrote inspect data to must-gather.
2026-04-20T21:12:08.227097151Z Wrote inspect data to must-gather.
2026-04-20T21:12:08.313505839Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-20T21:12:08.374383367Z INFO: Waiting for network log collection to complete ...
2026-04-20T21:12:08.374501113Z INFO: Waiting for ovnk database copies to complete ...
2026-04-20T21:12:08.374864535Z INFO: Copying ovnk databases complete.
2026-04-20T21:12:08.374993365Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-20T21:12:08.376574256Z 4.4M	must-gather/network_logs/ovnk_database_store
2026-04-20T21:12:08.378874912Z ovnk_database_store/
2026-04-20T21:12:08.378920858Z ovnk_database_store/ovnkube-node-5k984_nbdb
2026-04-20T21:12:08.396534120Z ovnk_database_store/ovnkube-node-5k984_sbdb
2026-04-20T21:12:08.425127709Z ovnk_database_store/ovnkube-node-8fzv6_nbdb
2026-04-20T21:12:08.435887383Z ovnk_database_store/ovnkube-node-8fzv6_sbdb
2026-04-20T21:12:08.462771283Z ovnk_database_store/ovnkube-node-z55qt_nbdb
2026-04-20T21:12:08.477455182Z ovnk_database_store/ovnkube-node-z55qt_sbdb
2026-04-20T21:12:08.509581873Z INFO: Network log collection complete.
2026-04-20T21:12:08.527192567Z Wrote inspect data to must-gather.
2026-04-20T21:12:08.570237746Z Gathering data for ns/openshift-network-console...
2026-04-20T21:12:08.735275342Z INFO: Getting status from alertmanager-main-0
2026-04-20T21:12:08.817408860Z Wrote inspect data to must-gather.
2026-04-20T21:12:09.071571944Z Gathering data for ns/openshift-console-operator...
2026-04-20T21:12:09.089562943Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-20T21:12:09.091672691Z INFO: Fallback to identify the container image from release info
2026-04-20T21:12:09.450651809Z Gathering data for ns/openshift-console...
2026-04-20T21:12:09.556808283Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-20T21:12:09.684615767Z daemonset.apps/perf-node-gather-daemonset created
2026-04-20T21:12:09.822196981Z Waiting for performance profile collector pods to become ready: 1
2026-04-20T21:12:09.949859517Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-20T21:12:10.327918975Z Gathering data for ns/openshift-dns-operator...
2026-04-20T21:12:10.626041411Z Gathering data for ns/openshift-dns...
2026-04-20T21:12:10.939219323Z Waiting for performance profile collector pods to become ready: 2
2026-04-20T21:12:11.288767111Z Gathering data for ns/openshift-image-registry...
2026-04-20T21:12:11.518572369Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-20T21:12:11.753421395Z Gathering data for ns/openshift-ingress-operator...
2026-04-20T21:12:12.066011203Z Gathering data for ns/openshift-ingress...
2026-04-20T21:12:12.072362016Z Waiting for performance profile collector pods to become ready: 3
2026-04-20T21:12:12.382213545Z Gathering data for ns/openshift-ingress-canary...
2026-04-20T21:12:12.750573709Z Gathering data for ns/openshift-insights...
2026-04-20T21:12:13.188117696Z Waiting for performance profile collector pods to become ready: 4
2026-04-20T21:12:14.313384006Z Waiting for performance profile collector pods to become ready: 5
2026-04-20T21:12:14.847550570Z Gathering data for ns/kserve...
2026-04-20T21:12:15.448832232Z Waiting for performance profile collector pods to become ready: 6
2026-04-20T21:12:16.524012297Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-20T21:12:16.570854162Z Waiting for performance profile collector pods to become ready: 7
2026-04-20T21:12:16.605082681Z Gathering data for ns/openshift-config...
2026-04-20T21:12:16.853120451Z Gathering data for ns/openshift-config-managed...
2026-04-20T21:12:17.259843082Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-20T21:12:17.534047189Z Gathering data for ns/openshift-kube-apiserver...
2026-04-20T21:12:17.703487288Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-20T21:12:17.822523705Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-20T21:12:17.989367597Z Collecting performance related data for node ip-10-0-139-59.ec2.internal
2026-04-20T21:12:17.999652990Z Collecting performance related data for node ip-10-0-143-23.ec2.internal
2026-04-20T21:12:18.008866744Z Collecting performance related data for node ip-10-0-140-155.ec2.internal
2026-04-20T21:12:18.159546413Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-20T21:12:18.513871125Z Gathering data for ns/openshift-kube-scheduler...
2026-04-20T21:12:18.845050466Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-20T21:12:19.189480428Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-20T21:12:19.603278013Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-20T21:12:19.902998903Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-20T21:12:20.416537901Z Gathering data for ns/openshift-multus...
2026-04-20T21:12:21.530032716Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-20T21:12:21.802518006Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-20T21:12:23.328129815Z Gathering data for ns/openshift-host-network...
2026-04-20T21:12:23.656415476Z Gathering data for ns/openshift-network-diagnostics...
2026-04-20T21:12:24.206738584Z Gathering data for ns/openshift-network-node-identity...
2026-04-20T21:12:24.592046016Z Gathering data for ns/openshift-network-operator...
2026-04-20T21:12:24.957107366Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-20T21:12:25.231740898Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-20T21:12:25.707890139Z Gathering data for ns/openshift-apiserver-operator...
2026-04-20T21:12:25.977681092Z Gathering data for ns/openshift-apiserver...
2026-04-20T21:12:25.982286162Z Collecting kubelet logs for node ip-10-0-139-59.ec2.internal
2026-04-20T21:12:25.984201773Z Collecting kubelet logs for node ip-10-0-143-23.ec2.internal
2026-04-20T21:12:25.987339000Z Collecting kubelet logs for node ip-10-0-140-155.ec2.internal
2026-04-20T21:12:26.415002939Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-20T21:12:26.420456832Z INFO: Node performance data collection complete.
2026-04-20T21:12:26.438751205Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-20T21:12:26.534760574Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-20T21:12:26.735434923Z Gathering data for ns/openshift-controller-manager...
2026-04-20T21:12:26.990233427Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-20T21:12:27.611024611Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-20T21:12:27.908605128Z Gathering data for ns/openshift-service-ca-operator...
2026-04-20T21:12:28.212710582Z Gathering data for ns/openshift-service-ca...
2026-04-20T21:12:28.565206538Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-20T21:12:29.407584414Z Wrote inspect data to must-gather.
2026-04-20T21:12:29.407628426Z error: inspection completed with the errors occurred while gathering data:
2026-04-20T21:12:29.407628426Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-20T21:12:29.537135950Z error: the server doesn't have a resource type "clusters"
2026-04-20T21:12:29.713295597Z Caches written to disk