2026-04-17T08:18:18.739560480Z [disk usage checker] Started
2026-04-17T08:18:18.743083101Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-17T08:18:18.944630520Z Gathering data for ns/openshift-cluster-version...
2026-04-17T08:18:19.084585888Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-17T08:18:19.165484744Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T08:18:19.243611685Z Gathering data for ns/default...
2026-04-17T08:18:19.560573041Z Gathering data for ns/openshift...
2026-04-17T08:18:19.990510085Z Gathering data for ns/kube-system...
2026-04-17T08:18:20.682142138Z Gathering data for ns/openshift-etcd...
2026-04-17T08:18:20.989342969Z Wrote inspect data to must-gather.
2026-04-17T08:18:20.989374036Z error: inspection completed with the errors occurred while gathering data:
2026-04-17T08:18:20.989374036Z     namespaces "assisted-installer" not found
2026-04-17T08:18:21.176489971Z Waiting on subprocesses to finish execution.
2026-04-17T08:18:21.188421047Z INFO: Collecting host service logs for crio
2026-04-17T08:18:21.189099966Z INFO: Collecting host service logs for kubelet
2026-04-17T08:18:21.189777287Z INFO: Collecting host service logs for rpm-ostreed
2026-04-17T08:18:21.190255050Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-17T08:18:21.190721615Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-17T08:18:21.191102542Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-17T08:18:21.191415688Z INFO: Collecting host service logs for NetworkManager
2026-04-17T08:18:21.191719864Z INFO: Collecting host service logs for openvswitch
2026-04-17T08:18:21.192342297Z INFO: Collecting host service logs for ovs-configuration
2026-04-17T08:18:21.192659259Z INFO: Collecting host service logs for ovsdb-server
2026-04-17T08:18:21.192717961Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-17T08:18:21.193000877Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-17T08:18:21.193398083Z INFO: Waiting for worker host service log collection to complete ...
2026-04-17T08:18:21.194260978Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-17T08:18:21.199757256Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-17T08:18:21.202632335Z INFO: Gathering HAProxy config files
2026-04-17T08:18:21.270800359Z INFO: Waiting for node performance related collection to complete ...
2026-04-17T08:18:21.658076053Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-17T08:18:21.867081918Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-17T08:18:22.112444203Z No resources found in openshift-etcd namespace.
2026-04-17T08:18:22.127352887Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-17T08:18:22.137173448Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-17T08:18:22.173761108Z No resources found
2026-04-17T08:18:22.335079397Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-17T08:18:22.351195591Z INFO: on-disk MachineConfig config collection complete.
2026-04-17T08:18:22.363284818Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-qlgcs
2026-04-17T08:18:22.363284818Z insights-runtime-extractor-pf4zb
2026-04-17T08:18:22.363284818Z insights-runtime-extractor-v8457
2026-04-17T08:18:22.363284818Z insights-runtime-extractor-z8d29
2026-04-17T08:18:22.385247577Z INFO: Worker host service log collection to complete.
2026-04-17T08:18:22.479106330Z error: the server doesn't have a resource type "performanceprofile"
2026-04-17T08:18:22.594069520Z ERROR: No running kube-apiserver pods found
2026-04-17T08:18:22.663980938Z Wrote inspect data to must-gather.
2026-04-17T08:18:22.755379404Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-17T08:18:22.786797612Z INFO: "metallb-operator" not detected. Skipping.
2026-04-17T08:18:22.849654960Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-17T08:18:22.849654960Z See 'oc rsync -h' for help and examples
2026-04-17T08:18:22.902347365Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-17T08:18:23.100277669Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T08:18:23.160991112Z Wrote inspect data to must-gather.
2026-04-17T08:18:23.191854420Z Wrote inspect data to must-gather.
2026-04-17T08:18:23.234757444Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-17T08:18:23.317124410Z Gathering data for ns/openshift-monitoring...
2026-04-17T08:18:23.377174323Z INFO: 'previous-logs' folder not found on ip-10-0-132-178.ec2.internal, skipping...
2026-04-17T08:18:23.436464085Z Wrote inspect data to must-gather.
2026-04-17T08:18:23.465727452Z Wrote inspect data to must-gather.
2026-04-17T08:18:23.490298386Z No resources found
2026-04-17T08:18:23.502329403Z tar: Removing leading `/' from member names
2026-04-17T08:18:23.507244496Z INFO: HAProxy config collection complete.
2026-04-17T08:18:23.579802934Z error: the server doesn't have a resource type "machineconfigs"
2026-04-17T08:18:23.668029803Z Wrote inspect data to must-gather.
2026-04-17T08:18:23.730960889Z Wrote inspect data to must-gather.
2026-04-17T08:18:23.746780099Z INFO: 'previous-logs' folder not found on ip-10-0-133-228.ec2.internal, skipping...
2026-04-17T08:18:23.749270407Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-17T08:18:23.831839674Z Wrote inspect data to must-gather.
2026-04-17T08:18:23.841759740Z INFO: Getting rules from prometheus-k8s-0
2026-04-17T08:18:23.993511727Z Wrote inspect data to must-gather.
2026-04-17T08:18:24.017674875Z INFO: 'previous-logs' folder not found on ip-10-0-142-45.ec2.internal, skipping...
2026-04-17T08:18:24.017700402Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-17T08:18:24.017724099Z INFO: Machine Config Daemon termination log collection complete.
2026-04-17T08:18:24.079245772Z Wrote inspect data to must-gather.
2026-04-17T08:18:24.241404518Z Wrote inspect data to must-gather.
2026-04-17T08:18:24.242168666Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-17T08:18:24.251927758Z INFO: Getting status/config from prometheus-k8s-0
2026-04-17T08:18:24.445714983Z Wrote inspect data to must-gather.
2026-04-17T08:18:24.457922292Z Wrote inspect data to must-gather.
2026-04-17T08:18:24.652721676Z Wrote inspect data to must-gather.
2026-04-17T08:18:24.665727107Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-17T08:18:24.736700397Z INFO: INTERCONNECT MODE
2026-04-17T08:18:24.736731700Z INFO: Gathering ovn-kubernetes DBs
2026-04-17T08:18:24.886675062Z Wrote inspect data to must-gather.
2026-04-17T08:18:24.918315091Z INFO: Gathering OVN_Northbound from ovnkube-node-ldxs6...
2026-04-17T08:18:24.918518209Z INFO: Gathering OVN_Northbound from ovnkube-node-pqdwt...
2026-04-17T08:18:24.918770620Z INFO: Gathering OVN_Northbound from ovnkube-node-wbxwr...
2026-04-17T08:18:24.919039449Z INFO: Gathering OVN_Southbound from ovnkube-node-ldxs6...
2026-04-17T08:18:24.919360901Z INFO: Gathering OVN_Southbound from ovnkube-node-pqdwt...
2026-04-17T08:18:24.919637098Z INFO: Gathering OVN_Southbound from ovnkube-node-wbxwr...
2026-04-17T08:18:24.952093367Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-17T08:18:24.956424055Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-17T08:18:25.233373146Z Wrote inspect data to must-gather.
2026-04-17T08:18:25.258367378Z tar: Removing leading `/' from member names
2026-04-17T08:18:25.272866335Z tar: Removing leading `/' from member names
2026-04-17T08:18:25.285036385Z tar: Removing leading `/' from member names
2026-04-17T08:18:25.308988555Z tar: Removing leading `/' from member names
2026-04-17T08:18:25.316272531Z tar: Removing leading `/' from member names
2026-04-17T08:18:25.316834222Z tar: Removing leading `/' from member names
2026-04-17T08:18:25.379634318Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-17T08:18:25.496622589Z Wrote inspect data to must-gather.
2026-04-17T08:18:25.661060443Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-17T08:18:25.708051255Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-17T08:18:25.775635782Z INFO: Waiting for network log collection to complete ...
2026-04-17T08:18:25.775766543Z INFO: Waiting for ovnk database copies to complete ...
2026-04-17T08:18:25.776315569Z INFO: Copying ovnk databases complete.
2026-04-17T08:18:25.778119166Z 3.3M	must-gather/network_logs/ovnk_database_store
2026-04-17T08:18:25.780529600Z ovnk_database_store/
2026-04-17T08:18:25.780529600Z ovnk_database_store/ovnkube-node-pqdwt_nbdb
2026-04-17T08:18:25.791647553Z ovnk_database_store/ovnkube-node-pqdwt_sbdb
2026-04-17T08:18:25.813073994Z ovnk_database_store/ovnkube-node-wbxwr_nbdb
2026-04-17T08:18:25.820914763Z ovnk_database_store/ovnkube-node-ldxs6_sbdb
2026-04-17T08:18:25.831282233Z Wrote inspect data to must-gather.
2026-04-17T08:18:25.838037293Z ovnk_database_store/ovnkube-node-wbxwr_sbdb
2026-04-17T08:18:25.858667623Z ovnk_database_store/ovnkube-node-ldxs6_nbdb
2026-04-17T08:18:25.869334075Z INFO: Network log collection complete.
2026-04-17T08:18:25.889491070Z Gathering data for ns/openshift-network-console...
2026-04-17T08:18:26.079035125Z INFO: Getting status from alertmanager-main-0
2026-04-17T08:18:26.132334817Z Wrote inspect data to must-gather.
2026-04-17T08:18:26.323611087Z Gathering data for ns/openshift-console-operator...
2026-04-17T08:18:26.418121889Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-17T08:18:26.420877710Z INFO: Fallback to identify the container image from release info
2026-04-17T08:18:26.684629934Z Gathering data for ns/openshift-console...
2026-04-17T08:18:26.906533648Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-17T08:18:27.029113467Z daemonset.apps/perf-node-gather-daemonset created
2026-04-17T08:18:27.116871187Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-17T08:18:27.165664554Z Waiting for performance profile collector pods to become ready: 1
2026-04-17T08:18:27.450241212Z Gathering data for ns/openshift-dns-operator...
2026-04-17T08:18:27.759818911Z Gathering data for ns/openshift-dns...
2026-04-17T08:18:28.299341711Z Waiting for performance profile collector pods to become ready: 2
2026-04-17T08:18:28.350109005Z Gathering data for ns/openshift-image-registry...
2026-04-17T08:18:28.755077445Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-17T08:18:28.797144196Z Gathering data for ns/openshift-ingress-operator...
2026-04-17T08:18:29.096274732Z Gathering data for ns/openshift-ingress...
2026-04-17T08:18:29.404870732Z Gathering data for ns/openshift-ingress-canary...
2026-04-17T08:18:29.432929937Z Waiting for performance profile collector pods to become ready: 3
2026-04-17T08:18:29.794839532Z Gathering data for ns/openshift-insights...
2026-04-17T08:18:30.545625692Z Waiting for performance profile collector pods to become ready: 4
2026-04-17T08:18:31.680598316Z Waiting for performance profile collector pods to become ready: 5
2026-04-17T08:18:31.870206223Z Gathering data for ns/kserve...
2026-04-17T08:18:32.792637593Z Waiting for performance profile collector pods to become ready: 6
2026-04-17T08:18:33.334487347Z Gathering data for ns/openshift-config...
2026-04-17T08:18:33.578850542Z Gathering data for ns/openshift-config-managed...
2026-04-17T08:18:33.759834147Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-17T08:18:33.924117059Z Waiting for performance profile collector pods to become ready: 7
2026-04-17T08:18:33.991161564Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-17T08:18:34.234967991Z Gathering data for ns/openshift-kube-apiserver...
2026-04-17T08:18:34.527173048Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-17T08:18:34.835491035Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-17T08:18:35.052390057Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-17T08:18:35.119049638Z Gathering data for ns/openshift-kube-scheduler...
2026-04-17T08:18:35.338275603Z Collecting performance related data for node ip-10-0-132-178.ec2.internal
2026-04-17T08:18:35.345627670Z Collecting performance related data for node ip-10-0-133-228.ec2.internal
2026-04-17T08:18:35.356140989Z Collecting performance related data for node ip-10-0-142-45.ec2.internal
2026-04-17T08:18:35.410559965Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-17T08:18:35.769857058Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-17T08:18:36.135134019Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-17T08:18:36.526471289Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-17T08:18:37.111397998Z Gathering data for ns/openshift-multus...
2026-04-17T08:18:38.558554507Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-17T08:18:38.765542441Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-17T08:18:40.021898910Z Gathering data for ns/openshift-host-network...
2026-04-17T08:18:40.328383390Z Gathering data for ns/openshift-network-diagnostics...
2026-04-17T08:18:40.857366512Z Gathering data for ns/openshift-network-node-identity...
2026-04-17T08:18:41.319154232Z Gathering data for ns/openshift-network-operator...
2026-04-17T08:18:41.675160062Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-17T08:18:41.921780374Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-17T08:18:42.396991058Z Gathering data for ns/openshift-apiserver-operator...
2026-04-17T08:18:42.705862767Z Gathering data for ns/openshift-apiserver...
2026-04-17T08:18:43.192537227Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-17T08:18:43.453113241Z Gathering data for ns/openshift-controller-manager...
2026-04-17T08:18:43.488946517Z Collecting kubelet logs for node ip-10-0-132-178.ec2.internal
2026-04-17T08:18:43.490948405Z Collecting kubelet logs for node ip-10-0-133-228.ec2.internal
2026-04-17T08:18:43.494121181Z Collecting kubelet logs for node ip-10-0-142-45.ec2.internal
2026-04-17T08:18:43.771348307Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-04-17T08:18:43.788355548Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-17T08:18:43.866432551Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-17T08:18:43.872992522Z INFO: Node performance data collection complete.
2026-04-17T08:18:44.454558410Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-17T08:18:44.721695914Z Gathering data for ns/openshift-service-ca-operator...
2026-04-17T08:18:45.008645238Z Gathering data for ns/openshift-service-ca...
2026-04-17T08:18:45.358324617Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-17T08:18:46.223332702Z Wrote inspect data to must-gather.
2026-04-17T08:18:46.223376193Z error: inspection completed with the errors occurred while gathering data:
2026-04-17T08:18:46.223376193Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-17T08:18:46.360750858Z error: the server doesn't have a resource type "clusters"
2026-04-17T08:18:46.496847595Z Caches written to disk