2026-04-22T14:38:52.027347879Z [disk usage checker] Started
2026-04-22T14:38:52.057648044Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-22T14:38:52.219108170Z Gathering data for ns/openshift-cluster-version...
2026-04-22T14:38:52.334401763Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-22T14:38:52.417422715Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-22T14:38:52.497556594Z Gathering data for ns/default...
2026-04-22T14:38:52.803114806Z Gathering data for ns/openshift...
2026-04-22T14:38:53.189708702Z Gathering data for ns/kube-system...
2026-04-22T14:38:53.817697044Z Gathering data for ns/openshift-etcd...
2026-04-22T14:38:54.089949491Z Wrote inspect data to must-gather.
2026-04-22T14:38:54.089982323Z error: inspection completed with the errors occurred while gathering data:
2026-04-22T14:38:54.089982323Z     namespaces "assisted-installer" not found
2026-04-22T14:38:54.354023511Z Waiting on subprocesses to finish execution.
2026-04-22T14:38:54.362324681Z INFO: Collecting host service logs for crio
2026-04-22T14:38:54.362708886Z INFO: Collecting host service logs for kubelet
2026-04-22T14:38:54.363053337Z INFO: Collecting host service logs for rpm-ostreed
2026-04-22T14:38:54.363383392Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-22T14:38:54.363773261Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-22T14:38:54.364112311Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-22T14:38:54.364391175Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-22T14:38:54.364492559Z INFO: Collecting host service logs for NetworkManager
2026-04-22T14:38:54.364849523Z INFO: Collecting host service logs for openvswitch
2026-04-22T14:38:54.365184871Z INFO: Collecting host service logs for ovs-configuration
2026-04-22T14:38:54.365541568Z INFO: Collecting host service logs for ovsdb-server
2026-04-22T14:38:54.365890612Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-22T14:38:54.366274341Z INFO: Waiting for worker host service log collection to complete ...
2026-04-22T14:38:54.372022159Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-22T14:38:54.378716585Z INFO: Gathering HAProxy config files
2026-04-22T14:38:54.449706768Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-22T14:38:54.685085296Z INFO: Waiting for node performance related collection to complete ...
2026-04-22T14:38:54.753743716Z No resources found in openshift-etcd namespace.
2026-04-22T14:38:55.171349879Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-22T14:38:55.295580867Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-22T14:38:55.469380204Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-22T14:38:55.650373149Z INFO: Worker host service log collection to complete.
2026-04-22T14:38:55.738888950Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-cl44f
2026-04-22T14:38:55.738888950Z insights-runtime-extractor-ctlbm
2026-04-22T14:38:55.738888950Z insights-runtime-extractor-fqwqv
2026-04-22T14:38:55.738888950Z insights-runtime-extractor-tmlr9
2026-04-22T14:38:55.847904504Z No resources found
2026-04-22T14:38:55.971650428Z Wrote inspect data to must-gather.
2026-04-22T14:38:56.057962887Z error: the server doesn't have a resource type "performanceprofile"
2026-04-22T14:38:56.064715528Z INFO: "metallb-operator" not detected. Skipping.
2026-04-22T14:38:56.217865476Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-22T14:38:56.218462738Z INFO: on-disk MachineConfig config collection complete.
2026-04-22T14:38:56.239753341Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-22T14:38:56.286789906Z ERROR: No running kube-apiserver pods found
2026-04-22T14:38:56.308527820Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-22T14:38:56.322932202Z Wrote inspect data to must-gather.
2026-04-22T14:38:56.414385123Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-22T14:38:56.472798686Z Wrote inspect data to must-gather.
2026-04-22T14:38:56.493560918Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-22T14:38:56.528343920Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-22T14:38:56.563263521Z No resources found
2026-04-22T14:38:56.570536496Z Wrote inspect data to must-gather.
2026-04-22T14:38:56.602858725Z Wrote inspect data to must-gather.
2026-04-22T14:38:56.628594384Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-22T14:38:56.628594384Z See 'oc rsync -h' for help and examples
2026-04-22T14:38:56.753835756Z tar: Removing leading `/' from member names
2026-04-22T14:38:56.762370111Z Wrote inspect data to must-gather.
2026-04-22T14:38:56.763503530Z INFO: HAProxy config collection complete.
2026-04-22T14:38:56.764857826Z INFO: 'previous-logs' folder not found on ip-10-0-129-161.ec2.internal, skipping...
2026-04-22T14:38:56.780349688Z Wrote inspect data to must-gather.
2026-04-22T14:38:56.882562207Z Gathering data for ns/openshift-monitoring...
2026-04-22T14:38:56.913786744Z Wrote inspect data to must-gather.
2026-04-22T14:38:56.965019588Z error: the server doesn't have a resource type "machineconfigs"
2026-04-22T14:38:57.005400059Z INFO: Getting rules from prometheus-k8s-0
2026-04-22T14:38:57.047379305Z INFO: 'previous-logs' folder not found on ip-10-0-130-98.ec2.internal, skipping...
2026-04-22T14:38:57.066591068Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-22T14:38:57.184187480Z Wrote inspect data to must-gather.
2026-04-22T14:38:57.186152458Z Wrote inspect data to must-gather.
2026-04-22T14:38:57.297629752Z INFO: 'previous-logs' folder not found on ip-10-0-131-75.ec2.internal, skipping...
2026-04-22T14:38:57.297663955Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-22T14:38:57.297663955Z INFO: Machine Config Daemon termination log collection complete.
2026-04-22T14:38:57.403902560Z INFO: Getting status/config from prometheus-k8s-0
2026-04-22T14:38:57.404070250Z Wrote inspect data to must-gather.
2026-04-22T14:38:57.424772942Z Wrote inspect data to must-gather.
2026-04-22T14:38:57.540197649Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-22T14:38:57.706257018Z INFO: INTERCONNECT MODE
2026-04-22T14:38:57.706257018Z INFO: Gathering ovn-kubernetes DBs
2026-04-22T14:38:57.735088875Z Wrote inspect data to must-gather.
2026-04-22T14:38:57.783797247Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-22T14:38:57.854577229Z INFO: Gathering OVN_Northbound from ovnkube-node-47psb...
2026-04-22T14:38:57.854832601Z INFO: Gathering OVN_Northbound from ovnkube-node-6zgvp...
2026-04-22T14:38:57.855061012Z INFO: Gathering OVN_Northbound from ovnkube-node-j58wd...
2026-04-22T14:38:57.855324704Z INFO: Gathering OVN_Southbound from ovnkube-node-47psb...
2026-04-22T14:38:57.855589375Z INFO: Gathering OVN_Southbound from ovnkube-node-6zgvp...
2026-04-22T14:38:57.855839957Z INFO: Gathering OVN_Southbound from ovnkube-node-j58wd...
2026-04-22T14:38:57.999267478Z Wrote inspect data to must-gather.
2026-04-22T14:38:58.065377652Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-22T14:38:58.101403178Z tar: Removing leading `/' from member names
2026-04-22T14:38:58.134919186Z tar: Removing leading `/' from member names
2026-04-22T14:38:58.143706441Z tar: Removing leading `/' from member names
2026-04-22T14:38:58.161062995Z tar: Removing leading `/' from member names
2026-04-22T14:38:58.165072841Z tar: Removing leading `/' from member names
2026-04-22T14:38:58.190146936Z tar: Removing leading `/' from member names
2026-04-22T14:38:58.286121683Z Wrote inspect data to must-gather.
2026-04-22T14:38:58.339296397Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-22T14:38:58.352120944Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-22T14:38:58.517976034Z Wrote inspect data to must-gather.
2026-04-22T14:38:58.591496229Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-22T14:38:58.672240657Z INFO: Waiting for network log collection to complete ...
2026-04-22T14:38:58.672357291Z INFO: Waiting for ovnk database copies to complete ...
2026-04-22T14:38:58.672913725Z INFO: Copying ovnk databases complete.
2026-04-22T14:38:58.674936161Z 3.4M	must-gather/network_logs/ovnk_database_store
2026-04-22T14:38:58.677920705Z ovnk_database_store/
2026-04-22T14:38:58.677920705Z ovnk_database_store/ovnkube-node-6zgvp_nbdb
2026-04-22T14:38:58.686416973Z ovnk_database_store/ovnkube-node-6zgvp_sbdb
2026-04-22T14:38:58.709517077Z ovnk_database_store/ovnkube-node-47psb_nbdb
2026-04-22T14:38:58.717235275Z ovnk_database_store/ovnkube-node-j58wd_nbdb
2026-04-22T14:38:58.728715105Z ovnk_database_store/ovnkube-node-j58wd_sbdb
2026-04-22T14:38:58.745180326Z ovnk_database_store/ovnkube-node-47psb_sbdb
2026-04-22T14:38:58.748896670Z Wrote inspect data to must-gather.
2026-04-22T14:38:58.769531024Z INFO: Network log collection complete.
2026-04-22T14:38:58.933768560Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-22T14:38:58.961787720Z INFO: Getting status from alertmanager-main-0
2026-04-22T14:38:59.050224419Z Wrote inspect data to must-gather.
2026-04-22T14:38:59.098518697Z Gathering data for ns/openshift-network-console...
2026-04-22T14:38:59.343784002Z Wrote inspect data to must-gather.
2026-04-22T14:38:59.467942745Z Gathering data for ns/openshift-console-operator...
2026-04-22T14:38:59.614356125Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-22T14:38:59.616567743Z INFO: Fallback to identify the container image from release info
2026-04-22T14:38:59.847842571Z Gathering data for ns/openshift-console...
2026-04-22T14:39:00.234993212Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-22T14:39:00.242835215Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-22T14:39:00.366301319Z daemonset.apps/perf-node-gather-daemonset created
2026-04-22T14:39:00.498315697Z Waiting for performance profile collector pods to become ready: 1
2026-04-22T14:39:00.613419719Z Gathering data for ns/openshift-dns-operator...
2026-04-22T14:39:00.887295329Z Gathering data for ns/openshift-dns...
2026-04-22T14:39:01.412753640Z Gathering data for ns/openshift-image-registry...
2026-04-22T14:39:01.626597166Z Waiting for performance profile collector pods to become ready: 2
2026-04-22T14:39:01.836453359Z Gathering data for ns/openshift-ingress-operator...
2026-04-22T14:39:02.073945470Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-22T14:39:02.114259507Z Gathering data for ns/openshift-ingress...
2026-04-22T14:39:02.418599933Z Gathering data for ns/openshift-ingress-canary...
2026-04-22T14:39:02.780531855Z Waiting for performance profile collector pods to become ready: 3
2026-04-22T14:39:02.804788786Z Gathering data for ns/openshift-insights...
2026-04-22T14:39:03.896141207Z Waiting for performance profile collector pods to become ready: 4
2026-04-22T14:39:04.864886600Z Gathering data for ns/kserve...
2026-04-22T14:39:05.014003574Z Waiting for performance profile collector pods to become ready: 5
2026-04-22T14:39:06.125327719Z Waiting for performance profile collector pods to become ready: 6
2026-04-22T14:39:06.324712935Z Gathering data for ns/openshift-config...
2026-04-22T14:39:06.557523845Z Gathering data for ns/openshift-config-managed...
2026-04-22T14:39:06.958519447Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-22T14:39:07.078379694Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-22T14:39:07.254533881Z Waiting for performance profile collector pods to become ready: 7
2026-04-22T14:39:07.279515258Z Gathering data for ns/openshift-kube-apiserver...
2026-04-22T14:39:07.536763772Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-22T14:39:07.789886314Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-22T14:39:08.100318344Z Gathering data for ns/openshift-kube-scheduler...
2026-04-22T14:39:08.346400616Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-22T14:39:08.395709010Z Waiting for performance profile collector pods to become ready: 8
2026-04-22T14:39:08.658576858Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-22T14:39:08.944052886Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-22T14:39:09.222532317Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-22T14:39:09.524503062Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-22T14:39:09.714401418Z Gathering data for ns/openshift-multus...
2026-04-22T14:39:09.785145782Z Collecting performance related data for node ip-10-0-130-98.ec2.internal
2026-04-22T14:39:09.792151805Z Collecting performance related data for node ip-10-0-129-161.ec2.internal
2026-04-22T14:39:09.799534761Z Collecting performance related data for node ip-10-0-131-75.ec2.internal
2026-04-22T14:39:11.268909700Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-22T14:39:12.082802354Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-22T14:39:12.837445768Z Gathering data for ns/openshift-host-network...
2026-04-22T14:39:13.105517682Z Gathering data for ns/openshift-network-diagnostics...
2026-04-22T14:39:13.580854428Z Gathering data for ns/openshift-network-node-identity...
2026-04-22T14:39:13.949140237Z Gathering data for ns/openshift-network-operator...
2026-04-22T14:39:14.322712244Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-22T14:39:14.596420584Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-22T14:39:15.066887094Z Gathering data for ns/openshift-apiserver-operator...
2026-04-22T14:39:15.402248320Z Gathering data for ns/openshift-apiserver...
2026-04-22T14:39:15.759459753Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-22T14:39:15.988104513Z Gathering data for ns/openshift-controller-manager...
2026-04-22T14:39:16.236132032Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-22T14:39:16.854555390Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-22T14:39:17.087311948Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-22T14:39:17.234037967Z Gathering data for ns/openshift-service-ca-operator...
2026-04-22T14:39:17.435113294Z Collecting kubelet logs for node ip-10-0-130-98.ec2.internal
2026-04-22T14:39:17.437284690Z Collecting kubelet logs for node ip-10-0-129-161.ec2.internal
2026-04-22T14:39:17.439066566Z Collecting kubelet logs for node ip-10-0-131-75.ec2.internal
2026-04-22T14:39:17.618365376Z Gathering data for ns/openshift-service-ca...
2026-04-22T14:39:17.809737779Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-22T14:39:17.814980948Z INFO: Node performance data collection complete.
2026-04-22T14:39:17.968322220Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-22T14:39:18.798686324Z Wrote inspect data to must-gather.
2026-04-22T14:39:18.798733996Z error: inspection completed with the errors occurred while gathering data:
2026-04-22T14:39:18.798733996Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-22T14:39:18.929195640Z error: the server doesn't have a resource type "clusters"
2026-04-22T14:39:19.042720781Z Caches written to disk