2026-04-23T18:16:18.362207464Z [disk usage checker] Started
2026-04-23T18:16:18.400624102Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-23T18:16:18.571334764Z Gathering data for ns/openshift-cluster-version...
2026-04-23T18:16:18.722196643Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-23T18:16:18.814690171Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-23T18:16:18.895019639Z Gathering data for ns/default...
2026-04-23T18:16:19.237141169Z Gathering data for ns/openshift...
2026-04-23T18:16:19.660523031Z Gathering data for ns/kube-system...
2026-04-23T18:16:20.388711045Z Gathering data for ns/openshift-etcd...
2026-04-23T18:16:20.733961251Z Wrote inspect data to must-gather.
2026-04-23T18:16:20.734048824Z error: inspection completed with the errors occurred while gathering data:
2026-04-23T18:16:20.734048824Z     namespaces "assisted-installer" not found
2026-04-23T18:16:20.790732120Z Waiting on subprocesses to finish execution.
2026-04-23T18:16:20.796846256Z INFO: Gathering HAProxy config files
2026-04-23T18:16:20.802215047Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-23T18:16:20.813094346Z INFO: Waiting for node performance related collection to complete ...
2026-04-23T18:16:20.819940122Z INFO: Collecting host service logs for crio
2026-04-23T18:16:20.820020324Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-23T18:16:20.820260171Z INFO: Collecting host service logs for kubelet
2026-04-23T18:16:20.820302270Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-23T18:16:20.820564589Z INFO: Collecting host service logs for rpm-ostreed
2026-04-23T18:16:20.820878443Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-23T18:16:20.821184697Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-23T18:16:20.821519970Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-23T18:16:20.821824408Z INFO: Collecting host service logs for NetworkManager
2026-04-23T18:16:20.822109274Z INFO: Collecting host service logs for openvswitch
2026-04-23T18:16:20.822418104Z INFO: Collecting host service logs for ovs-configuration
2026-04-23T18:16:20.822729281Z INFO: Collecting host service logs for ovsdb-server
2026-04-23T18:16:20.823041546Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-23T18:16:20.823388936Z INFO: Waiting for worker host service log collection to complete ...
2026-04-23T18:16:21.501587877Z Wrote inspect data to must-gather.
2026-04-23T18:16:21.570673325Z error: the server doesn't have a resource type "performanceprofile"
2026-04-23T18:16:21.572273602Z INFO: "metallb-operator" not detected. Skipping.
2026-04-23T18:16:21.672024447Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-23T18:16:21.693621518Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-23T18:16:21.693653861Z INFO: on-disk MachineConfig config collection complete.
2026-04-23T18:16:21.735716848Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-23T18:16:21.926191828Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-23T18:16:21.935088751Z No resources found
2026-04-23T18:16:22.171217979Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-23T18:16:22.172262059Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-hd2z2
2026-04-23T18:16:22.172262059Z insights-runtime-extractor-6np7g
2026-04-23T18:16:22.172262059Z insights-runtime-extractor-q9nhf
2026-04-23T18:16:22.172262059Z insights-runtime-extractor-wd76j
2026-04-23T18:16:22.226386074Z No resources found in openshift-etcd namespace.
2026-04-23T18:16:22.395251493Z No resources found
2026-04-23T18:16:22.484583927Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-23T18:16:22.609672370Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-23T18:16:22.616266157Z ERROR: No running kube-apiserver pods found
2026-04-23T18:16:22.697511068Z Wrote inspect data to must-gather.
2026-04-23T18:16:22.716074024Z Wrote inspect data to must-gather.
2026-04-23T18:16:22.842108445Z INFO: Worker host service log collection to complete.
2026-04-23T18:16:22.863130445Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-23T18:16:22.892346343Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-23T18:16:22.892346343Z See 'oc rsync -h' for help and examples
2026-04-23T18:16:22.897480932Z Wrote inspect data to must-gather.
2026-04-23T18:16:22.927025484Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-23T18:16:22.942622149Z Wrote inspect data to must-gather.
2026-04-23T18:16:23.011004012Z Wrote inspect data to must-gather.
2026-04-23T18:16:23.051724388Z tar: Removing leading `/' from member names
2026-04-23T18:16:23.060114529Z INFO: HAProxy config collection complete.
2026-04-23T18:16:23.065372860Z Wrote inspect data to must-gather.
2026-04-23T18:16:23.114253043Z Gathering data for ns/openshift-monitoring...
2026-04-23T18:16:23.166805217Z INFO: 'previous-logs' folder not found on ip-10-0-130-202.ec2.internal, skipping...
2026-04-23T18:16:23.223246221Z Wrote inspect data to must-gather.
2026-04-23T18:16:23.263059426Z error: the server doesn't have a resource type "machineconfigs"
2026-04-23T18:16:23.406509792Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-23T18:16:23.409561434Z INFO: Getting rules from prometheus-k8s-0
2026-04-23T18:16:23.438977852Z INFO: 'previous-logs' folder not found on ip-10-0-132-102.ec2.internal, skipping...
2026-04-23T18:16:23.487846642Z Wrote inspect data to must-gather.
2026-04-23T18:16:23.502104456Z Wrote inspect data to must-gather.
2026-04-23T18:16:23.713840221Z INFO: 'previous-logs' folder not found on ip-10-0-141-209.ec2.internal, skipping...
2026-04-23T18:16:23.713867861Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-23T18:16:23.713890941Z INFO: Machine Config Daemon termination log collection complete.
2026-04-23T18:16:23.733727343Z Wrote inspect data to must-gather.
2026-04-23T18:16:23.744046957Z Wrote inspect data to must-gather.
2026-04-23T18:16:23.873000072Z INFO: Getting status/config from prometheus-k8s-0
2026-04-23T18:16:23.891216735Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-23T18:16:24.029254796Z INFO: INTERCONNECT MODE
2026-04-23T18:16:24.029279792Z INFO: Gathering ovn-kubernetes DBs
2026-04-23T18:16:24.100396829Z Wrote inspect data to must-gather.
2026-04-23T18:16:24.183463853Z INFO: Gathering OVN_Northbound from ovnkube-node-8tv94...
2026-04-23T18:16:24.183686037Z INFO: Gathering OVN_Northbound from ovnkube-node-9sxcg...
2026-04-23T18:16:24.183936212Z INFO: Gathering OVN_Northbound from ovnkube-node-tph9h...
2026-04-23T18:16:24.184215606Z INFO: Gathering OVN_Southbound from ovnkube-node-8tv94...
2026-04-23T18:16:24.184474734Z INFO: Gathering OVN_Southbound from ovnkube-node-9sxcg...
2026-04-23T18:16:24.184772024Z INFO: Gathering OVN_Southbound from ovnkube-node-tph9h...
2026-04-23T18:16:24.364294934Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-23T18:16:24.393443999Z Wrote inspect data to must-gather.
2026-04-23T18:16:24.470014905Z tar: Removing leading `/' from member names
2026-04-23T18:16:24.474474438Z tar: Removing leading `/' from member names
2026-04-23T18:16:24.485862144Z tar: Removing leading `/' from member names
2026-04-23T18:16:24.489525499Z tar: Removing leading `/' from member names
2026-04-23T18:16:24.500244468Z tar: Removing leading `/' from member names
2026-04-23T18:16:24.515712795Z tar: Removing leading `/' from member names
2026-04-23T18:16:24.641995875Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-23T18:16:24.676038760Z Wrote inspect data to must-gather.
2026-04-23T18:16:24.691530873Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-23T18:16:24.885797887Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-23T18:16:24.914299257Z Wrote inspect data to must-gather.
2026-04-23T18:16:24.982275304Z INFO: Waiting for network log collection to complete ...
2026-04-23T18:16:24.982359996Z INFO: Waiting for ovnk database copies to complete ...
2026-04-23T18:16:24.982674510Z INFO: Copying ovnk databases complete.
2026-04-23T18:16:24.984224645Z 3.3M	must-gather/network_logs/ovnk_database_store
2026-04-23T18:16:24.987719417Z ovnk_database_store/
2026-04-23T18:16:24.987719417Z ovnk_database_store/ovnkube-node-8tv94_sbdb
2026-04-23T18:16:25.009791115Z ovnk_database_store/ovnkube-node-8tv94_nbdb
2026-04-23T18:16:25.016308363Z ovnk_database_store/ovnkube-node-9sxcg_sbdb
2026-04-23T18:16:25.038092999Z ovnk_database_store/ovnkube-node-tph9h_sbdb
2026-04-23T18:16:25.055661681Z ovnk_database_store/ovnkube-node-9sxcg_nbdb
2026-04-23T18:16:25.063157477Z ovnk_database_store/ovnkube-node-tph9h_nbdb
2026-04-23T18:16:25.076301219Z INFO: Network log collection complete.
2026-04-23T18:16:25.124861350Z Wrote inspect data to must-gather.
2026-04-23T18:16:25.157031704Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-23T18:16:25.279220810Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-23T18:16:25.402885098Z Wrote inspect data to must-gather.
2026-04-23T18:16:25.434699416Z Gathering data for ns/openshift-network-console...
2026-04-23T18:16:25.547474698Z INFO: Getting status from alertmanager-main-0
2026-04-23T18:16:25.686077176Z Wrote inspect data to must-gather.
2026-04-23T18:16:25.884252257Z Gathering data for ns/openshift-console-operator...
2026-04-23T18:16:25.945987097Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-23T18:16:25.948912631Z INFO: Fallback to identify the container image from release info
2026-04-23T18:16:26.262387645Z Gathering data for ns/openshift-console...
2026-04-23T18:16:26.451132304Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-23T18:16:26.574209640Z daemonset.apps/perf-node-gather-daemonset created
2026-04-23T18:16:26.712575484Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-23T18:16:26.721070040Z Waiting for performance profile collector pods to become ready: 1
2026-04-23T18:16:27.089153156Z Gathering data for ns/openshift-dns-operator...
2026-04-23T18:16:27.421648677Z Gathering data for ns/openshift-dns...
2026-04-23T18:16:27.842872984Z Waiting for performance profile collector pods to become ready: 2
2026-04-23T18:16:28.020000843Z Gathering data for ns/openshift-image-registry...
2026-04-23T18:16:28.412616816Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-23T18:16:28.482183431Z Gathering data for ns/openshift-ingress-operator...
2026-04-23T18:16:28.868172513Z Gathering data for ns/openshift-ingress...
2026-04-23T18:16:28.974479246Z Waiting for performance profile collector pods to become ready: 3
2026-04-23T18:16:29.217383645Z Gathering data for ns/openshift-ingress-canary...
2026-04-23T18:16:29.605532864Z Gathering data for ns/openshift-insights...
2026-04-23T18:16:30.097179785Z Waiting for performance profile collector pods to become ready: 4
2026-04-23T18:16:31.216221477Z Waiting for performance profile collector pods to become ready: 5
2026-04-23T18:16:31.687641993Z Gathering data for ns/kserve...
2026-04-23T18:16:32.337669796Z Waiting for performance profile collector pods to become ready: 6
2026-04-23T18:16:33.095990457Z Gathering data for ns/openshift-config...
2026-04-23T18:16:33.399018500Z Gathering data for ns/openshift-config-managed...
2026-04-23T18:16:33.426078882Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-23T18:16:33.491961894Z Waiting for performance profile collector pods to become ready: 7
2026-04-23T18:16:33.840014573Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-23T18:16:34.106826703Z Gathering data for ns/openshift-kube-apiserver...
2026-04-23T18:16:34.372860066Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-23T18:16:34.619965838Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-23T18:16:34.674365358Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-23T18:16:34.888922691Z Collecting performance related data for node ip-10-0-130-202.ec2.internal
2026-04-23T18:16:34.898209715Z Collecting performance related data for node ip-10-0-132-102.ec2.internal
2026-04-23T18:16:34.906037451Z Collecting performance related data for node ip-10-0-141-209.ec2.internal
2026-04-23T18:16:35.023310702Z Gathering data for ns/openshift-kube-scheduler...
2026-04-23T18:16:35.368905525Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-23T18:16:35.725698054Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-23T18:16:36.129089937Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-23T18:16:36.529151317Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-23T18:16:37.144302568Z Gathering data for ns/openshift-multus...
2026-04-23T18:16:38.436822107Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-23T18:16:38.602037978Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-23T18:16:40.237152605Z Gathering data for ns/openshift-host-network...
2026-04-23T18:16:40.586630018Z Gathering data for ns/openshift-network-diagnostics...
2026-04-23T18:16:41.233974319Z Gathering data for ns/openshift-network-node-identity...
2026-04-23T18:16:41.672114716Z Gathering data for ns/openshift-network-operator...
2026-04-23T18:16:42.198400959Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-23T18:16:42.556345591Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-23T18:16:42.925654223Z Collecting kubelet logs for node ip-10-0-130-202.ec2.internal
2026-04-23T18:16:42.927837730Z Collecting kubelet logs for node ip-10-0-132-102.ec2.internal
2026-04-23T18:16:42.929845149Z Collecting kubelet logs for node ip-10-0-141-209.ec2.internal
2026-04-23T18:16:43.093571820Z Gathering data for ns/openshift-apiserver-operator...
2026-04-23T18:16:43.318568205Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-23T18:16:43.324149145Z INFO: Node performance data collection complete.
2026-04-23T18:16:43.430958874Z Gathering data for ns/openshift-apiserver...
2026-04-23T18:16:43.442851152Z [disk usage checker] Volume usage percentage: current = 18 ; allowed = 70
2026-04-23T18:16:43.856915037Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-23T18:16:44.130366088Z Gathering data for ns/openshift-controller-manager...
2026-04-23T18:16:44.400085505Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-23T18:16:45.043184221Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-23T18:16:45.343405199Z Gathering data for ns/openshift-service-ca-operator...
2026-04-23T18:16:45.660783109Z Gathering data for ns/openshift-service-ca...
2026-04-23T18:16:46.041175341Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-23T18:16:46.931479962Z Wrote inspect data to must-gather.
2026-04-23T18:16:46.931525300Z error: inspection completed with the errors occurred while gathering data:
2026-04-23T18:16:46.931525300Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-23T18:16:47.065836400Z error: the server doesn't have a resource type "clusters"
2026-04-23T18:16:47.206109038Z Caches written to disk