2026-06-03T09:48:46.385875803Z [disk usage checker] Started
2026-06-03T09:48:46.389438813Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-03T09:48:46.580596417Z Gathering data for ns/openshift-cluster-version...
2026-06-03T09:48:46.705114992Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-03T09:48:46.793942098Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T09:48:46.871854355Z Gathering data for ns/default...
2026-06-03T09:48:47.170090121Z Gathering data for ns/openshift...
2026-06-03T09:48:47.563794111Z Gathering data for ns/kube-system...
2026-06-03T09:48:48.284267936Z Gathering data for ns/openshift-etcd...
2026-06-03T09:48:48.578409261Z Wrote inspect data to must-gather.
2026-06-03T09:48:48.578503712Z error: inspection completed with the errors occurred while gathering data:
2026-06-03T09:48:48.578503712Z     namespaces "assisted-installer" not found
2026-06-03T09:48:48.596952351Z Waiting on subprocesses to finish execution.
2026-06-03T09:48:48.601345247Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-03T09:48:48.606758843Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-03T09:48:48.609258291Z INFO: Gathering HAProxy config files
2026-06-03T09:48:48.610679358Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-03T09:48:48.616433495Z INFO: Collecting host service logs for crio
2026-06-03T09:48:48.616781508Z INFO: Collecting host service logs for kubelet
2026-06-03T09:48:48.617116736Z INFO: Collecting host service logs for rpm-ostreed
2026-06-03T09:48:48.617525795Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-03T09:48:48.617865616Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-03T09:48:48.618203219Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-03T09:48:48.618553558Z INFO: Collecting host service logs for NetworkManager
2026-06-03T09:48:48.618894647Z INFO: Collecting host service logs for openvswitch
2026-06-03T09:48:48.619351280Z INFO: Collecting host service logs for ovs-configuration
2026-06-03T09:48:48.619727277Z INFO: Collecting host service logs for ovsdb-server
2026-06-03T09:48:48.620046840Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-03T09:48:48.620444268Z INFO: Waiting for worker host service log collection to complete ...
2026-06-03T09:48:48.713480063Z INFO: Waiting for node performance related collection to complete ...
2026-06-03T09:48:48.917639549Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-rrlkv
2026-06-03T09:48:48.917705425Z insights-runtime-extractor-9nx6l
2026-06-03T09:48:48.917726520Z insights-runtime-extractor-nzxfx
2026-06-03T09:48:48.917746909Z insights-runtime-extractor-wv4z6
2026-06-03T09:48:49.086817262Z No resources found in openshift-etcd namespace.
2026-06-03T09:48:49.180232553Z No resources found
2026-06-03T09:48:49.339452659Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-03T09:48:49.720174223Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-03T09:48:49.720206319Z INFO: on-disk MachineConfig config collection complete.
2026-06-03T09:48:49.758498999Z INFO: "metallb-operator" not detected. Skipping.
2026-06-03T09:48:49.779029631Z Wrote inspect data to must-gather.
2026-06-03T09:48:49.852019440Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-03T09:48:49.852758411Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-03T09:48:49.889768383Z error: the server doesn't have a resource type "performanceprofile"
2026-06-03T09:48:49.895525978Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-03T09:48:49.955776999Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-03T09:48:49.999792135Z INFO: Worker host service log collection to complete.
2026-06-03T09:48:50.042375224Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-03T09:48:50.042375224Z See 'oc rsync -h' for help and examples
2026-06-03T09:48:50.252740686Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-03T09:48:50.259996204Z ERROR: No running kube-apiserver pods found
2026-06-03T09:48:50.405627171Z Wrote inspect data to must-gather.
2026-06-03T09:48:50.542776750Z Wrote inspect data to must-gather.
2026-06-03T09:48:50.583374521Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-03T09:48:50.599718206Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T09:48:50.641539256Z Wrote inspect data to must-gather.
2026-06-03T09:48:50.697669274Z INFO: 'previous-logs' folder not found on ip-10-0-129-86.ec2.internal, skipping...
2026-06-03T09:48:50.716567097Z No resources found
2026-06-03T09:48:50.721479286Z Gathering data for ns/openshift-monitoring...
2026-06-03T09:48:50.753150309Z Wrote inspect data to must-gather.
2026-06-03T09:48:50.780691301Z Wrote inspect data to must-gather.
2026-06-03T09:48:50.816215055Z tar: Removing leading `/' from member names
2026-06-03T09:48:50.821116062Z Wrote inspect data to must-gather.
2026-06-03T09:48:50.822104038Z INFO: HAProxy config collection complete.
2026-06-03T09:48:50.926287607Z error: the server doesn't have a resource type "machineconfigs"
2026-06-03T09:48:50.991547818Z INFO: 'previous-logs' folder not found on ip-10-0-135-171.ec2.internal, skipping...
2026-06-03T09:48:51.016770801Z INFO: Getting rules from prometheus-k8s-0
2026-06-03T09:48:51.031114270Z Wrote inspect data to must-gather.
2026-06-03T09:48:51.151630164Z Wrote inspect data to must-gather.
2026-06-03T09:48:51.241869902Z INFO: 'previous-logs' folder not found on ip-10-0-139-245.ec2.internal, skipping...
2026-06-03T09:48:51.241903141Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-03T09:48:51.241910597Z INFO: Machine Config Daemon termination log collection complete.
2026-06-03T09:48:51.259295131Z Wrote inspect data to must-gather.
2026-06-03T09:48:51.356639355Z Wrote inspect data to must-gather.
2026-06-03T09:48:51.391482268Z INFO: Getting status/config from prometheus-k8s-0
2026-06-03T09:48:51.394650154Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-03T09:48:51.472882574Z Wrote inspect data to must-gather.
2026-06-03T09:48:51.504811586Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-03T09:48:51.694876553Z Wrote inspect data to must-gather.
2026-06-03T09:48:51.739424383Z INFO: INTERCONNECT MODE
2026-06-03T09:48:51.739459656Z INFO: Gathering ovn-kubernetes DBs
2026-06-03T09:48:51.763909630Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-03T09:48:51.902069249Z Wrote inspect data to must-gather.
2026-06-03T09:48:51.903457304Z INFO: Gathering OVN_Northbound from ovnkube-node-79qpx...
2026-06-03T09:48:51.903672209Z INFO: Gathering OVN_Northbound from ovnkube-node-m4bz9...
2026-06-03T09:48:51.903869276Z INFO: Gathering OVN_Northbound from ovnkube-node-nkws8...
2026-06-03T09:48:51.904094637Z INFO: Gathering OVN_Southbound from ovnkube-node-79qpx...
2026-06-03T09:48:51.904376779Z INFO: Gathering OVN_Southbound from ovnkube-node-m4bz9...
2026-06-03T09:48:51.904610114Z INFO: Gathering OVN_Southbound from ovnkube-node-nkws8...
2026-06-03T09:48:52.034435393Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-03T09:48:52.199405768Z tar: Removing leading `/' from member names
2026-06-03T09:48:52.206059208Z tar: Removing leading `/' from member names
2026-06-03T09:48:52.206270043Z tar: Removing leading `/' from member names
2026-06-03T09:48:52.213398513Z tar: Removing leading `/' from member names
2026-06-03T09:48:52.223335508Z tar: Removing leading `/' from member names
2026-06-03T09:48:52.247145976Z tar: Removing leading `/' from member names
2026-06-03T09:48:52.252890705Z Wrote inspect data to must-gather.
2026-06-03T09:48:52.263686326Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-03T09:48:52.342549493Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-03T09:48:52.472411402Z Wrote inspect data to must-gather.
2026-06-03T09:48:52.589146756Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-03T09:48:52.640302396Z INFO: Waiting for network log collection to complete ...
2026-06-03T09:48:52.640376369Z INFO: Waiting for ovnk database copies to complete ...
2026-06-03T09:48:52.640860203Z INFO: Copying ovnk databases complete.
2026-06-03T09:48:52.642948275Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-06-03T09:48:52.645653862Z ovnk_database_store/
2026-06-03T09:48:52.645704829Z ovnk_database_store/ovnkube-node-nkws8_nbdb
2026-06-03T09:48:52.652525950Z ovnk_database_store/ovnkube-node-m4bz9_nbdb
2026-06-03T09:48:52.659613810Z ovnk_database_store/ovnkube-node-m4bz9_sbdb
2026-06-03T09:48:52.676111315Z ovnk_database_store/ovnkube-node-nkws8_sbdb
2026-06-03T09:48:52.680254861Z Wrote inspect data to must-gather.
2026-06-03T09:48:52.693958834Z ovnk_database_store/ovnkube-node-79qpx_sbdb
2026-06-03T09:48:52.712522433Z ovnk_database_store/ovnkube-node-79qpx_nbdb
2026-06-03T09:48:52.722228163Z INFO: Network log collection complete.
2026-06-03T09:48:52.852241662Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T09:48:52.940807241Z Wrote inspect data to must-gather.
2026-06-03T09:48:52.988398175Z INFO: Getting status from alertmanager-main-0
2026-06-03T09:48:53.023024436Z Gathering data for ns/openshift-network-console...
2026-06-03T09:48:53.212364051Z Wrote inspect data to must-gather.
2026-06-03T09:48:53.418426687Z Gathering data for ns/openshift-console-operator...
2026-06-03T09:48:53.446936257Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-03T09:48:53.448761856Z INFO: Fallback to identify the container image from release info
2026-06-03T09:48:53.752061682Z Gathering data for ns/openshift-console...
2026-06-03T09:48:54.136633700Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-03T09:48:54.178279190Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-03T09:48:54.296639278Z daemonset.apps/perf-node-gather-daemonset created
2026-06-03T09:48:54.422112876Z Waiting for performance profile collector pods to become ready: 1
2026-06-03T09:48:54.489751940Z Gathering data for ns/openshift-dns-operator...
2026-06-03T09:48:54.783715722Z Gathering data for ns/openshift-dns...
2026-06-03T09:48:55.344100951Z Gathering data for ns/openshift-image-registry...
2026-06-03T09:48:55.539804795Z Waiting for performance profile collector pods to become ready: 2
2026-06-03T09:48:55.786220890Z Gathering data for ns/openshift-ingress-operator...
2026-06-03T09:48:56.112979946Z Gathering data for ns/openshift-ingress...
2026-06-03T09:48:56.399572267Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-03T09:48:56.457572891Z Gathering data for ns/openshift-ingress-canary...
2026-06-03T09:48:56.656517539Z Waiting for performance profile collector pods to become ready: 3
2026-06-03T09:48:56.842511171Z Gathering data for ns/openshift-insights...
2026-06-03T09:48:57.763410344Z Waiting for performance profile collector pods to become ready: 4
2026-06-03T09:48:58.615647269Z Gathering data for ns/openshift-config...
2026-06-03T09:48:58.877974827Z Gathering data for ns/openshift-config-managed...
2026-06-03T09:48:58.882944681Z Waiting for performance profile collector pods to become ready: 5
2026-06-03T09:48:59.290464681Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-03T09:48:59.612549910Z Gathering data for ns/openshift-kube-apiserver...
2026-06-03T09:48:59.869053857Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-03T09:48:59.996456594Z Waiting for performance profile collector pods to become ready: 6
2026-06-03T09:49:00.159445194Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-03T09:49:00.444761973Z Gathering data for ns/openshift-kube-scheduler...
2026-06-03T09:49:00.713827992Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-03T09:49:01.010938627Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-03T09:49:01.114158964Z Waiting for performance profile collector pods to become ready: 7
2026-06-03T09:49:01.377351519Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-03T09:49:01.404061884Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-03T09:49:01.697554471Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-03T09:49:02.223227398Z Gathering data for ns/openshift-multus...
2026-06-03T09:49:02.232091046Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-03T09:49:02.446863452Z Collecting performance related data for node ip-10-0-135-171.ec2.internal
2026-06-03T09:49:02.453380992Z Collecting performance related data for node ip-10-0-129-86.ec2.internal
2026-06-03T09:49:02.460341607Z Collecting performance related data for node ip-10-0-139-245.ec2.internal
2026-06-03T09:49:03.963202702Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-03T09:49:05.483739715Z Gathering data for ns/openshift-host-network...
2026-06-03T09:49:05.787304922Z Gathering data for ns/openshift-network-diagnostics...
2026-06-03T09:49:06.358647066Z Gathering data for ns/openshift-network-node-identity...
2026-06-03T09:49:06.411145168Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-03T09:49:06.759537044Z Gathering data for ns/openshift-network-operator...
2026-06-03T09:49:07.132868407Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-03T09:49:07.390521463Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-03T09:49:07.886552634Z Gathering data for ns/openshift-apiserver-operator...
2026-06-03T09:49:08.247397956Z Gathering data for ns/openshift-apiserver...
2026-06-03T09:49:08.657262065Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-03T09:49:08.912636892Z Gathering data for ns/openshift-controller-manager...
2026-06-03T09:49:09.176340065Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-03T09:49:09.837514413Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-03T09:49:10.170730918Z Gathering data for ns/openshift-service-ca-operator...
2026-06-03T09:49:10.460896396Z Gathering data for ns/openshift-service-ca...
2026-06-03T09:49:10.538708023Z Collecting kubelet logs for node ip-10-0-135-171.ec2.internal
2026-06-03T09:49:10.540897768Z Collecting kubelet logs for node ip-10-0-129-86.ec2.internal
2026-06-03T09:49:10.543186842Z Collecting kubelet logs for node ip-10-0-139-245.ec2.internal
2026-06-03T09:49:10.863031824Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-03T09:49:10.882785645Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-03T09:49:10.887856006Z INFO: Node performance data collection complete.
2026-06-03T09:49:11.418705435Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-03T09:49:11.763889686Z Wrote inspect data to must-gather.
2026-06-03T09:49:11.763931185Z error: inspection completed with the errors occurred while gathering data:
2026-06-03T09:49:11.763931185Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-03T09:49:11.888520229Z error: the server doesn't have a resource type "clusters"
2026-06-03T09:49:12.047174158Z Caches written to disk