2026-06-03T09:06:58.985788341Z [disk usage checker] Started
2026-06-03T09:06:58.989316234Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-03T09:06:59.212391378Z Gathering data for ns/openshift-cluster-version...
2026-06-03T09:06:59.374515620Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-03T09:06:59.481772507Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T09:06:59.596029314Z Gathering data for ns/default...
2026-06-03T09:07:00.073068251Z Gathering data for ns/openshift...
2026-06-03T09:07:00.561201786Z Gathering data for ns/kube-system...
2026-06-03T09:07:01.426120123Z Gathering data for ns/openshift-etcd...
2026-06-03T09:07:01.458483764Z Waiting on subprocesses to finish execution.
2026-06-03T09:07:01.465540305Z INFO: Collecting host service logs for crio
2026-06-03T09:07:01.465857344Z INFO: Collecting host service logs for kubelet
2026-06-03T09:07:01.466187496Z INFO: Collecting host service logs for rpm-ostreed
2026-06-03T09:07:01.466610712Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-03T09:07:01.466961609Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-03T09:07:01.467312551Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-03T09:07:01.467646359Z INFO: Collecting host service logs for NetworkManager
2026-06-03T09:07:01.467983664Z INFO: Collecting host service logs for openvswitch
2026-06-03T09:07:01.468326731Z INFO: Collecting host service logs for ovs-configuration
2026-06-03T09:07:01.468664306Z INFO: Collecting host service logs for ovsdb-server
2026-06-03T09:07:01.468991475Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-03T09:07:01.469451059Z INFO: Waiting for worker host service log collection to complete ...
2026-06-03T09:07:01.478262506Z INFO: Gathering HAProxy config files
2026-06-03T09:07:01.478667888Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-03T09:07:01.478872777Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-03T09:07:01.526754984Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-03T09:07:01.692395810Z INFO: Waiting for node performance related collection to complete ...
2026-06-03T09:07:01.940636241Z No resources found
2026-06-03T09:07:02.341166362Z No resources found in openshift-etcd namespace.
2026-06-03T09:07:02.515941929Z INFO: "metallb-operator" not detected. Skipping.
2026-06-03T09:07:02.661614992Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-03T09:07:02.921223884Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-03T09:07:03.001771172Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-03T09:07:03.190631392Z error: the server doesn't have a resource type "performanceprofile"
2026-06-03T09:07:03.230843370Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-03T09:07:03.268485487Z INFO: Worker host service log collection to complete.
2026-06-03T09:07:03.368319271Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-2fhnj
2026-06-03T09:07:03.368370604Z insights-runtime-extractor-h4v6l
2026-06-03T09:07:03.368391450Z insights-runtime-extractor-hxx7p
2026-06-03T09:07:03.368410899Z insights-runtime-extractor-pdh2g
2026-06-03T09:07:03.388158894Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-03T09:07:03.442245663Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T09:07:03.484373184Z No resources found
2026-06-03T09:07:03.624372739Z Wrote inspect data to must-gather.
2026-06-03T09:07:03.630371610Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-03T09:07:03.630457972Z INFO: on-disk MachineConfig config collection complete.
2026-06-03T09:07:03.904428410Z ERROR: No running kube-apiserver pods found
2026-06-03T09:07:03.929644263Z Wrote inspect data to must-gather.
2026-06-03T09:07:04.001572325Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-03T09:07:04.055870525Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-03T09:07:04.170385413Z INFO: 'previous-logs' folder not found on ip-10-0-129-83.ec2.internal, skipping...
2026-06-03T09:07:04.405326176Z Wrote inspect data to must-gather.
2026-06-03T09:07:04.505916046Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-03T09:07:04.505916046Z See 'oc rsync -h' for help and examples
2026-06-03T09:07:04.518002085Z Wrote inspect data to must-gather.
2026-06-03T09:07:04.518040796Z error: inspection completed with the errors occurred while gathering data:
2026-06-03T09:07:04.518040796Z     namespaces "assisted-installer" not found
2026-06-03T09:07:04.525016595Z Wrote inspect data to must-gather.
2026-06-03T09:07:04.552048881Z Wrote inspect data to must-gather.
2026-06-03T09:07:04.567965227Z Wrote inspect data to must-gather.
2026-06-03T09:07:04.606056815Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-03T09:07:04.611813723Z Wrote inspect data to must-gather.
2026-06-03T09:07:04.700252377Z INFO: 'previous-logs' folder not found on ip-10-0-130-255.ec2.internal, skipping...
2026-06-03T09:07:04.752554434Z error: the server doesn't have a resource type "machineconfigs"
2026-06-03T09:07:04.790231672Z INFO: Getting rules from prometheus-k8s-0
2026-06-03T09:07:04.955904606Z tar: Removing leading `/' from member names
2026-06-03T09:07:04.964629534Z INFO: HAProxy config collection complete.
2026-06-03T09:07:05.083298574Z Gathering data for ns/kuadrant-system...
2026-06-03T09:07:05.089108035Z INFO: 'previous-logs' folder not found on ip-10-0-138-22.ec2.internal, skipping...
2026-06-03T09:07:05.089148632Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-03T09:07:05.089184079Z INFO: Machine Config Daemon termination log collection complete.
2026-06-03T09:07:05.174379595Z Wrote inspect data to must-gather.
2026-06-03T09:07:05.187630449Z Wrote inspect data to must-gather.
2026-06-03T09:07:05.300496125Z INFO: Getting status/config from prometheus-k8s-0
2026-06-03T09:07:05.515519698Z Wrote inspect data to must-gather.
2026-06-03T09:07:05.558807595Z Wrote inspect data to must-gather.
2026-06-03T09:07:05.737037988Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-03T09:07:05.759769669Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-03T09:07:05.948068150Z INFO: INTERCONNECT MODE
2026-06-03T09:07:05.948161111Z INFO: Gathering ovn-kubernetes DBs
2026-06-03T09:07:06.061042287Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-03T09:07:06.064882585Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-03T09:07:06.151266910Z Wrote inspect data to must-gather.
2026-06-03T09:07:06.194493331Z INFO: Gathering OVN_Northbound from ovnkube-node-9qbwn...
2026-06-03T09:07:06.194757402Z INFO: Gathering OVN_Northbound from ovnkube-node-gdhbw...
2026-06-03T09:07:06.195049783Z INFO: Gathering OVN_Northbound from ovnkube-node-qwmxm...
2026-06-03T09:07:06.195378798Z INFO: Gathering OVN_Southbound from ovnkube-node-9qbwn...
2026-06-03T09:07:06.195659116Z INFO: Gathering OVN_Southbound from ovnkube-node-gdhbw...
2026-06-03T09:07:06.195915722Z INFO: Gathering OVN_Southbound from ovnkube-node-qwmxm...
2026-06-03T09:07:06.442360771Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-03T09:07:06.537105862Z tar: Removing leading `/' from member names
2026-06-03T09:07:06.585511518Z tar: Removing leading `/' from member names
2026-06-03T09:07:06.603288831Z tar: Removing leading `/' from member names
2026-06-03T09:07:06.611070459Z tar: Removing leading `/' from member names
2026-06-03T09:07:06.677210748Z tar: Removing leading `/' from member names
2026-06-03T09:07:06.680606283Z tar: Removing leading `/' from member names
2026-06-03T09:07:06.746104183Z Wrote inspect data to must-gather.
2026-06-03T09:07:06.814787624Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T09:07:06.833473255Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-03T09:07:07.151182816Z Gathering data for ns/openshift-monitoring...
2026-06-03T09:07:07.273676206Z Wrote inspect data to must-gather.
2026-06-03T09:07:07.327694063Z INFO: Getting status from alertmanager-main-0
2026-06-03T09:07:07.329200808Z INFO: Waiting for network log collection to complete ...
2026-06-03T09:07:07.329253867Z INFO: Waiting for ovnk database copies to complete ...
2026-06-03T09:07:07.329756144Z INFO: Copying ovnk databases complete.
2026-06-03T09:07:07.331874008Z 4.2M	must-gather/network_logs/ovnk_database_store
2026-06-03T09:07:07.334590498Z ovnk_database_store/
2026-06-03T09:07:07.334643883Z ovnk_database_store/ovnkube-node-gdhbw_nbdb
2026-06-03T09:07:07.346073752Z ovnk_database_store/ovnkube-node-9qbwn_nbdb
2026-06-03T09:07:07.357662658Z ovnk_database_store/ovnkube-node-qwmxm_nbdb
2026-06-03T09:07:07.367911271Z ovnk_database_store/ovnkube-node-9qbwn_sbdb
2026-06-03T09:07:07.399402937Z ovnk_database_store/ovnkube-node-qwmxm_sbdb
2026-06-03T09:07:07.426500947Z ovnk_database_store/ovnkube-node-gdhbw_sbdb
2026-06-03T09:07:07.453187367Z INFO: Network log collection complete.
2026-06-03T09:07:07.658430346Z Wrote inspect data to must-gather.
2026-06-03T09:07:08.010963963Z Wrote inspect data to must-gather.
2026-06-03T09:07:08.317539774Z Wrote inspect data to must-gather.
2026-06-03T09:07:08.665130504Z Wrote inspect data to must-gather.
2026-06-03T09:07:08.942309859Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-03T09:07:08.944949323Z INFO: Fallback to identify the container image from release info
2026-06-03T09:07:09.062065900Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-03T09:07:09.482588216Z Gathering data for ns/openshift-network-console...
2026-06-03T09:07:09.769187027Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-03T09:07:09.920592598Z daemonset.apps/perf-node-gather-daemonset created
2026-06-03T09:07:10.028081786Z Gathering data for ns/openshift-console-operator...
2026-06-03T09:07:10.057337175Z Waiting for performance profile collector pods to become ready: 1
2026-06-03T09:07:10.569656396Z Gathering data for ns/openshift-console...
2026-06-03T09:07:11.103861819Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-03T09:07:11.205960414Z Waiting for performance profile collector pods to become ready: 2
2026-06-03T09:07:11.511610885Z Wrote inspect data to must-gather.
2026-06-03T09:07:11.551260435Z Gathering data for ns/openshift-dns-operator...
2026-06-03T09:07:11.872950533Z Gathering data for ns/openshift-dns...
2026-06-03T09:07:12.332671122Z Waiting for performance profile collector pods to become ready: 3
2026-06-03T09:07:12.544607448Z Gathering data for ns/openshift-image-registry...
2026-06-03T09:07:13.027764457Z Gathering data for ns/openshift-ingress-operator...
2026-06-03T09:07:13.467717413Z Waiting for performance profile collector pods to become ready: 4
2026-06-03T09:07:13.474809231Z Gathering data for ns/openshift-ingress...
2026-06-03T09:07:14.067711166Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70
2026-06-03T09:07:14.157852179Z Gathering data for ns/openshift-ingress-canary...
2026-06-03T09:07:14.598099135Z Waiting for performance profile collector pods to become ready: 5
2026-06-03T09:07:14.646505150Z Gathering data for ns/openshift-insights...
2026-06-03T09:07:15.712429024Z Waiting for performance profile collector pods to become ready: 6
2026-06-03T09:07:16.820307503Z Waiting for performance profile collector pods to become ready: 7
2026-06-03T09:07:16.899494633Z Gathering data for ns/opendatahub...
2026-06-03T09:07:17.944089065Z Waiting for performance profile collector pods to become ready: 8
2026-06-03T09:07:18.646314971Z Gathering data for ns/openshift-lws-operator...
2026-06-03T09:07:19.072479800Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-03T09:07:19.081293829Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-03T09:07:19.314264646Z Collecting performance related data for node ip-10-0-138-22.ec2.internal
2026-06-03T09:07:19.321171194Z Collecting performance related data for node ip-10-0-129-83.ec2.internal
2026-06-03T09:07:19.328439225Z Collecting performance related data for node ip-10-0-130-255.ec2.internal
2026-06-03T09:07:20.373737859Z Gathering data for ns/openshift-config...
2026-06-03T09:07:20.795343977Z Gathering data for ns/openshift-config-managed...
2026-06-03T09:07:21.294801892Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-03T09:07:21.650379175Z Gathering data for ns/openshift-kube-apiserver...
2026-06-03T09:07:22.027685179Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-03T09:07:22.433387777Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-03T09:07:22.785604554Z Gathering data for ns/openshift-kube-scheduler...
2026-06-03T09:07:23.127218954Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-03T09:07:23.501314452Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-03T09:07:23.890694090Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-03T09:07:24.086994484Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-03T09:07:24.260010961Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-03T09:07:24.889969772Z Gathering data for ns/openshift-multus...
2026-06-03T09:07:26.611813986Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-03T09:07:27.454993868Z Collecting kubelet logs for node ip-10-0-138-22.ec2.internal
2026-06-03T09:07:27.457506463Z Collecting kubelet logs for node ip-10-0-129-83.ec2.internal
2026-06-03T09:07:27.459494400Z Collecting kubelet logs for node ip-10-0-130-255.ec2.internal
2026-06-03T09:07:27.827176570Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-03T09:07:27.833919074Z INFO: Node performance data collection complete.
2026-06-03T09:07:28.346697589Z Gathering data for ns/openshift-host-network...
2026-06-03T09:07:28.694904731Z Gathering data for ns/openshift-network-diagnostics...
2026-06-03T09:07:29.092506680Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-03T09:07:29.252841337Z Gathering data for ns/openshift-network-node-identity...
2026-06-03T09:07:29.728347861Z Gathering data for ns/openshift-network-operator...
2026-06-03T09:07:30.174071064Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-03T09:07:30.508911417Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-03T09:07:30.994514666Z Gathering data for ns/openshift-apiserver-operator...
2026-06-03T09:07:31.331971209Z Gathering data for ns/openshift-apiserver...
2026-06-03T09:07:31.810473341Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-03T09:07:32.119919805Z Gathering data for ns/openshift-controller-manager...
2026-06-03T09:07:32.468983121Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-03T09:07:33.213191760Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-03T09:07:33.559716946Z Gathering data for ns/openshift-service-ca-operator...
2026-06-03T09:07:33.896388424Z Gathering data for ns/openshift-service-ca...
2026-06-03T09:07:34.097052287Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-06-03T09:07:34.398223122Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-03T09:07:35.438134068Z Wrote inspect data to must-gather.
2026-06-03T09:07:35.438181108Z error: inspection completed with the errors occurred while gathering data:
2026-06-03T09:07:35.438181108Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-03T09:07:35.576080560Z error: the server doesn't have a resource type "clusters"
2026-06-03T09:07:36.026967241Z Caches written to disk