2026-05-29T18:25:56.023708819Z [disk usage checker] Started
2026-05-29T18:25:56.027470400Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-29T18:25:56.220429378Z Gathering data for ns/openshift-cluster-version...
2026-05-29T18:25:56.349275596Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-29T18:25:56.446981857Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-29T18:25:56.524672176Z Gathering data for ns/default...
2026-05-29T18:25:56.823480952Z Gathering data for ns/openshift...
2026-05-29T18:25:57.280195554Z Gathering data for ns/kube-system...
2026-05-29T18:25:57.993433060Z Gathering data for ns/openshift-etcd...
2026-05-29T18:25:58.201755065Z Waiting on subprocesses to finish execution.
2026-05-29T18:25:58.205484067Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-05-29T18:25:58.206893649Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-05-29T18:25:58.208300693Z INFO: Gathering HAProxy config files
2026-05-29T18:25:58.212507738Z INFO: Collecting host service logs for crio
2026-05-29T18:25:58.212802858Z INFO: Collecting host service logs for kubelet
2026-05-29T18:25:58.213153264Z INFO: Collecting host service logs for rpm-ostreed
2026-05-29T18:25:58.213507548Z INFO: Collecting host service logs for ostree-finalize-staged
2026-05-29T18:25:58.213838806Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-05-29T18:25:58.214174309Z INFO: Collecting host service logs for machine-config-daemon-host
2026-05-29T18:25:58.214626598Z INFO: Collecting host service logs for NetworkManager
2026-05-29T18:25:58.215031873Z INFO: Collecting host service logs for openvswitch
2026-05-29T18:25:58.215355891Z INFO: Collecting host service logs for ovs-configuration
2026-05-29T18:25:58.215703558Z INFO: Collecting host service logs for ovsdb-server
2026-05-29T18:25:58.216038547Z INFO: Collecting host service logs for ovs-vswitchd
2026-05-29T18:25:58.216425936Z INFO: Waiting for worker host service log collection to complete ...
2026-05-29T18:25:58.248044761Z INFO: Gathering machine config daemon's old logs from all nodes
2026-05-29T18:25:58.544364581Z Wrote inspect data to must-gather.
2026-05-29T18:25:58.544485223Z error: inspection completed with the errors occurred while gathering data:
2026-05-29T18:25:58.544485223Z     namespaces "assisted-installer" not found
2026-05-29T18:25:58.731621509Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-79dvn
2026-05-29T18:25:58.731621509Z insights-runtime-extractor-gwrqz
2026-05-29T18:25:58.731621509Z insights-runtime-extractor-khp6q
2026-05-29T18:25:58.731621509Z insights-runtime-extractor-wtbzs
2026-05-29T18:25:58.771599940Z INFO: Waiting for node performance related collection to complete ...
2026-05-29T18:25:58.809795848Z INFO: "sriov-network-operator" not detected. Skipping.
2026-05-29T18:25:58.941437877Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-05-29T18:25:58.941491260Z INFO: on-disk MachineConfig config collection complete.
2026-05-29T18:25:58.993698006Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-05-29T18:25:59.147023706Z No resources found
2026-05-29T18:25:59.223601715Z INFO: Found 1 replicas - prometheus-k8s-0
2026-05-29T18:25:59.297651602Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-05-29T18:25:59.325088107Z No resources found in openshift-etcd namespace.
2026-05-29T18:25:59.357313254Z error: the server doesn't have a resource type "performanceprofile"
2026-05-29T18:25:59.403541182Z Wrote inspect data to must-gather.
2026-05-29T18:25:59.457937697Z INFO: "metallb-operator" not detected. Skipping.
2026-05-29T18:25:59.504809871Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-05-29T18:25:59.504809871Z See 'oc rsync -h' for help and examples
2026-05-29T18:25:59.521931020Z INFO: Worker host service log collection to complete.
2026-05-29T18:25:59.755558135Z Wrote inspect data to must-gather.
2026-05-29T18:25:59.755592071Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-05-29T18:25:59.823140419Z INFO: Waiting for HAProxy config collection to complete ...
2026-05-29T18:25:59.970014798Z No resources found
2026-05-29T18:25:59.991780268Z Wrote inspect data to must-gather.
2026-05-29T18:26:00.062743034Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-29T18:26:00.072178017Z ERROR: No running kube-apiserver pods found
2026-05-29T18:26:00.161117800Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-05-29T18:26:00.292982624Z Wrote inspect data to must-gather.
2026-05-29T18:26:00.316147549Z Wrote inspect data to must-gather.
2026-05-29T18:26:00.351066220Z tar: Removing leading `/' from member names
2026-05-29T18:26:00.357797089Z INFO: HAProxy config collection complete.
2026-05-29T18:26:00.357968797Z Wrote inspect data to must-gather.
2026-05-29T18:26:00.366318083Z error: the server doesn't have a resource type "machineconfigs"
2026-05-29T18:26:00.370339877Z Wrote inspect data to must-gather.
2026-05-29T18:26:00.418927034Z INFO: 'previous-logs' folder not found on ip-10-0-128-122.ec2.internal, skipping...
2026-05-29T18:26:00.527116535Z Gathering data for ns/openshift-monitoring...
2026-05-29T18:26:00.534765972Z INFO: Getting rules from prometheus-k8s-0
2026-05-29T18:26:00.599899083Z Wrote inspect data to must-gather.
2026-05-29T18:26:00.626566848Z Wrote inspect data to must-gather.
2026-05-29T18:26:00.682861837Z INFO: 'previous-logs' folder not found on ip-10-0-133-167.ec2.internal, skipping...
2026-05-29T18:26:00.807963475Z Wrote inspect data to must-gather.
2026-05-29T18:26:00.887372701Z Wrote inspect data to must-gather.
2026-05-29T18:26:00.930224549Z INFO: 'previous-logs' folder not found on ip-10-0-143-128.ec2.internal, skipping...
2026-05-29T18:26:00.930331849Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-05-29T18:26:00.930380320Z INFO: Machine Config Daemon termination log collection complete.
2026-05-29T18:26:00.949254535Z INFO: Getting status/config from prometheus-k8s-0
2026-05-29T18:26:00.969955178Z error: the server doesn't have a resource type "kubeletconfigs"
2026-05-29T18:26:01.034775305Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-29T18:26:01.119526636Z Wrote inspect data to must-gather.
2026-05-29T18:26:01.157632194Z Wrote inspect data to must-gather.
2026-05-29T18:26:01.330406734Z INFO: Getting status/flags from prometheus-k8s-0
2026-05-29T18:26:01.343898072Z Wrote inspect data to must-gather.
2026-05-29T18:26:01.382184362Z INFO: INTERCONNECT MODE
2026-05-29T18:26:01.382221290Z INFO: Gathering ovn-kubernetes DBs
2026-05-29T18:26:01.524125987Z INFO: Gathering OVN_Northbound from ovnkube-node-cxqf9...
2026-05-29T18:26:01.524329958Z INFO: Gathering OVN_Northbound from ovnkube-node-m2tkf...
2026-05-29T18:26:01.524558265Z INFO: Gathering OVN_Northbound from ovnkube-node-vcq7l...
2026-05-29T18:26:01.524830281Z INFO: Gathering OVN_Southbound from ovnkube-node-cxqf9...
2026-05-29T18:26:01.525088827Z INFO: Gathering OVN_Southbound from ovnkube-node-m2tkf...
2026-05-29T18:26:01.525325297Z INFO: Gathering OVN_Southbound from ovnkube-node-vcq7l...
2026-05-29T18:26:01.529551679Z Wrote inspect data to must-gather.
2026-05-29T18:26:01.556395965Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-05-29T18:26:01.773776449Z tar: Removing leading `/' from member names
2026-05-29T18:26:01.786092411Z tar: Removing leading `/' from member names
2026-05-29T18:26:01.796267096Z tar: Removing leading `/' from member names
2026-05-29T18:26:01.815891609Z tar: Removing leading `/' from member names
2026-05-29T18:26:01.822857955Z tar: Removing leading `/' from member names
2026-05-29T18:26:01.822883644Z tar: Removing leading `/' from member names
2026-05-29T18:26:01.858398849Z Wrote inspect data to must-gather.
2026-05-29T18:26:01.900387456Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-05-29T18:26:02.093689203Z Wrote inspect data to must-gather.
2026-05-29T18:26:02.115591976Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-05-29T18:26:02.174091198Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-05-29T18:26:02.286726616Z Wrote inspect data to must-gather.
2026-05-29T18:26:02.314033477Z INFO: Waiting for network log collection to complete ...
2026-05-29T18:26:02.314083160Z INFO: Waiting for ovnk database copies to complete ...
2026-05-29T18:26:02.314589659Z INFO: Copying ovnk databases complete.
2026-05-29T18:26:02.316124943Z 3.7M	must-gather/network_logs/ovnk_database_store
2026-05-29T18:26:02.318223131Z ovnk_database_store/
2026-05-29T18:26:02.318223131Z ovnk_database_store/ovnkube-node-vcq7l_sbdb
2026-05-29T18:26:02.344276736Z ovnk_database_store/ovnkube-node-cxqf9_nbdb
2026-05-29T18:26:02.353594246Z ovnk_database_store/ovnkube-node-m2tkf_sbdb
2026-05-29T18:26:02.372387681Z ovnk_database_store/ovnkube-node-m2tkf_nbdb
2026-05-29T18:26:02.382679683Z ovnk_database_store/ovnkube-node-cxqf9_sbdb
2026-05-29T18:26:02.404276245Z ovnk_database_store/ovnkube-node-vcq7l_nbdb
2026-05-29T18:26:02.415679035Z INFO: Network log collection complete.
2026-05-29T18:26:02.482566485Z Wrote inspect data to must-gather.
2026-05-29T18:26:02.540808461Z INFO: Getting status from alertmanager-main-0
2026-05-29T18:26:02.697842977Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-05-29T18:26:02.739147806Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-05-29T18:26:02.743030296Z INFO: Fallback to identify the container image from release info
2026-05-29T18:26:02.848432940Z Gathering data for ns/openshift-network-console...
2026-05-29T18:26:03.217876452Z Gathering data for ns/openshift-console-operator...
2026-05-29T18:26:03.398339333Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-05-29T18:26:03.511619153Z daemonset.apps/perf-node-gather-daemonset created
2026-05-29T18:26:03.601186836Z Gathering data for ns/openshift-console...
2026-05-29T18:26:03.630373210Z Waiting for performance profile collector pods to become ready: 1
2026-05-29T18:26:04.050333387Z Gathering data for ns/openshift-cluster-storage-operator...
2026-05-29T18:26:04.406570673Z Gathering data for ns/openshift-dns-operator...
2026-05-29T18:26:04.669992392Z Gathering data for ns/openshift-dns...
2026-05-29T18:26:04.739358819Z Waiting for performance profile collector pods to become ready: 2
2026-05-29T18:26:05.248058966Z Gathering data for ns/openshift-image-registry...
2026-05-29T18:26:05.675551165Z Gathering data for ns/openshift-ingress-operator...
2026-05-29T18:26:05.841644353Z Waiting for performance profile collector pods to become ready: 3
2026-05-29T18:26:06.024283152Z Gathering data for ns/openshift-ingress...
2026-05-29T18:26:06.039734031Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-29T18:26:06.350076281Z Gathering data for ns/openshift-ingress-canary...
2026-05-29T18:26:06.726431360Z Gathering data for ns/openshift-insights...
2026-05-29T18:26:06.947989317Z Waiting for performance profile collector pods to become ready: 4
2026-05-29T18:26:08.049381769Z Waiting for performance profile collector pods to become ready: 5
2026-05-29T18:26:08.670021867Z Gathering data for ns/openshift-config...
2026-05-29T18:26:08.922325210Z Gathering data for ns/openshift-config-managed...
2026-05-29T18:26:09.162895581Z Waiting for performance profile collector pods to become ready: 6
2026-05-29T18:26:09.341098002Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-05-29T18:26:09.606569906Z Gathering data for ns/openshift-kube-apiserver...
2026-05-29T18:26:09.874617732Z Gathering data for ns/openshift-kube-controller-manager...
2026-05-29T18:26:10.154221699Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-05-29T18:26:10.278337881Z Waiting for performance profile collector pods to become ready: 7
2026-05-29T18:26:10.451268877Z Gathering data for ns/openshift-kube-scheduler...
2026-05-29T18:26:10.731116700Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-05-29T18:26:11.018856219Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-05-29T18:26:11.044088507Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-29T18:26:11.333803827Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-05-29T18:26:11.394423290Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-05-29T18:26:11.633294501Z Collecting performance related data for node ip-10-0-133-167.ec2.internal
2026-05-29T18:26:11.642573315Z Collecting performance related data for node ip-10-0-143-128.ec2.internal
2026-05-29T18:26:11.653936647Z Collecting performance related data for node ip-10-0-128-122.ec2.internal
2026-05-29T18:26:11.694196106Z Gathering data for ns/openshift-user-workload-monitoring...
2026-05-29T18:26:12.297127390Z Gathering data for ns/openshift-multus...
2026-05-29T18:26:13.779876732Z Gathering data for ns/openshift-ovn-kubernetes...
2026-05-29T18:26:15.191990833Z Gathering data for ns/openshift-host-network...
2026-05-29T18:26:15.490890355Z Gathering data for ns/openshift-network-diagnostics...
2026-05-29T18:26:15.996750900Z Gathering data for ns/openshift-network-node-identity...
2026-05-29T18:26:16.050185130Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-29T18:26:16.392017410Z Gathering data for ns/openshift-network-operator...
2026-05-29T18:26:16.760081605Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-05-29T18:26:17.019195853Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-05-29T18:26:17.464796119Z Gathering data for ns/openshift-apiserver-operator...
2026-05-29T18:26:17.752085123Z Gathering data for ns/openshift-apiserver...
2026-05-29T18:26:18.133986283Z Gathering data for ns/openshift-controller-manager-operator...
2026-05-29T18:26:18.397112070Z Gathering data for ns/openshift-controller-manager...
2026-05-29T18:26:18.721466282Z Gathering data for ns/openshift-cluster-samples-operator...
2026-05-29T18:26:19.190987660Z Collecting kubelet logs for node ip-10-0-133-167.ec2.internal
2026-05-29T18:26:19.193056369Z Collecting kubelet logs for node ip-10-0-143-128.ec2.internal
2026-05-29T18:26:19.194776677Z Collecting kubelet logs for node ip-10-0-128-122.ec2.internal
2026-05-29T18:26:19.413078414Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-05-29T18:26:19.529843587Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-05-29T18:26:19.535072519Z INFO: Node performance data collection complete.
2026-05-29T18:26:19.706376874Z Gathering data for ns/openshift-service-ca-operator...
2026-05-29T18:26:20.007209501Z Gathering data for ns/openshift-service-ca...
2026-05-29T18:26:20.352722756Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-05-29T18:26:21.055032879Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-05-29T18:26:21.180523514Z Wrote inspect data to must-gather.
2026-05-29T18:26:21.180563092Z error: inspection completed with the errors occurred while gathering data:
2026-05-29T18:26:21.180563092Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-05-29T18:26:21.305488972Z error: the server doesn't have a resource type "clusters"
2026-05-29T18:26:21.435368765Z Caches written to disk