2026-06-03T16:12:14.718211594Z [disk usage checker] Started
2026-06-03T16:12:14.721842341Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-03T16:12:14.907995454Z Gathering data for ns/openshift-cluster-version...
2026-06-03T16:12:15.045446572Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-03T16:12:15.121226415Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T16:12:15.196419805Z Gathering data for ns/default...
2026-06-03T16:12:15.509634626Z Gathering data for ns/openshift...
2026-06-03T16:12:15.916106677Z Gathering data for ns/kube-system...
2026-06-03T16:12:16.575828421Z Gathering data for ns/openshift-etcd...
2026-06-03T16:12:16.886000832Z Wrote inspect data to must-gather.
2026-06-03T16:12:16.886042360Z error: inspection completed with the errors occurred while gathering data:
2026-06-03T16:12:16.886042360Z     namespaces "assisted-installer" not found
2026-06-03T16:12:16.949934307Z Waiting on subprocesses to finish execution.
2026-06-03T16:12:16.959339895Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-03T16:12:16.959984398Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-03T16:12:16.970029362Z INFO: Gathering HAProxy config files
2026-06-03T16:12:16.972814433Z INFO: Collecting host service logs for crio
2026-06-03T16:12:16.973090512Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-03T16:12:16.973194065Z INFO: Collecting host service logs for kubelet
2026-06-03T16:12:16.973528033Z INFO: Collecting host service logs for rpm-ostreed
2026-06-03T16:12:16.973850595Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-03T16:12:16.974198155Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-03T16:12:16.974541505Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-03T16:12:16.975198673Z INFO: Collecting host service logs for NetworkManager
2026-06-03T16:12:16.975572209Z INFO: Collecting host service logs for openvswitch
2026-06-03T16:12:16.975932199Z INFO: Collecting host service logs for ovs-configuration
2026-06-03T16:12:16.976306905Z INFO: Collecting host service logs for ovsdb-server
2026-06-03T16:12:16.982825049Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-03T16:12:16.983771760Z INFO: Waiting for node performance related collection to complete ...
2026-06-03T16:12:16.984555140Z INFO: Waiting for worker host service log collection to complete ...
2026-06-03T16:12:17.443735540Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-fjjpr
2026-06-03T16:12:17.443955713Z insights-runtime-extractor-8kq4p
2026-06-03T16:12:17.443978828Z insights-runtime-extractor-kfhg4
2026-06-03T16:12:17.443999253Z insights-runtime-extractor-t8qks
2026-06-03T16:12:17.509023230Z No resources found
2026-06-03T16:12:17.546310992Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-03T16:12:17.546412137Z INFO: on-disk MachineConfig config collection complete.
2026-06-03T16:12:17.701379261Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-03T16:12:17.911465736Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-03T16:12:18.047584911Z INFO: "metallb-operator" not detected. Skipping.
2026-06-03T16:12:18.051551893Z error: the server doesn't have a resource type "performanceprofile"
2026-06-03T16:12:18.065884771Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-03T16:12:18.075147638Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-03T16:12:18.075147638Z See 'oc rsync -h' for help and examples
2026-06-03T16:12:18.210789888Z INFO: Worker host service log collection to complete.
2026-06-03T16:12:18.226883116Z No resources found in openshift-etcd namespace.
2026-06-03T16:12:18.249161012Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-03T16:12:18.264896237Z Wrote inspect data to must-gather.
2026-06-03T16:12:18.510471941Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-03T16:12:18.602000274Z Wrote inspect data to must-gather.
2026-06-03T16:12:18.602340922Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T16:12:18.690894632Z No resources found
2026-06-03T16:12:18.701623288Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-03T16:12:18.725901715Z ERROR: No running kube-apiserver pods found
2026-06-03T16:12:18.845585503Z Gathering data for ns/openshift-monitoring...
2026-06-03T16:12:18.851404292Z INFO: 'previous-logs' folder not found on ip-10-0-128-61.ec2.internal, skipping...
2026-06-03T16:12:19.067498900Z tar: Removing leading `/' from member names
2026-06-03T16:12:19.074242481Z INFO: HAProxy config collection complete.
2026-06-03T16:12:19.096125142Z Wrote inspect data to must-gather.
2026-06-03T16:12:19.138783920Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-03T16:12:19.140909923Z Wrote inspect data to must-gather.
2026-06-03T16:12:19.161159354Z Wrote inspect data to must-gather.
2026-06-03T16:12:19.162507737Z Wrote inspect data to must-gather.
2026-06-03T16:12:19.211487066Z Wrote inspect data to must-gather.
2026-06-03T16:12:19.279332536Z INFO: 'previous-logs' folder not found on ip-10-0-134-47.ec2.internal, skipping...
2026-06-03T16:12:19.314462277Z error: the server doesn't have a resource type "machineconfigs"
2026-06-03T16:12:19.350197866Z INFO: Getting rules from prometheus-k8s-0
2026-06-03T16:12:19.490066711Z Wrote inspect data to must-gather.
2026-06-03T16:12:19.522112516Z Wrote inspect data to must-gather.
2026-06-03T16:12:19.536606100Z INFO: 'previous-logs' folder not found on ip-10-0-138-89.ec2.internal, skipping...
2026-06-03T16:12:19.536649461Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-03T16:12:19.536679305Z INFO: Machine Config Daemon termination log collection complete.
2026-06-03T16:12:19.715722955Z Wrote inspect data to must-gather.
2026-06-03T16:12:19.722557936Z Wrote inspect data to must-gather.
2026-06-03T16:12:19.727598951Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-03T16:12:19.741812767Z INFO: Getting status/config from prometheus-k8s-0
2026-06-03T16:12:19.865695595Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-03T16:12:19.937933072Z Wrote inspect data to must-gather.
2026-06-03T16:12:20.068917545Z Wrote inspect data to must-gather.
2026-06-03T16:12:20.115759750Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-03T16:12:20.218889477Z INFO: INTERCONNECT MODE
2026-06-03T16:12:20.218981918Z INFO: Gathering ovn-kubernetes DBs
2026-06-03T16:12:20.285721276Z Wrote inspect data to must-gather.
2026-06-03T16:12:20.342559486Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-03T16:12:20.345994071Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-03T16:12:20.372112456Z INFO: Gathering OVN_Northbound from ovnkube-node-bjv7n...
2026-06-03T16:12:20.372343429Z INFO: Gathering OVN_Northbound from ovnkube-node-cw9l9...
2026-06-03T16:12:20.372554852Z INFO: Gathering OVN_Northbound from ovnkube-node-vfbq8...
2026-06-03T16:12:20.372844626Z INFO: Gathering OVN_Southbound from ovnkube-node-bjv7n...
2026-06-03T16:12:20.373165979Z INFO: Gathering OVN_Southbound from ovnkube-node-cw9l9...
2026-06-03T16:12:20.373701468Z INFO: Gathering OVN_Southbound from ovnkube-node-vfbq8...
2026-06-03T16:12:20.607581863Z Wrote inspect data to must-gather.
2026-06-03T16:12:20.663844835Z tar: Removing leading `/' from member names
2026-06-03T16:12:20.669926346Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-03T16:12:20.675724927Z tar: Removing leading `/' from member names
2026-06-03T16:12:20.695978875Z tar: Removing leading `/' from member names
2026-06-03T16:12:20.712483738Z tar: Removing leading `/' from member names
2026-06-03T16:12:20.719819935Z tar: Removing leading `/' from member names
2026-06-03T16:12:20.742188760Z tar: Removing leading `/' from member names
2026-06-03T16:12:20.859638917Z Wrote inspect data to must-gather.
2026-06-03T16:12:20.923358614Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-03T16:12:21.069957977Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-03T16:12:21.174842654Z Wrote inspect data to must-gather.
2026-06-03T16:12:21.178718673Z INFO: Waiting for network log collection to complete ...
2026-06-03T16:12:21.178827839Z INFO: Waiting for ovnk database copies to complete ...
2026-06-03T16:12:21.179122344Z INFO: Copying ovnk databases complete.
2026-06-03T16:12:21.180824439Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-06-03T16:12:21.183377185Z ovnk_database_store/
2026-06-03T16:12:21.183377185Z ovnk_database_store/ovnkube-node-cw9l9_nbdb
2026-06-03T16:12:21.191396924Z ovnk_database_store/ovnkube-node-bjv7n_sbdb
2026-06-03T16:12:21.209415246Z ovnk_database_store/ovnkube-node-vfbq8_nbdb
2026-06-03T16:12:21.218144622Z ovnk_database_store/ovnkube-node-vfbq8_sbdb
2026-06-03T16:12:21.238129090Z ovnk_database_store/ovnkube-node-bjv7n_nbdb
2026-06-03T16:12:21.245026174Z ovnk_database_store/ovnkube-node-cw9l9_sbdb
2026-06-03T16:12:21.246154993Z Gathering data for ns/openshift-network-console...
2026-06-03T16:12:21.262655821Z INFO: Network log collection complete.
2026-06-03T16:12:21.369586640Z INFO: Getting status from alertmanager-main-0
2026-06-03T16:12:21.469078290Z Wrote inspect data to must-gather.
2026-06-03T16:12:21.649740521Z Gathering data for ns/openshift-console-operator...
2026-06-03T16:12:21.756516563Z Wrote inspect data to must-gather.
2026-06-03T16:12:21.997597282Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-03T16:12:22.000032302Z INFO: Fallback to identify the container image from release info
2026-06-03T16:12:22.002661783Z Gathering data for ns/openshift-console...
2026-06-03T16:12:22.383900996Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-03T16:12:22.712127887Z Gathering data for ns/openshift-dns-operator...
2026-06-03T16:12:22.719008796Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-03T16:12:22.835581056Z daemonset.apps/perf-node-gather-daemonset created
2026-06-03T16:12:22.961596520Z Waiting for performance profile collector pods to become ready: 1
2026-06-03T16:12:23.006186146Z Gathering data for ns/openshift-dns...
2026-06-03T16:12:23.591773073Z Gathering data for ns/openshift-image-registry...
2026-06-03T16:12:24.027938840Z Gathering data for ns/openshift-ingress-operator...
2026-06-03T16:12:24.085489111Z Waiting for performance profile collector pods to become ready: 2
2026-06-03T16:12:24.336157816Z Gathering data for ns/openshift-ingress...
2026-06-03T16:12:24.631502289Z Gathering data for ns/openshift-ingress-canary...
2026-06-03T16:12:24.734111719Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-03T16:12:24.973577686Z Gathering data for ns/openshift-insights...
2026-06-03T16:12:25.191233703Z Waiting for performance profile collector pods to become ready: 3
2026-06-03T16:12:26.295923491Z Waiting for performance profile collector pods to become ready: 4
2026-06-03T16:12:26.713050624Z Gathering data for ns/openshift-jobset-operator...
2026-06-03T16:12:27.407219350Z Waiting for performance profile collector pods to become ready: 5
2026-06-03T16:12:27.466750332Z Gathering data for ns/openshift-config...
2026-06-03T16:12:27.694195475Z Gathering data for ns/openshift-config-managed...
2026-06-03T16:12:28.120053980Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-03T16:12:28.350691783Z Gathering data for ns/openshift-kube-apiserver...
2026-06-03T16:12:28.522749465Z Waiting for performance profile collector pods to become ready: 6
2026-06-03T16:12:28.583296607Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-03T16:12:28.841277768Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-03T16:12:29.098252335Z Gathering data for ns/openshift-kube-scheduler...
2026-06-03T16:12:29.314366457Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-03T16:12:29.573692026Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-03T16:12:29.648502947Z Waiting for performance profile collector pods to become ready: 7
2026-06-03T16:12:29.738821221Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-03T16:12:29.869614872Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-03T16:12:30.161862749Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-03T16:12:30.613176652Z Gathering data for ns/openshift-multus...
2026-06-03T16:12:30.750171930Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-03T16:12:30.977302272Z Collecting performance related data for node ip-10-0-138-89.ec2.internal
2026-06-03T16:12:30.983941197Z Collecting performance related data for node ip-10-0-128-61.ec2.internal
2026-06-03T16:12:30.990994619Z Collecting performance related data for node ip-10-0-134-47.ec2.internal
2026-06-03T16:12:32.229035224Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-03T16:12:33.858285302Z Gathering data for ns/openshift-host-network...
2026-06-03T16:12:34.150675285Z Gathering data for ns/openshift-network-diagnostics...
2026-06-03T16:12:34.624576322Z Gathering data for ns/openshift-network-node-identity...
2026-06-03T16:12:34.744549967Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-03T16:12:34.994588847Z Gathering data for ns/openshift-network-operator...
2026-06-03T16:12:35.345168014Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-03T16:12:35.592142577Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-03T16:12:36.044111674Z Gathering data for ns/openshift-apiserver-operator...
2026-06-03T16:12:36.332180786Z Gathering data for ns/openshift-apiserver...
2026-06-03T16:12:36.695725914Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-03T16:12:36.943725337Z Gathering data for ns/openshift-controller-manager...
2026-06-03T16:12:37.254258454Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-03T16:12:37.894619351Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-03T16:12:38.172208324Z Gathering data for ns/openshift-service-ca-operator...
2026-06-03T16:12:38.472739451Z Gathering data for ns/openshift-service-ca...
2026-06-03T16:12:38.827128639Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-03T16:12:39.136876431Z Collecting kubelet logs for node ip-10-0-138-89.ec2.internal
2026-06-03T16:12:39.138963931Z Collecting kubelet logs for node ip-10-0-128-61.ec2.internal
2026-06-03T16:12:39.141137768Z Collecting kubelet logs for node ip-10-0-134-47.ec2.internal
2026-06-03T16:12:39.500445473Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-03T16:12:39.505519210Z INFO: Node performance data collection complete.
2026-06-03T16:12:39.749439423Z [disk usage checker] Volume usage percentage: current = 16 ; allowed = 70
2026-06-03T16:12:39.816155884Z Wrote inspect data to must-gather.
2026-06-03T16:12:39.816201914Z error: inspection completed with the errors occurred while gathering data:
2026-06-03T16:12:39.816201914Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-03T16:12:39.944741069Z error: the server doesn't have a resource type "clusters"
2026-06-03T16:12:40.086810174Z Caches written to disk