2026-04-22T20:08:11.636613678Z [disk usage checker] Started
2026-04-22T20:08:11.639807894Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-22T20:08:11.845989102Z Gathering data for ns/openshift-cluster-version...
2026-04-22T20:08:11.998242422Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-22T20:08:12.085475823Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-22T20:08:12.170948809Z Gathering data for ns/default...
2026-04-22T20:08:12.473475578Z Gathering data for ns/openshift...
2026-04-22T20:08:12.903553148Z Gathering data for ns/kube-system...
2026-04-22T20:08:13.720440527Z Gathering data for ns/openshift-etcd...
2026-04-22T20:08:14.039444585Z Wrote inspect data to must-gather.
2026-04-22T20:08:14.039471196Z error: inspection completed with the errors occurred while gathering data:
2026-04-22T20:08:14.039471196Z     namespaces "assisted-installer" not found
2026-04-22T20:08:14.063489259Z Waiting on subprocesses to finish execution.
2026-04-22T20:08:14.073414365Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-22T20:08:14.073521441Z INFO: Gathering HAProxy config files
2026-04-22T20:08:14.089979280Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-22T20:08:14.093626895Z INFO: Collecting host service logs for crio
2026-04-22T20:08:14.093951197Z INFO: Collecting host service logs for kubelet
2026-04-22T20:08:14.094292569Z INFO: Collecting host service logs for rpm-ostreed
2026-04-22T20:08:14.094651921Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-22T20:08:14.094898658Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-22T20:08:14.095021255Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-22T20:08:14.095328563Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-22T20:08:14.095685588Z INFO: Collecting host service logs for NetworkManager
2026-04-22T20:08:14.096003953Z INFO: Collecting host service logs for openvswitch
2026-04-22T20:08:14.096342187Z INFO: Collecting host service logs for ovs-configuration
2026-04-22T20:08:14.096698465Z INFO: Collecting host service logs for ovsdb-server
2026-04-22T20:08:14.097040710Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-22T20:08:14.097465737Z INFO: Waiting for worker host service log collection to complete ...
2026-04-22T20:08:14.584485826Z INFO: Waiting for node performance related collection to complete ...
2026-04-22T20:08:14.753616756Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-22T20:08:14.938275637Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-22T20:08:15.016873000Z No resources found in openshift-etcd namespace.
2026-04-22T20:08:15.035291926Z error: the server doesn't have a resource type "performanceprofile"
2026-04-22T20:08:15.036698837Z INFO: Collecting Insights Archives from insights-operator-585dfdc468-dxw7s
2026-04-22T20:08:15.036736443Z insights-runtime-extractor-btj9l
2026-04-22T20:08:15.036756259Z insights-runtime-extractor-hv22f
2026-04-22T20:08:15.036776066Z insights-runtime-extractor-ndm6t
2026-04-22T20:08:15.120505638Z ERROR: No running kube-apiserver pods found
2026-04-22T20:08:15.171689664Z INFO: "metallb-operator" not detected. Skipping.
2026-04-22T20:08:15.218070501Z INFO: Worker host service log collection to complete.
2026-04-22T20:08:15.295183516Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-22T20:08:15.295329949Z INFO: on-disk MachineConfig config collection complete.
2026-04-22T20:08:15.321548327Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-22T20:08:15.349426543Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-22T20:08:15.489345490Z No resources found
2026-04-22T20:08:15.545416112Z Wrote inspect data to must-gather.
2026-04-22T20:08:15.639019260Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-22T20:08:15.639019260Z See 'oc rsync -h' for help and examples
2026-04-22T20:08:15.720123764Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-22T20:08:15.966163391Z INFO: 'previous-logs' folder not found on ip-10-0-129-142.ec2.internal, skipping...
2026-04-22T20:08:15.991291546Z Wrote inspect data to must-gather.
2026-04-22T20:08:16.029696979Z Wrote inspect data to must-gather.
2026-04-22T20:08:16.051972119Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-22T20:08:16.072957513Z No resources found
2026-04-22T20:08:16.082093323Z Wrote inspect data to must-gather.
2026-04-22T20:08:16.192585102Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-22T20:08:16.193954156Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-22T20:08:16.196091458Z Wrote inspect data to must-gather.
2026-04-22T20:08:16.290827199Z Wrote inspect data to must-gather.
2026-04-22T20:08:16.294955281Z Wrote inspect data to must-gather.
2026-04-22T20:08:16.332870502Z Gathering data for ns/openshift-monitoring...
2026-04-22T20:08:16.338040065Z tar: Removing leading `/' from member names
2026-04-22T20:08:16.343760223Z INFO: HAProxy config collection complete.
2026-04-22T20:08:16.384299037Z error: the server doesn't have a resource type "machineconfigs"
2026-04-22T20:08:16.485317270Z INFO: 'previous-logs' folder not found on ip-10-0-132-204.ec2.internal, skipping...
2026-04-22T20:08:16.571687526Z Wrote inspect data to must-gather.
2026-04-22T20:08:16.610363920Z Wrote inspect data to must-gather.
2026-04-22T20:08:16.652684384Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-22T20:08:16.689641192Z INFO: Getting rules from prometheus-k8s-0
2026-04-22T20:08:16.800435455Z INFO: 'previous-logs' folder not found on ip-10-0-133-29.ec2.internal, skipping...
2026-04-22T20:08:16.800551334Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-22T20:08:16.800609568Z INFO: Machine Config Daemon termination log collection complete.
2026-04-22T20:08:16.867658361Z Wrote inspect data to must-gather.
2026-04-22T20:08:16.877247051Z Wrote inspect data to must-gather.
2026-04-22T20:08:17.038728135Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-22T20:08:17.113522415Z INFO: Getting status/config from prometheus-k8s-0
2026-04-22T20:08:17.124364103Z Wrote inspect data to must-gather.
2026-04-22T20:08:17.252254556Z Wrote inspect data to must-gather.
2026-04-22T20:08:17.401617801Z INFO: INTERCONNECT MODE
2026-04-22T20:08:17.401648464Z INFO: Gathering ovn-kubernetes DBs
2026-04-22T20:08:17.460699797Z Wrote inspect data to must-gather.
2026-04-22T20:08:17.512100653Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-22T20:08:17.629488437Z INFO: Gathering OVN_Northbound from ovnkube-node-pr85c...
2026-04-22T20:08:17.629752711Z INFO: Gathering OVN_Northbound from ovnkube-node-r65js...
2026-04-22T20:08:17.629987826Z INFO: Gathering OVN_Northbound from ovnkube-node-zbqgd...
2026-04-22T20:08:17.630303413Z INFO: Gathering OVN_Southbound from ovnkube-node-pr85c...
2026-04-22T20:08:17.630542403Z INFO: Gathering OVN_Southbound from ovnkube-node-r65js...
2026-04-22T20:08:17.630854954Z INFO: Gathering OVN_Southbound from ovnkube-node-zbqgd...
2026-04-22T20:08:17.685794094Z Wrote inspect data to must-gather.
2026-04-22T20:08:17.778191046Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-22T20:08:17.916645966Z tar: Removing leading `/' from member names
2026-04-22T20:08:17.921914619Z tar: Removing leading `/' from member names
2026-04-22T20:08:17.927873708Z tar: Removing leading `/' from member names
2026-04-22T20:08:17.939395390Z tar: Removing leading `/' from member names
2026-04-22T20:08:17.940789683Z tar: Removing leading `/' from member names
2026-04-22T20:08:17.949680793Z tar: Removing leading `/' from member names
2026-04-22T20:08:18.032570153Z Wrote inspect data to must-gather.
2026-04-22T20:08:18.103813909Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-22T20:08:18.134140123Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-22T20:08:18.285662596Z Wrote inspect data to must-gather.
2026-04-22T20:08:18.374472780Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-22T20:08:18.426782338Z INFO: Waiting for network log collection to complete ...
2026-04-22T20:08:18.426818432Z INFO: Waiting for ovnk database copies to complete ...
2026-04-22T20:08:18.427270660Z INFO: Copying ovnk databases complete.
2026-04-22T20:08:18.429048042Z 3.2M	must-gather/network_logs/ovnk_database_store
2026-04-22T20:08:18.431179450Z ovnk_database_store/
2026-04-22T20:08:18.431179450Z ovnk_database_store/ovnkube-node-pr85c_sbdb
2026-04-22T20:08:18.451263652Z ovnk_database_store/ovnkube-node-pr85c_nbdb
2026-04-22T20:08:18.461777837Z ovnk_database_store/ovnkube-node-zbqgd_sbdb
2026-04-22T20:08:18.483813095Z ovnk_database_store/ovnkube-node-r65js_nbdb
2026-04-22T20:08:18.493860913Z ovnk_database_store/ovnkube-node-zbqgd_nbdb
2026-04-22T20:08:18.500823550Z ovnk_database_store/ovnkube-node-r65js_sbdb
2026-04-22T20:08:18.517432013Z Wrote inspect data to must-gather.
2026-04-22T20:08:18.520163883Z INFO: Network log collection complete.
2026-04-22T20:08:18.720987787Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-22T20:08:18.774482485Z INFO: Getting status from alertmanager-main-0
2026-04-22T20:08:18.800897795Z Wrote inspect data to must-gather.
2026-04-22T20:08:18.912817025Z Gathering data for ns/openshift-network-console...
2026-04-22T20:08:19.074456420Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-22T20:08:19.076799723Z INFO: Fallback to identify the container image from release info
2026-04-22T20:08:19.333407187Z Gathering data for ns/openshift-console-operator...
2026-04-22T20:08:19.701501488Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f2123db9953f98da0e43c266e6a8a070bf221533b995f87b7e358cc7498ca6d
2026-04-22T20:08:19.709534814Z Gathering data for ns/openshift-console...
2026-04-22T20:08:19.823218798Z daemonset.apps/perf-node-gather-daemonset created
2026-04-22T20:08:19.942334798Z Waiting for performance profile collector pods to become ready: 1
2026-04-22T20:08:20.169968366Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-22T20:08:20.547865869Z Gathering data for ns/openshift-dns-operator...
2026-04-22T20:08:20.831293827Z Gathering data for ns/openshift-dns...
2026-04-22T20:08:21.048053399Z Waiting for performance profile collector pods to become ready: 2
2026-04-22T20:08:21.431934432Z Gathering data for ns/openshift-image-registry...
2026-04-22T20:08:21.657687543Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-22T20:08:21.915020204Z Gathering data for ns/openshift-ingress-operator...
2026-04-22T20:08:22.182806106Z Waiting for performance profile collector pods to become ready: 3
2026-04-22T20:08:22.262039346Z Gathering data for ns/openshift-ingress...
2026-04-22T20:08:22.602075581Z Gathering data for ns/openshift-ingress-canary...
2026-04-22T20:08:23.022360012Z Gathering data for ns/openshift-insights...
2026-04-22T20:08:23.297939223Z Waiting for performance profile collector pods to become ready: 4
2026-04-22T20:08:24.415939325Z Waiting for performance profile collector pods to become ready: 5
2026-04-22T20:08:25.145217130Z Gathering data for ns/kserve...
2026-04-22T20:08:25.528340152Z Waiting for performance profile collector pods to become ready: 6
2026-04-22T20:08:26.509646400Z Gathering data for ns/openshift-config...
2026-04-22T20:08:26.659415780Z Waiting for performance profile collector pods to become ready: 7
2026-04-22T20:08:26.662435013Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-22T20:08:26.796046832Z Gathering data for ns/openshift-config-managed...
2026-04-22T20:08:27.254039738Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-22T20:08:27.519793346Z Gathering data for ns/openshift-kube-apiserver...
2026-04-22T20:08:27.799695922Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-22T20:08:27.802751166Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-22T20:08:28.081814671Z Collecting performance related data for node ip-10-0-129-142.ec2.internal
2026-04-22T20:08:28.088986742Z Collecting performance related data for node ip-10-0-132-204.ec2.internal
2026-04-22T20:08:28.101567931Z Collecting performance related data for node ip-10-0-133-29.ec2.internal
2026-04-22T20:08:28.142281332Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-22T20:08:28.532465070Z Gathering data for ns/openshift-kube-scheduler...
2026-04-22T20:08:28.873714042Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-22T20:08:29.271083828Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-22T20:08:29.714902578Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-22T20:08:30.049050921Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-22T20:08:30.665994089Z Gathering data for ns/openshift-multus...
2026-04-22T20:08:31.667080708Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-22T20:08:32.442978756Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-22T20:08:34.101831575Z Gathering data for ns/openshift-host-network...
2026-04-22T20:08:34.418618037Z Gathering data for ns/openshift-network-diagnostics...
2026-04-22T20:08:34.939100310Z Gathering data for ns/openshift-network-node-identity...
2026-04-22T20:08:35.392497871Z Gathering data for ns/openshift-network-operator...
2026-04-22T20:08:35.792245152Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-22T20:08:36.089625646Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-22T20:08:36.246077068Z Collecting kubelet logs for node ip-10-0-129-142.ec2.internal
2026-04-22T20:08:36.247964693Z Collecting kubelet logs for node ip-10-0-132-204.ec2.internal
2026-04-22T20:08:36.249556635Z Collecting kubelet logs for node ip-10-0-133-29.ec2.internal
2026-04-22T20:08:36.602537988Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-22T20:08:36.603311350Z Gathering data for ns/openshift-apiserver-operator...
2026-04-22T20:08:36.607933108Z INFO: Node performance data collection complete.
2026-04-22T20:08:36.673163583Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-04-22T20:08:36.979793721Z Gathering data for ns/openshift-apiserver...
2026-04-22T20:08:37.381444442Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-22T20:08:37.688518391Z Gathering data for ns/openshift-controller-manager...
2026-04-22T20:08:38.015179971Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-22T20:08:38.673337383Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-22T20:08:39.012715903Z Gathering data for ns/openshift-service-ca-operator...
2026-04-22T20:08:39.361729047Z Gathering data for ns/openshift-service-ca...
2026-04-22T20:08:39.742946276Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-22T20:08:40.621592361Z Wrote inspect data to must-gather.
2026-04-22T20:08:40.621636680Z error: inspection completed with the errors occurred while gathering data:
2026-04-22T20:08:40.621636680Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-22T20:08:40.746019737Z error: the server doesn't have a resource type "clusters"
2026-04-22T20:08:40.982168326Z Caches written to disk