2026-04-16T15:45:24.355771733Z [disk usage checker] Started
2026-04-16T15:45:24.387593259Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-16T15:45:24.556491075Z Gathering data for ns/openshift-cluster-version...
2026-04-16T15:45:24.696426667Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T15:45:24.776572791Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T15:45:24.855319546Z Gathering data for ns/default...
2026-04-16T15:45:25.133926638Z Gathering data for ns/openshift...
2026-04-16T15:45:25.549980778Z Gathering data for ns/kube-system...
2026-04-16T15:45:26.192733774Z Gathering data for ns/openshift-etcd...
2026-04-16T15:45:26.473070984Z Wrote inspect data to must-gather.
2026-04-16T15:45:26.473107601Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T15:45:26.473107601Z     namespaces "assisted-installer" not found
2026-04-16T15:45:26.667544597Z Waiting on subprocesses to finish execution.
2026-04-16T15:45:26.677641121Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-04-16T15:45:26.678221907Z INFO: Gathering machine config daemon's old logs from all nodes
2026-04-16T15:45:26.679113200Z INFO: Gathering HAProxy config files
2026-04-16T15:45:26.680389533Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-04-16T15:45:26.690881750Z INFO: Collecting host service logs for crio
2026-04-16T15:45:26.691280371Z INFO: Collecting host service logs for kubelet
2026-04-16T15:45:26.691629078Z INFO: Collecting host service logs for rpm-ostreed
2026-04-16T15:45:26.691972740Z INFO: Collecting host service logs for ostree-finalize-staged
2026-04-16T15:45:26.692329673Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-04-16T15:45:26.692546094Z INFO: Waiting for node performance related collection to complete ...
2026-04-16T15:45:26.692696694Z INFO: Collecting host service logs for machine-config-daemon-host
2026-04-16T15:45:26.693022775Z INFO: Collecting host service logs for NetworkManager
2026-04-16T15:45:26.693375473Z INFO: Collecting host service logs for openvswitch
2026-04-16T15:45:26.693718840Z INFO: Collecting host service logs for ovs-configuration
2026-04-16T15:45:26.694151595Z INFO: Collecting host service logs for ovsdb-server
2026-04-16T15:45:26.694619116Z INFO: Collecting host service logs for ovs-vswitchd
2026-04-16T15:45:26.695012857Z INFO: Waiting for worker host service log collection to complete ...
2026-04-16T15:45:26.998896519Z No resources found in openshift-etcd namespace.
2026-04-16T15:45:27.310785705Z No resources found
2026-04-16T15:45:27.345837798Z INFO: Found 1 replicas - prometheus-k8s-0
2026-04-16T15:45:27.576788160Z error: the server doesn't have a resource type "performanceprofile"
2026-04-16T15:45:27.623728580Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-04-16T15:45:27.681916975Z INFO: "sriov-network-operator" not detected. Skipping.
2026-04-16T15:45:27.683089985Z INFO: "metallb-operator" not detected. Skipping.
2026-04-16T15:45:27.758748490Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-04-16T15:45:27.758897003Z INFO: on-disk MachineConfig config collection complete.
2026-04-16T15:45:27.762871960Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-04-16T15:45:27.877469315Z Wrote inspect data to must-gather.
2026-04-16T15:45:28.013831873Z INFO: Collecting Insights Archives from insights-operator-5785d4fcdd-g8xfd
2026-04-16T15:45:28.013874029Z insights-runtime-extractor-hxs84
2026-04-16T15:45:28.013892705Z insights-runtime-extractor-nbr9m
2026-04-16T15:45:28.013911878Z insights-runtime-extractor-rghv9
2026-04-16T15:45:28.093666077Z INFO: Worker host service log collection to complete.
2026-04-16T15:45:28.097228019Z ERROR: No running kube-apiserver pods found
2026-04-16T15:45:28.254998956Z INFO: Waiting for HAProxy config collection to complete ...
2026-04-16T15:45:28.267498559Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-04-16T15:45:28.335795771Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-04-16T15:45:28.335795771Z See 'oc rsync -h' for help and examples
2026-04-16T15:45:28.385719594Z Wrote inspect data to must-gather.
2026-04-16T15:45:28.595795262Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T15:45:28.603272405Z Wrote inspect data to must-gather.
2026-04-16T15:45:28.706932753Z INFO: 'previous-logs' folder not found on ip-10-0-129-105.ec2.internal, skipping...
2026-04-16T15:45:28.707412773Z No resources found
2026-04-16T15:45:28.743134510Z tar: Removing leading `/' from member names
2026-04-16T15:45:28.749154572Z Wrote inspect data to must-gather.
2026-04-16T15:45:28.754531171Z INFO: HAProxy config collection complete.
2026-04-16T15:45:28.806968801Z Wrote inspect data to must-gather.
2026-04-16T15:45:28.825117944Z Wrote inspect data to must-gather.
2026-04-16T15:45:28.899007476Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-04-16T15:45:28.944770224Z error: the server doesn't have a resource type "machineconfigs"
2026-04-16T15:45:28.966784803Z Gathering data for ns/openshift-monitoring...
2026-04-16T15:45:29.038810578Z Wrote inspect data to must-gather.
2026-04-16T15:45:29.157731078Z Wrote inspect data to must-gather.
2026-04-16T15:45:29.183752734Z INFO: 'previous-logs' folder not found on ip-10-0-130-140.ec2.internal, skipping...
2026-04-16T15:45:29.195790732Z Wrote inspect data to must-gather.
2026-04-16T15:45:29.302880744Z INFO: Getting rules from prometheus-k8s-0
2026-04-16T15:45:29.395005810Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-16T15:45:29.428618011Z Wrote inspect data to must-gather.
2026-04-16T15:45:29.430152059Z Wrote inspect data to must-gather.
2026-04-16T15:45:29.444046534Z INFO: 'previous-logs' folder not found on ip-10-0-130-229.ec2.internal, skipping...
2026-04-16T15:45:29.444085632Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-04-16T15:45:29.444116173Z INFO: Machine Config Daemon termination log collection complete.
2026-04-16T15:45:29.572488021Z error: the server doesn't have a resource type "kubeletconfigs"
2026-04-16T15:45:29.655599256Z Wrote inspect data to must-gather.
2026-04-16T15:45:29.717256342Z INFO: Getting status/config from prometheus-k8s-0
2026-04-16T15:45:29.782698301Z Wrote inspect data to must-gather.
2026-04-16T15:45:29.932656158Z INFO: INTERCONNECT MODE
2026-04-16T15:45:29.932683040Z INFO: Gathering ovn-kubernetes DBs
2026-04-16T15:45:29.993031484Z Wrote inspect data to must-gather.
2026-04-16T15:45:30.087772977Z INFO: Gathering OVN_Northbound from ovnkube-node-75cxs...
2026-04-16T15:45:30.088052412Z INFO: Gathering OVN_Northbound from ovnkube-node-m882k...
2026-04-16T15:45:30.088373374Z INFO: Gathering OVN_Northbound from ovnkube-node-r7dqw...
2026-04-16T15:45:30.088746534Z INFO: Gathering OVN_Southbound from ovnkube-node-75cxs...
2026-04-16T15:45:30.089038255Z INFO: Gathering OVN_Southbound from ovnkube-node-m882k...
2026-04-16T15:45:30.089352946Z INFO: Gathering OVN_Southbound from ovnkube-node-r7dqw...
2026-04-16T15:45:30.111292860Z INFO: Getting status/flags from prometheus-k8s-0
2026-04-16T15:45:30.274310430Z Wrote inspect data to must-gather.
2026-04-16T15:45:30.403161150Z tar: Removing leading `/' from member names
2026-04-16T15:45:30.408901503Z tar: Removing leading `/' from member names
2026-04-16T15:45:30.449341048Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-04-16T15:45:30.454507680Z tar: Removing leading `/' from member names
2026-04-16T15:45:30.461909022Z tar: Removing leading `/' from member names
2026-04-16T15:45:30.467004953Z tar: Removing leading `/' from member names
2026-04-16T15:45:30.485518553Z tar: Removing leading `/' from member names
2026-04-16T15:45:30.487812367Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-04-16T15:45:30.574047420Z Wrote inspect data to must-gather.
2026-04-16T15:45:30.726235345Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-04-16T15:45:30.814085650Z Wrote inspect data to must-gather.
2026-04-16T15:45:30.914534338Z INFO: Waiting for network log collection to complete ...
2026-04-16T15:45:30.914577774Z INFO: Waiting for ovnk database copies to complete ...
2026-04-16T15:45:30.914975120Z INFO: Copying ovnk databases complete.
2026-04-16T15:45:30.916479309Z 3.8M	must-gather/network_logs/ovnk_database_store
2026-04-16T15:45:30.918398661Z ovnk_database_store/
2026-04-16T15:45:30.918398661Z ovnk_database_store/ovnkube-node-75cxs_sbdb
2026-04-16T15:45:30.939235463Z ovnk_database_store/ovnkube-node-m882k_nbdb
2026-04-16T15:45:30.948659891Z ovnk_database_store/ovnkube-node-r7dqw_nbdb
2026-04-16T15:45:30.957369787Z ovnk_database_store/ovnkube-node-r7dqw_sbdb
2026-04-16T15:45:30.980419805Z ovnk_database_store/ovnkube-node-m882k_sbdb
2026-04-16T15:45:30.983905368Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-04-16T15:45:31.006721672Z ovnk_database_store/ovnkube-node-75cxs_nbdb
2026-04-16T15:45:31.020130834Z INFO: Network log collection complete.
2026-04-16T15:45:31.029039709Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-04-16T15:45:31.099873026Z Wrote inspect data to must-gather.
2026-04-16T15:45:31.185751232Z Gathering data for ns/openshift-network-console...
2026-04-16T15:45:31.359581590Z INFO: Getting status from alertmanager-main-0
2026-04-16T15:45:31.367964091Z Wrote inspect data to must-gather.
2026-04-16T15:45:31.600494569Z Gathering data for ns/openshift-console-operator...
2026-04-16T15:45:31.635737888Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-04-16T15:45:31.638488830Z INFO: Fallback to identify the container image from release info
2026-04-16T15:45:31.938440917Z Gathering data for ns/openshift-console...
2026-04-16T15:45:32.128914045Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc77fc5f1546189d6b57967ccc684e794bd846ea36c3e3c1e61d83a684f0f9b9
2026-04-16T15:45:32.251070190Z daemonset.apps/perf-node-gather-daemonset created
2026-04-16T15:45:32.384458594Z Waiting for performance profile collector pods to become ready: 1
2026-04-16T15:45:32.391924523Z Gathering data for ns/openshift-cluster-storage-operator...
2026-04-16T15:45:32.727739820Z Gathering data for ns/openshift-dns-operator...
2026-04-16T15:45:32.981496982Z Gathering data for ns/openshift-dns...
2026-04-16T15:45:33.517110647Z Waiting for performance profile collector pods to become ready: 2
2026-04-16T15:45:33.535480321Z Gathering data for ns/openshift-image-registry...
2026-04-16T15:45:33.960593815Z Gathering data for ns/openshift-ingress-operator...
2026-04-16T15:45:34.241105872Z Gathering data for ns/openshift-ingress...
2026-04-16T15:45:34.402464770Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-16T15:45:34.536959605Z Gathering data for ns/openshift-ingress-canary...
2026-04-16T15:45:34.629507770Z Waiting for performance profile collector pods to become ready: 3
2026-04-16T15:45:34.882519305Z Gathering data for ns/openshift-insights...
2026-04-16T15:45:35.746086632Z Waiting for performance profile collector pods to become ready: 4
2026-04-16T15:45:36.813944634Z Gathering data for ns/kserve...
2026-04-16T15:45:36.852465646Z Waiting for performance profile collector pods to become ready: 5
2026-04-16T15:45:37.970250295Z Waiting for performance profile collector pods to become ready: 6
2026-04-16T15:45:38.360581944Z Gathering data for ns/openshift-config...
2026-04-16T15:45:38.637411000Z Gathering data for ns/openshift-config-managed...
2026-04-16T15:45:39.019372149Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-04-16T15:45:39.113350581Z Waiting for performance profile collector pods to become ready: 7
2026-04-16T15:45:39.296926843Z Gathering data for ns/openshift-kube-apiserver...
2026-04-16T15:45:39.406777439Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-16T15:45:39.527104393Z Gathering data for ns/openshift-kube-controller-manager...
2026-04-16T15:45:39.786412326Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-04-16T15:45:40.082153666Z Gathering data for ns/openshift-kube-scheduler...
2026-04-16T15:45:40.236636353Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-04-16T15:45:40.328034998Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-04-16T15:45:40.505556494Z Collecting performance related data for node ip-10-0-130-229.ec2.internal
2026-04-16T15:45:40.513681654Z Collecting performance related data for node ip-10-0-129-105.ec2.internal
2026-04-16T15:45:40.521973980Z Collecting performance related data for node ip-10-0-130-140.ec2.internal
2026-04-16T15:45:40.657361324Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-04-16T15:45:41.007982055Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-04-16T15:45:41.364527613Z Gathering data for ns/openshift-user-workload-monitoring...
2026-04-16T15:45:41.962485771Z Gathering data for ns/openshift-multus...
2026-04-16T15:45:43.365518075Z Gathering data for ns/openshift-ovn-kubernetes...
2026-04-16T15:45:44.410903497Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-16T15:45:44.868286578Z Gathering data for ns/openshift-host-network...
2026-04-16T15:45:45.142005907Z Gathering data for ns/openshift-network-diagnostics...
2026-04-16T15:45:45.631193192Z Gathering data for ns/openshift-network-node-identity...
2026-04-16T15:45:46.004355500Z Gathering data for ns/openshift-network-operator...
2026-04-16T15:45:46.350227400Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-04-16T15:45:46.587197156Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-04-16T15:45:46.991353966Z Gathering data for ns/openshift-apiserver-operator...
2026-04-16T15:45:47.295631898Z Gathering data for ns/openshift-apiserver...
2026-04-16T15:45:47.658035191Z Gathering data for ns/openshift-controller-manager-operator...
2026-04-16T15:45:47.937149364Z Gathering data for ns/openshift-controller-manager...
2026-04-16T15:45:48.185436148Z Gathering data for ns/openshift-cluster-samples-operator...
2026-04-16T15:45:48.408739298Z Collecting kubelet logs for node ip-10-0-130-229.ec2.internal
2026-04-16T15:45:48.410968611Z Collecting kubelet logs for node ip-10-0-129-105.ec2.internal
2026-04-16T15:45:48.413448338Z Collecting kubelet logs for node ip-10-0-130-140.ec2.internal
2026-04-16T15:45:48.774689285Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-04-16T15:45:48.779324804Z INFO: Node performance data collection complete.
2026-04-16T15:45:48.853146601Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-04-16T15:45:49.110114849Z Gathering data for ns/openshift-service-ca-operator...
2026-04-16T15:45:49.392859156Z Gathering data for ns/openshift-service-ca...
2026-04-16T15:45:49.415170978Z [disk usage checker] Volume usage percentage: current = 14 ; allowed = 70
2026-04-16T15:45:49.731368904Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-04-16T15:45:50.681000231Z Wrote inspect data to must-gather.
2026-04-16T15:45:50.681043479Z error: inspection completed with the errors occurred while gathering data:
2026-04-16T15:45:50.681043479Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-04-16T15:45:50.804366852Z error: the server doesn't have a resource type "clusters"
2026-04-16T15:45:50.952409242Z Caches written to disk