2026-06-02T09:16:38.845301276Z [disk usage checker] Started
2026-06-02T09:16:38.849221584Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:16:39.053676847Z Gathering data for ns/openshift-cluster-version...
2026-06-02T09:16:39.203690947Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T09:16:39.299024553Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T09:16:39.384149781Z Gathering data for ns/default...
2026-06-02T09:16:39.690474049Z Gathering data for ns/openshift...
2026-06-02T09:16:40.112134799Z Gathering data for ns/kube-system...
2026-06-02T09:16:40.771054716Z Gathering data for ns/openshift-etcd...
2026-06-02T09:16:41.077522392Z Waiting on subprocesses to finish execution.
2026-06-02T09:16:41.081940668Z Wrote inspect data to must-gather.
2026-06-02T09:16:41.082017841Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T09:16:41.082017841Z     namespaces "assisted-installer" not found
2026-06-02T09:16:41.083425406Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T09:16:41.084631893Z INFO: Gathering HAProxy config files
2026-06-02T09:16:41.095745363Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T09:16:41.108108580Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T09:16:41.124723020Z INFO: Collecting host service logs for crio
2026-06-02T09:16:41.125089704Z INFO: Collecting host service logs for kubelet
2026-06-02T09:16:41.125429626Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T09:16:41.125743795Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T09:16:41.126087181Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T09:16:41.126435250Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T09:16:41.126757525Z INFO: Collecting host service logs for NetworkManager
2026-06-02T09:16:41.127103650Z INFO: Collecting host service logs for openvswitch
2026-06-02T09:16:41.127436231Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T09:16:41.127752176Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T09:16:41.128109757Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T09:16:41.128515231Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T09:16:41.398318233Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T09:16:41.446994359Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T09:16:41.713975846Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T09:16:41.923464267Z No resources found in openshift-etcd namespace.
2026-06-02T09:16:41.926215886Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T09:16:42.107072876Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T09:16:42.311094363Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T09:16:42.325185502Z No resources found
2026-06-02T09:16:42.376615666Z No resources found
2026-06-02T09:16:42.561366090Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T09:16:42.648660842Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T09:16:42.655072709Z ERROR: No running kube-apiserver pods found
2026-06-02T09:16:42.659909814Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T09:16:42.716541852Z Wrote inspect data to must-gather.
2026-06-02T09:16:42.723166498Z INFO: 'previous-logs' folder not found on ip-10-0-130-185.ec2.internal, skipping...
2026-06-02T09:16:42.789429928Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T09:16:42.843632684Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-668gd
2026-06-02T09:16:42.843632684Z insights-runtime-extractor-d76q5
2026-06-02T09:16:42.843632684Z insights-runtime-extractor-hlpvb
2026-06-02T09:16:42.843632684Z insights-runtime-extractor-ql68r
2026-06-02T09:16:42.935609301Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T09:16:42.935705257Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T09:16:42.968853864Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T09:16:43.013385490Z INFO: Worker host service log collection to complete.
2026-06-02T09:16:43.028989468Z tar: Removing leading `/' from member names
2026-06-02T09:16:43.036873701Z INFO: HAProxy config collection complete.
2026-06-02T09:16:43.038162368Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.152209428Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T09:16:43.152209428Z See 'oc rsync -h' for help and examples
2026-06-02T09:16:43.152327294Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.162338865Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.174705072Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.230357726Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.268633326Z INFO: 'previous-logs' folder not found on ip-10-0-133-84.ec2.internal, skipping...
2026-06-02T09:16:43.289699506Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.366260910Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T09:16:43.408822342Z Gathering data for ns/openshift-monitoring...
2026-06-02T09:16:43.433548692Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.460894374Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T09:16:43.565337350Z INFO: 'previous-logs' folder not found on ip-10-0-138-61.ec2.internal, skipping...
2026-06-02T09:16:43.565372952Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T09:16:43.565401396Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T09:16:43.660552775Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.662071432Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.757150120Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T09:16:43.855175577Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:16:43.865681539Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.904117040Z Wrote inspect data to must-gather.
2026-06-02T09:16:43.997526057Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T09:16:44.125020591Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T09:16:44.165488801Z INFO: INTERCONNECT MODE
2026-06-02T09:16:44.165521327Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T09:16:44.204218072Z Wrote inspect data to must-gather.
2026-06-02T09:16:44.311473606Z INFO: Gathering OVN_Northbound from ovnkube-node-6rwsj...
2026-06-02T09:16:44.311675605Z INFO: Gathering OVN_Northbound from ovnkube-node-b2fxz...
2026-06-02T09:16:44.311896604Z INFO: Gathering OVN_Northbound from ovnkube-node-vt9sh...
2026-06-02T09:16:44.312120077Z INFO: Gathering OVN_Southbound from ovnkube-node-6rwsj...
2026-06-02T09:16:44.312366951Z INFO: Gathering OVN_Southbound from ovnkube-node-b2fxz...
2026-06-02T09:16:44.312617418Z INFO: Gathering OVN_Southbound from ovnkube-node-vt9sh...
2026-06-02T09:16:44.339530406Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T09:16:44.454812818Z Wrote inspect data to must-gather.
2026-06-02T09:16:44.577019363Z tar: Removing leading `/' from member names
2026-06-02T09:16:44.580321617Z tar: Removing leading `/' from member names
2026-06-02T09:16:44.595678474Z tar: Removing leading `/' from member names
2026-06-02T09:16:44.608664017Z tar: Removing leading `/' from member names
2026-06-02T09:16:44.623533678Z tar: Removing leading `/' from member names
2026-06-02T09:16:44.628454401Z tar: Removing leading `/' from member names
2026-06-02T09:16:44.655739900Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T09:16:44.732809037Z Wrote inspect data to must-gather.
2026-06-02T09:16:44.793774278Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T09:16:44.895314677Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T09:16:44.973989312Z Wrote inspect data to must-gather.
2026-06-02T09:16:45.032959110Z INFO: Waiting for network log collection to complete ...
2026-06-02T09:16:45.032994970Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T09:16:45.033414339Z INFO: Copying ovnk databases complete.
2026-06-02T09:16:45.034981264Z 2.7M	must-gather/network_logs/ovnk_database_store
2026-06-02T09:16:45.037014529Z ovnk_database_store/
2026-06-02T09:16:45.037014529Z ovnk_database_store/ovnkube-node-6rwsj_nbdb
2026-06-02T09:16:45.045148826Z ovnk_database_store/ovnkube-node-vt9sh_nbdb
2026-06-02T09:16:45.052103947Z ovnk_database_store/ovnkube-node-6rwsj_sbdb
2026-06-02T09:16:45.067390205Z ovnk_database_store/ovnkube-node-b2fxz_nbdb
2026-06-02T09:16:45.077470991Z ovnk_database_store/ovnkube-node-b2fxz_sbdb
2026-06-02T09:16:45.096145414Z ovnk_database_store/ovnkube-node-vt9sh_sbdb
2026-06-02T09:16:45.116998393Z INFO: Network log collection complete.
2026-06-02T09:16:45.169129190Z Wrote inspect data to must-gather.
2026-06-02T09:16:45.259851984Z INFO: Getting status from alertmanager-main-0
2026-06-02T09:16:45.364084110Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T09:16:45.430650942Z Wrote inspect data to must-gather.
2026-06-02T09:16:45.521268889Z Gathering data for ns/openshift-network-console...
2026-06-02T09:16:45.670785347Z Wrote inspect data to must-gather.
2026-06-02T09:16:45.905609342Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T09:16:45.908952166Z INFO: Fallback to identify the container image from release info
2026-06-02T09:16:45.937357757Z Gathering data for ns/openshift-console-operator...
2026-06-02T09:16:46.282960735Z Gathering data for ns/openshift-console...
2026-06-02T09:16:46.557000491Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T09:16:46.681973829Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T09:16:46.706182891Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T09:16:46.806203377Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T09:16:47.082226083Z Gathering data for ns/openshift-dns-operator...
2026-06-02T09:16:47.384040132Z Gathering data for ns/openshift-dns...
2026-06-02T09:16:47.929780451Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T09:16:47.949488531Z Gathering data for ns/openshift-image-registry...
2026-06-02T09:16:48.383983619Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T09:16:48.697768317Z Gathering data for ns/openshift-ingress...
2026-06-02T09:16:48.860386549Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:16:49.047566545Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T09:16:49.048242530Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T09:16:49.416204313Z Gathering data for ns/openshift-insights...
2026-06-02T09:16:50.156542298Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T09:16:51.171250355Z Gathering data for ns/openshift-jobset-operator...
2026-06-02T09:16:51.269471522Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T09:16:51.951799994Z Gathering data for ns/openshift-config...
2026-06-02T09:16:52.212796937Z Gathering data for ns/openshift-config-managed...
2026-06-02T09:16:52.369381843Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T09:16:52.666100201Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T09:16:52.921536197Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T09:16:53.178128171Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T09:16:53.488393257Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T09:16:53.513293437Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T09:16:53.801508915Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T09:16:53.864778173Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:16:54.064176400Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T09:16:54.350992653Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T09:16:54.602028101Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T09:16:54.698510551Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T09:16:54.854704164Z Collecting performance related data for node ip-10-0-133-84.ec2.internal
2026-06-02T09:16:54.861218868Z Collecting performance related data for node ip-10-0-138-61.ec2.internal
2026-06-02T09:16:54.868344320Z Collecting performance related data for node ip-10-0-130-185.ec2.internal
2026-06-02T09:16:55.062044802Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T09:16:55.686861861Z Gathering data for ns/openshift-multus...
2026-06-02T09:16:57.087237770Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T09:16:58.490891689Z Gathering data for ns/openshift-host-network...
2026-06-02T09:16:58.798022956Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T09:16:58.869218605Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:16:59.327327702Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T09:16:59.738957180Z Gathering data for ns/openshift-network-operator...
2026-06-02T09:17:00.112406594Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T09:17:00.375257250Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T09:17:00.812421814Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T09:17:01.144317009Z Gathering data for ns/openshift-apiserver...
2026-06-02T09:17:01.512872244Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T09:17:01.785561382Z Gathering data for ns/openshift-controller-manager...
2026-06-02T09:17:02.060019388Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T09:17:02.703807015Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T09:17:02.748028420Z Collecting kubelet logs for node ip-10-0-133-84.ec2.internal
2026-06-02T09:17:02.751313865Z Collecting kubelet logs for node ip-10-0-138-61.ec2.internal
2026-06-02T09:17:02.753642685Z Collecting kubelet logs for node ip-10-0-130-185.ec2.internal
2026-06-02T09:17:03.026150596Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T09:17:03.078533528Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T09:17:03.084596945Z INFO: Node performance data collection complete.
2026-06-02T09:17:03.369190635Z Gathering data for ns/openshift-service-ca...
2026-06-02T09:17:03.723549682Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T09:17:03.873761148Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:17:04.589578431Z Wrote inspect data to must-gather.
2026-06-02T09:17:04.589627571Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T09:17:04.589627571Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T09:17:04.719806655Z error: the server doesn't have a resource type "clusters"
2026-06-02T09:17:04.860958577Z Caches written to disk