2026-06-02T08:08:53.586464553Z [disk usage checker] Started
2026-06-02T08:08:53.590465844Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T08:08:53.780904379Z Gathering data for ns/openshift-cluster-version...
2026-06-02T08:08:53.899501991Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T08:08:53.974015244Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T08:08:54.052765039Z Gathering data for ns/default...
2026-06-02T08:08:54.420023102Z Gathering data for ns/openshift...
2026-06-02T08:08:54.863379751Z Gathering data for ns/kube-system...
2026-06-02T08:08:55.527382960Z Gathering data for ns/openshift-etcd...
2026-06-02T08:08:55.757504015Z Waiting on subprocesses to finish execution.
2026-06-02T08:08:55.766630307Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T08:08:55.770905840Z INFO: Collecting host service logs for crio
2026-06-02T08:08:55.771213266Z INFO: Collecting host service logs for kubelet
2026-06-02T08:08:55.771556324Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T08:08:55.771909601Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T08:08:55.772256819Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T08:08:55.772588230Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T08:08:55.772922016Z INFO: Collecting host service logs for NetworkManager
2026-06-02T08:08:55.773243261Z INFO: Collecting host service logs for openvswitch
2026-06-02T08:08:55.773558849Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T08:08:55.773963523Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T08:08:55.774300913Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T08:08:55.774696781Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T08:08:55.796668082Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T08:08:55.800909615Z INFO: Gathering HAProxy config files
2026-06-02T08:08:55.824437144Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T08:08:55.949135407Z Wrote inspect data to must-gather.
2026-06-02T08:08:55.949188642Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T08:08:55.949188642Z     namespaces "assisted-installer" not found
2026-06-02T08:08:55.953078190Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T08:08:56.580835014Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T08:08:56.604735560Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-vnt4z
2026-06-02T08:08:56.604735560Z insights-runtime-extractor-7xftw
2026-06-02T08:08:56.604735560Z insights-runtime-extractor-b7p9t
2026-06-02T08:08:56.604735560Z insights-runtime-extractor-zs6pv
2026-06-02T08:08:56.756155263Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T08:08:56.756233974Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T08:08:56.814380495Z Wrote inspect data to must-gather.
2026-06-02T08:08:56.827557184Z ERROR: No running kube-apiserver pods found
2026-06-02T08:08:56.850213404Z No resources found
2026-06-02T08:08:56.922024497Z No resources found in openshift-etcd namespace.
2026-06-02T08:08:56.943123058Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T08:08:56.973671735Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T08:08:56.989578327Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T08:08:57.054193871Z INFO: Worker host service log collection to complete.
2026-06-02T08:08:57.118282466Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T08:08:57.132427891Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T08:08:57.284709762Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T08:08:57.314659340Z INFO: 'previous-logs' folder not found on ip-10-0-132-52.ec2.internal, skipping...
2026-06-02T08:08:57.327917106Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T08:08:57.327917106Z See 'oc rsync -h' for help and examples
2026-06-02T08:08:57.486804126Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T08:08:57.782790254Z Wrote inspect data to must-gather.
2026-06-02T08:08:57.791036076Z Wrote inspect data to must-gather.
2026-06-02T08:08:57.831174701Z Wrote inspect data to must-gather.
2026-06-02T08:08:57.928210826Z tar: Removing leading `/' from member names
2026-06-02T08:08:57.933498533Z INFO: HAProxy config collection complete.
2026-06-02T08:08:57.934369987Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T08:08:57.967553712Z Wrote inspect data to must-gather.
2026-06-02T08:08:57.971524389Z Wrote inspect data to must-gather.
2026-06-02T08:08:57.977012261Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T08:08:57.981768700Z No resources found
2026-06-02T08:08:58.001237743Z Wrote inspect data to must-gather.
2026-06-02T08:08:58.071416366Z Gathering data for ns/openshift-monitoring...
2026-06-02T08:08:58.163004209Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T08:08:58.165330129Z INFO: 'previous-logs' folder not found on ip-10-0-135-3.ec2.internal, skipping...
2026-06-02T08:08:58.169656444Z Wrote inspect data to must-gather.
2026-06-02T08:08:58.256190556Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T08:08:58.397055541Z Wrote inspect data to must-gather.
2026-06-02T08:08:58.430872961Z Wrote inspect data to must-gather.
2026-06-02T08:08:58.439551409Z INFO: 'previous-logs' folder not found on ip-10-0-137-47.ec2.internal, skipping...
2026-06-02T08:08:58.439580026Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T08:08:58.439592487Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T08:08:58.591771360Z Wrote inspect data to must-gather.
2026-06-02T08:08:58.595697792Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T08:08:58.643893944Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T08:08:58.657241957Z Wrote inspect data to must-gather.
2026-06-02T08:08:58.733002425Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T08:08:58.908643008Z INFO: INTERCONNECT MODE
2026-06-02T08:08:58.908738390Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T08:08:58.918493851Z Wrote inspect data to must-gather.
2026-06-02T08:08:58.996865034Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T08:08:59.057299029Z INFO: Gathering OVN_Northbound from ovnkube-node-kxrz8...
2026-06-02T08:08:59.057566097Z INFO: Gathering OVN_Northbound from ovnkube-node-t2nhc...
2026-06-02T08:08:59.057890956Z INFO: Gathering OVN_Northbound from ovnkube-node-wnv8z...
2026-06-02T08:08:59.058192555Z INFO: Gathering OVN_Southbound from ovnkube-node-kxrz8...
2026-06-02T08:08:59.058430667Z INFO: Gathering OVN_Southbound from ovnkube-node-t2nhc...
2026-06-02T08:08:59.058743994Z INFO: Gathering OVN_Southbound from ovnkube-node-wnv8z...
2026-06-02T08:08:59.162587147Z Wrote inspect data to must-gather.
2026-06-02T08:08:59.306120394Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T08:08:59.335011044Z tar: Removing leading `/' from member names
2026-06-02T08:08:59.340564071Z tar: Removing leading `/' from member names
2026-06-02T08:08:59.344735344Z tar: Removing leading `/' from member names
2026-06-02T08:08:59.346508901Z tar: Removing leading `/' from member names
2026-06-02T08:08:59.363369366Z tar: Removing leading `/' from member names
2026-06-02T08:08:59.401771179Z tar: Removing leading `/' from member names
2026-06-02T08:08:59.469304154Z Wrote inspect data to must-gather.
2026-06-02T08:08:59.535083435Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T08:08:59.580774745Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T08:08:59.692341124Z Wrote inspect data to must-gather.
2026-06-02T08:08:59.793571489Z INFO: Waiting for network log collection to complete ...
2026-06-02T08:08:59.793634288Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T08:08:59.794072148Z INFO: Copying ovnk databases complete.
2026-06-02T08:08:59.795859269Z 2.7M	must-gather/network_logs/ovnk_database_store
2026-06-02T08:08:59.798309097Z ovnk_database_store/
2026-06-02T08:08:59.798309097Z ovnk_database_store/ovnkube-node-t2nhc_nbdb
2026-06-02T08:08:59.806908891Z ovnk_database_store/ovnkube-node-wnv8z_sbdb
2026-06-02T08:08:59.826217010Z ovnk_database_store/ovnkube-node-kxrz8_sbdb
2026-06-02T08:08:59.832571189Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T08:08:59.844355708Z ovnk_database_store/ovnkube-node-kxrz8_nbdb
2026-06-02T08:08:59.853474987Z ovnk_database_store/ovnkube-node-wnv8z_nbdb
2026-06-02T08:08:59.862761935Z ovnk_database_store/ovnkube-node-t2nhc_sbdb
2026-06-02T08:08:59.882100273Z INFO: Network log collection complete.
2026-06-02T08:08:59.917885748Z Wrote inspect data to must-gather.
2026-06-02T08:09:00.098089900Z W0602 08:09:00.098030    1385 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-02T08:09:00.102997924Z Wrote inspect data to must-gather.
2026-06-02T08:09:00.153339485Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T08:09:00.195751277Z INFO: Getting status from alertmanager-main-0
2026-06-02T08:09:00.320426988Z Gathering data for ns/openshift-network-console...
2026-06-02T08:09:00.349046237Z Wrote inspect data to must-gather.
2026-06-02T08:09:00.591049400Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T08:09:00.593020255Z INFO: Fallback to identify the container image from release info
2026-06-02T08:09:00.708690171Z Gathering data for ns/openshift-console-operator...
2026-06-02T08:09:01.021405395Z Gathering data for ns/openshift-console...
2026-06-02T08:09:01.311766078Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T08:09:01.420013714Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T08:09:01.430844880Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T08:09:01.555069446Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T08:09:01.796035912Z Gathering data for ns/openshift-dns-operator...
2026-06-02T08:09:02.137879241Z Gathering data for ns/openshift-dns...
2026-06-02T08:09:02.667305704Z Gathering data for ns/openshift-image-registry...
2026-06-02T08:09:02.674834196Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T08:09:03.099706378Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T08:09:03.444868732Z Gathering data for ns/openshift-ingress...
2026-06-02T08:09:03.600020982Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T08:09:03.770857848Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T08:09:03.792162403Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T08:09:04.132944103Z Gathering data for ns/openshift-insights...
2026-06-02T08:09:04.895541014Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T08:09:05.881628490Z Gathering data for ns/openshift-jobset-operator...
2026-06-02T08:09:06.016751751Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T08:09:06.639530210Z Gathering data for ns/openshift-config...
2026-06-02T08:09:06.878072851Z Gathering data for ns/openshift-config-managed...
2026-06-02T08:09:07.120988584Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T08:09:07.283816760Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T08:09:07.521851528Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T08:09:07.757409532Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T08:09:08.011379990Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T08:09:08.233135858Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T08:09:08.325973985Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T08:09:08.605027394Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T08:09:08.607459345Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T08:09:08.914912952Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T08:09:09.199431987Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T08:09:09.345515102Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T08:09:09.507183724Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T08:09:09.607619014Z Collecting performance related data for node ip-10-0-132-52.ec2.internal
2026-06-02T08:09:09.614292323Z Collecting performance related data for node ip-10-0-137-47.ec2.internal
2026-06-02T08:09:09.621705436Z Collecting performance related data for node ip-10-0-135-3.ec2.internal
2026-06-02T08:09:10.053658351Z Gathering data for ns/openshift-multus...
2026-06-02T08:09:11.406559593Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T08:09:12.744919579Z Gathering data for ns/openshift-host-network...
2026-06-02T08:09:13.026371693Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T08:09:13.523896484Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T08:09:13.609452477Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T08:09:13.915285727Z Gathering data for ns/openshift-network-operator...
2026-06-02T08:09:14.289855031Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T08:09:14.537131120Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T08:09:15.050306749Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T08:09:15.317806038Z Gathering data for ns/openshift-apiserver...
2026-06-02T08:09:15.708498194Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T08:09:15.953522109Z Gathering data for ns/openshift-controller-manager...
2026-06-02T08:09:16.205637878Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T08:09:16.865797186Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T08:09:17.138441096Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T08:09:17.422024553Z Gathering data for ns/openshift-service-ca...
2026-06-02T08:09:17.527162720Z Collecting kubelet logs for node ip-10-0-132-52.ec2.internal
2026-06-02T08:09:17.528849144Z Collecting kubelet logs for node ip-10-0-137-47.ec2.internal
2026-06-02T08:09:17.530566714Z Collecting kubelet logs for node ip-10-0-135-3.ec2.internal
2026-06-02T08:09:17.816116185Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T08:09:17.858540552Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T08:09:17.863131557Z INFO: Node performance data collection complete.
2026-06-02T08:09:18.615018665Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T08:09:18.726149869Z Wrote inspect data to must-gather.
2026-06-02T08:09:18.726193019Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T08:09:18.726193019Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T08:09:18.847316942Z error: the server doesn't have a resource type "clusters"
2026-06-02T08:09:18.981635201Z Caches written to disk