2026-06-02T09:40:54.222112988Z [disk usage checker] Started
2026-06-02T09:40:54.225944683Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:40:54.417442624Z Gathering data for ns/openshift-cluster-version...
2026-06-02T09:40:54.539050031Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T09:40:54.620869074Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T09:40:54.692411009Z Gathering data for ns/default...
2026-06-02T09:40:54.960866223Z Gathering data for ns/openshift...
2026-06-02T09:40:55.351512887Z Gathering data for ns/kube-system...
2026-06-02T09:40:55.952269441Z Gathering data for ns/openshift-etcd...
2026-06-02T09:40:56.260111324Z Wrote inspect data to must-gather.
2026-06-02T09:40:56.260146508Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T09:40:56.260146508Z     namespaces "assisted-installer" not found
2026-06-02T09:40:56.480300008Z Waiting on subprocesses to finish execution.
2026-06-02T09:40:56.495125927Z INFO: Collecting host service logs for crio
2026-06-02T09:40:56.495455979Z INFO: Collecting host service logs for kubelet
2026-06-02T09:40:56.495795160Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T09:40:56.496174924Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T09:40:56.496501890Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T09:40:56.496845228Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T09:40:56.497183161Z INFO: Collecting host service logs for NetworkManager
2026-06-02T09:40:56.497526054Z INFO: Collecting host service logs for openvswitch
2026-06-02T09:40:56.497911027Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T09:40:56.498248899Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T09:40:56.498593553Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T09:40:56.498612886Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T09:40:56.498807936Z INFO: Gathering HAProxy config files
2026-06-02T09:40:56.499021444Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T09:40:56.502420780Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T09:40:56.514485681Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T09:40:56.545981123Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T09:40:57.337689542Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T09:40:57.344727094Z No resources found
2026-06-02T09:40:57.350184627Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-ssbrz
2026-06-02T09:40:57.350233172Z insights-runtime-extractor-4mjmq
2026-06-02T09:40:57.350253445Z insights-runtime-extractor-b4qgv
2026-06-02T09:40:57.350273024Z insights-runtime-extractor-tjmmd
2026-06-02T09:40:57.375431300Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T09:40:57.429077320Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T09:40:57.574759443Z Wrote inspect data to must-gather.
2026-06-02T09:40:57.619078512Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T09:40:57.619206384Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T09:40:57.627321728Z No resources found in openshift-etcd namespace.
2026-06-02T09:40:57.968791525Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T09:40:57.991814528Z No resources found
2026-06-02T09:40:58.066690066Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T09:40:58.084895171Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T09:40:58.154386338Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T09:40:58.165200682Z Wrote inspect data to must-gather.
2026-06-02T09:40:58.172004042Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T09:40:58.216061849Z Wrote inspect data to must-gather.
2026-06-02T09:40:58.228212888Z INFO: Worker host service log collection to complete.
2026-06-02T09:40:58.332096650Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T09:40:58.332096650Z See 'oc rsync -h' for help and examples
2026-06-02T09:40:58.500073574Z Wrote inspect data to must-gather.
2026-06-02T09:40:58.534102816Z Gathering data for ns/openshift-monitoring...
2026-06-02T09:40:58.580745205Z Wrote inspect data to must-gather.
2026-06-02T09:40:58.643954024Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T09:40:58.663372368Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T09:40:58.680421537Z Wrote inspect data to must-gather.
2026-06-02T09:40:58.687311486Z Wrote inspect data to must-gather.
2026-06-02T09:40:58.701398160Z ERROR: No running kube-apiserver pods found
2026-06-02T09:40:58.725412904Z INFO: 'previous-logs' folder not found on ip-10-0-130-147.ec2.internal, skipping...
2026-06-02T09:40:58.753861729Z tar: Removing leading `/' from member names
2026-06-02T09:40:58.759186876Z INFO: HAProxy config collection complete.
2026-06-02T09:40:58.823689569Z Wrote inspect data to must-gather.
2026-06-02T09:40:58.840978119Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T09:40:58.995440655Z INFO: 'previous-logs' folder not found on ip-10-0-132-231.ec2.internal, skipping...
2026-06-02T09:40:59.036905732Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T09:40:59.055867783Z Wrote inspect data to must-gather.
2026-06-02T09:40:59.071160359Z Wrote inspect data to must-gather.
2026-06-02T09:40:59.232385019Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:40:59.266559622Z INFO: 'previous-logs' folder not found on ip-10-0-137-138.ec2.internal, skipping...
2026-06-02T09:40:59.266662652Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T09:40:59.266760294Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T09:40:59.271229938Z Wrote inspect data to must-gather.
2026-06-02T09:40:59.311388267Z Wrote inspect data to must-gather.
2026-06-02T09:40:59.396741037Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T09:40:59.413036596Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T09:40:59.582370047Z INFO: INTERCONNECT MODE
2026-06-02T09:40:59.582462944Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T09:40:59.622434414Z Wrote inspect data to must-gather.
2026-06-02T09:40:59.750518699Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T09:40:59.751973324Z INFO: Gathering OVN_Northbound from ovnkube-node-2trrd...
2026-06-02T09:40:59.752281885Z INFO: Gathering OVN_Northbound from ovnkube-node-9dksc...
2026-06-02T09:40:59.752522925Z INFO: Gathering OVN_Northbound from ovnkube-node-l69wl...
2026-06-02T09:40:59.752804321Z INFO: Gathering OVN_Southbound from ovnkube-node-2trrd...
2026-06-02T09:40:59.753032182Z INFO: Gathering OVN_Southbound from ovnkube-node-9dksc...
2026-06-02T09:40:59.753262080Z INFO: Gathering OVN_Southbound from ovnkube-node-l69wl...
2026-06-02T09:40:59.777935888Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T09:40:59.919510127Z Wrote inspect data to must-gather.
2026-06-02T09:41:00.029423256Z tar: Removing leading `/' from member names
2026-06-02T09:41:00.045881043Z tar: Removing leading `/' from member names
2026-06-02T09:41:00.055952664Z tar: Removing leading `/' from member names
2026-06-02T09:41:00.056773356Z tar: Removing leading `/' from member names
2026-06-02T09:41:00.105909822Z tar: Removing leading `/' from member names
2026-06-02T09:41:00.106221164Z tar: Removing leading `/' from member names
2026-06-02T09:41:00.177930631Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T09:41:00.194918586Z Wrote inspect data to must-gather.
2026-06-02T09:41:00.405135098Z W0602 09:41:00.405083    1293 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-02T09:41:00.408527051Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T09:41:00.410574727Z Wrote inspect data to must-gather.
2026-06-02T09:41:00.467402576Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T09:41:00.558184535Z INFO: Waiting for network log collection to complete ...
2026-06-02T09:41:00.558240635Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T09:41:00.558772343Z INFO: Copying ovnk databases complete.
2026-06-02T09:41:00.560338276Z 2.7M	must-gather/network_logs/ovnk_database_store
2026-06-02T09:41:00.562465659Z ovnk_database_store/
2026-06-02T09:41:00.562465659Z ovnk_database_store/ovnkube-node-2trrd_nbdb
2026-06-02T09:41:00.571078767Z ovnk_database_store/ovnkube-node-9dksc_nbdb
2026-06-02T09:41:00.581099178Z ovnk_database_store/ovnkube-node-9dksc_sbdb
2026-06-02T09:41:00.596513036Z ovnk_database_store/ovnkube-node-l69wl_sbdb
2026-06-02T09:41:00.613166308Z ovnk_database_store/ovnkube-node-2trrd_sbdb
2026-06-02T09:41:00.632070833Z ovnk_database_store/ovnkube-node-l69wl_nbdb
2026-06-02T09:41:00.634009664Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T09:41:00.641575977Z INFO: Network log collection complete.
2026-06-02T09:41:00.655611070Z Gathering data for ns/openshift-network-console...
2026-06-02T09:41:00.694459483Z Wrote inspect data to must-gather.
2026-06-02T09:41:00.967853684Z Wrote inspect data to must-gather.
2026-06-02T09:41:00.990647680Z INFO: Getting status from alertmanager-main-0
2026-06-02T09:41:01.071396260Z Gathering data for ns/openshift-console-operator...
2026-06-02T09:41:01.231548521Z Wrote inspect data to must-gather.
2026-06-02T09:41:01.435913055Z Gathering data for ns/openshift-console...
2026-06-02T09:41:01.483599437Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T09:41:01.485687791Z INFO: Fallback to identify the container image from release info
2026-06-02T09:41:01.840974470Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T09:41:02.136685236Z Gathering data for ns/openshift-dns-operator...
2026-06-02T09:41:02.263826736Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T09:41:02.387954769Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T09:41:02.403067357Z Gathering data for ns/openshift-dns...
2026-06-02T09:41:02.498294074Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T09:41:02.994623774Z Gathering data for ns/openshift-image-registry...
2026-06-02T09:41:03.390565944Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T09:41:03.628699855Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T09:41:03.685356088Z Gathering data for ns/openshift-ingress...
2026-06-02T09:41:03.974114905Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T09:41:04.240254006Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:41:04.313383460Z Gathering data for ns/openshift-insights...
2026-06-02T09:41:04.739558688Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T09:41:05.846170940Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T09:41:06.054976941Z Gathering data for ns/openshift-jobset-operator...
2026-06-02T09:41:06.801472824Z Gathering data for ns/openshift-config...
2026-06-02T09:41:06.950330584Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T09:41:07.112174347Z Gathering data for ns/openshift-config-managed...
2026-06-02T09:41:07.552598077Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T09:41:07.789393135Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T09:41:08.022965759Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T09:41:08.075243969Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T09:41:08.289483700Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T09:41:08.541324608Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T09:41:08.766542185Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T09:41:09.071617314Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T09:41:09.194484946Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T09:41:09.245982466Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:41:09.374152604Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T09:41:09.639997888Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T09:41:10.157917164Z Gathering data for ns/openshift-multus...
2026-06-02T09:41:10.300780776Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T09:41:10.523583842Z Collecting performance related data for node ip-10-0-137-138.ec2.internal
2026-06-02T09:41:10.530692791Z Collecting performance related data for node ip-10-0-132-231.ec2.internal
2026-06-02T09:41:10.537845816Z Collecting performance related data for node ip-10-0-130-147.ec2.internal
2026-06-02T09:41:11.490627624Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T09:41:12.920403530Z Gathering data for ns/openshift-host-network...
2026-06-02T09:41:13.234981806Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T09:41:13.734956426Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T09:41:14.075825925Z Gathering data for ns/openshift-network-operator...
2026-06-02T09:41:14.250686596Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T09:41:14.408077248Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T09:41:14.693351510Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T09:41:15.107641513Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T09:41:15.371067084Z Gathering data for ns/openshift-apiserver...
2026-06-02T09:41:15.733457089Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T09:41:15.964580731Z Gathering data for ns/openshift-controller-manager...
2026-06-02T09:41:16.255695273Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T09:41:16.864349484Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T09:41:17.119769617Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T09:41:17.432150965Z Gathering data for ns/openshift-service-ca...
2026-06-02T09:41:17.814363137Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T09:41:18.602300036Z Collecting kubelet logs for node ip-10-0-137-138.ec2.internal
2026-06-02T09:41:18.604056599Z Collecting kubelet logs for node ip-10-0-132-231.ec2.internal
2026-06-02T09:41:18.605826494Z Collecting kubelet logs for node ip-10-0-130-147.ec2.internal
2026-06-02T09:41:18.640127097Z Wrote inspect data to must-gather.
2026-06-02T09:41:18.640176160Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T09:41:18.640176160Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T09:41:18.903060471Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T09:41:18.907921734Z INFO: Node performance data collection complete.
2026-06-02T09:41:19.038858327Z error: the server doesn't have a resource type "clusters"
2026-06-02T09:41:19.170318025Z Caches written to disk