2026-06-12T21:52:07.426779501Z [disk usage checker] Started
2026-06-12T21:52:07.429981614Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T21:52:07.622131116Z Gathering data for ns/openshift-cluster-version...
2026-06-12T21:52:07.762728430Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-12T21:52:07.844832927Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-12T21:52:07.923791965Z Gathering data for ns/default...
2026-06-12T21:52:08.195452404Z Gathering data for ns/openshift...
2026-06-12T21:52:08.574425635Z Gathering data for ns/kube-system...
2026-06-12T21:52:09.204373765Z Gathering data for ns/openshift-etcd...
2026-06-12T21:52:09.513307613Z Wrote inspect data to must-gather.
2026-06-12T21:52:09.513331831Z error: inspection completed with the errors occurred while gathering data:
2026-06-12T21:52:09.513331831Z     namespaces "assisted-installer" not found
2026-06-12T21:52:09.868019679Z Waiting on subprocesses to finish execution.
2026-06-12T21:52:09.872176838Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-12T21:52:09.878997230Z Executing Istio gather script
2026-06-12T21:52:09.887641048Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-12T21:52:09.890490589Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-12T21:52:09.913470374Z INFO: Collecting host service logs for crio
2026-06-12T21:52:09.913741775Z INFO: Collecting host service logs for kubelet
2026-06-12T21:52:09.914045627Z INFO: Collecting host service logs for rpm-ostreed
2026-06-12T21:52:09.914352256Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-12T21:52:09.914651290Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-12T21:52:09.914976955Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-12T21:52:09.915288808Z INFO: Collecting host service logs for NetworkManager
2026-06-12T21:52:09.915583047Z INFO: Collecting host service logs for openvswitch
2026-06-12T21:52:09.915915800Z INFO: Collecting host service logs for ovs-configuration
2026-06-12T21:52:09.916225090Z INFO: Collecting host service logs for ovsdb-server
2026-06-12T21:52:09.916524067Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-12T21:52:09.916893164Z INFO: Waiting for worker host service log collection to complete ...
2026-06-12T21:52:09.923180736Z INFO: Gathering HAProxy config files
2026-06-12T21:52:10.143401368Z INFO: Waiting for node performance related collection to complete ...
2026-06-12T21:52:10.192096465Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-12T21:52:10.256281690Z INFO: "metallb-operator" not detected. Skipping.
2026-06-12T21:52:10.332741768Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-12T21:52:10.540076062Z No resources found
2026-06-12T21:52:10.856654820Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-12T21:52:11.027463822Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-12T21:52:11.056323053Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-12T21:52:11.107949219Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-12T21:52:11.265614061Z Wrote inspect data to must-gather.
2026-06-12T21:52:11.364546188Z No resources found
2026-06-12T21:52:11.422309985Z INFO: Collecting Insights Archives from insights-operator-5bbd86d6bd-gthzt
2026-06-12T21:52:11.422309985Z insights-runtime-extractor-l5wdg
2026-06-12T21:52:11.422309985Z insights-runtime-extractor-psv2x
2026-06-12T21:52:11.422309985Z insights-runtime-extractor-rxh2m
2026-06-12T21:52:11.556960776Z Wrote inspect data to must-gather.
2026-06-12T21:52:11.636726545Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-12T21:52:11.643179476Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-12T21:52:11.643264449Z INFO: on-disk MachineConfig config collection complete.
2026-06-12T21:52:11.658794276Z Wrote inspect data to must-gather.
2026-06-12T21:52:11.662093523Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-12T21:52:11.662093523Z See 'oc rsync -h' for help and examples
2026-06-12T21:52:11.677876643Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-12T21:52:11.883297049Z INFO: 'previous-logs' folder not found on ip-10-0-128-93.ec2.internal, skipping...
2026-06-12T21:52:11.990279870Z error: the server doesn't have a resource type "performanceprofile"
2026-06-12T21:52:12.029496469Z ERROR: No running kube-apiserver pods found
2026-06-12T21:52:12.058311470Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-12T21:52:12.079202464Z INFO: Getting rules from prometheus-k8s-0
2026-06-12T21:52:12.133771007Z No resources found in openshift-etcd namespace.
2026-06-12T21:52:12.220745203Z INFO: Worker host service log collection to complete.
2026-06-12T21:52:12.253383070Z Wrote inspect data to must-gather.
2026-06-12T21:52:12.260779601Z Wrote inspect data to must-gather.
2026-06-12T21:52:12.356626565Z Wrote inspect data to must-gather.
2026-06-12T21:52:12.370347409Z Wrote inspect data to must-gather.
2026-06-12T21:52:12.386320764Z INFO: 'previous-logs' folder not found on ip-10-0-133-229.ec2.internal, skipping...
2026-06-12T21:52:12.395027274Z tar: Removing leading `/' from member names
2026-06-12T21:52:12.400060359Z INFO: HAProxy config collection complete.
2026-06-12T21:52:12.435904133Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T21:52:12.529780100Z error: the server doesn't have a resource type "machineconfigs"
2026-06-12T21:52:12.562606969Z Gathering data for ns/openshift-monitoring...
2026-06-12T21:52:12.647252559Z INFO: Getting status/config from prometheus-k8s-0
2026-06-12T21:52:12.649644117Z Wrote inspect data to must-gather.
2026-06-12T21:52:12.657558172Z INFO: 'previous-logs' folder not found on ip-10-0-137-209.ec2.internal, skipping...
2026-06-12T21:52:12.657608652Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-12T21:52:12.657648350Z INFO: Machine Config Daemon termination log collection complete.
2026-06-12T21:52:12.707779993Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-12T21:52:12.879216148Z Wrote inspect data to must-gather.
2026-06-12T21:52:12.899585893Z Wrote inspect data to must-gather.
2026-06-12T21:52:13.052275394Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-12T21:52:13.064253680Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-12T21:52:13.122417654Z Wrote inspect data to must-gather.
2026-06-12T21:52:13.248009208Z Wrote inspect data to must-gather.
2026-06-12T21:52:13.283583686Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-12T21:52:13.334125698Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-12T21:52:13.398917961Z INFO: INTERCONNECT MODE
2026-06-12T21:52:13.398962463Z INFO: Gathering ovn-kubernetes DBs
2026-06-12T21:52:13.456884399Z Wrote inspect data to must-gather.
2026-06-12T21:52:13.500831288Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-12T21:52:13.519002241Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:13.548715980Z INFO: Gathering OVN_Northbound from ovnkube-node-fnlbf...
2026-06-12T21:52:13.549058128Z INFO: Gathering OVN_Northbound from ovnkube-node-rlk66...
2026-06-12T21:52:13.549328744Z INFO: Gathering OVN_Northbound from ovnkube-node-s694q...
2026-06-12T21:52:13.549608899Z INFO: Gathering OVN_Southbound from ovnkube-node-fnlbf...
2026-06-12T21:52:13.549906407Z INFO: Gathering OVN_Southbound from ovnkube-node-rlk66...
2026-06-12T21:52:13.550186643Z INFO: Gathering OVN_Southbound from ovnkube-node-s694q...
2026-06-12T21:52:13.792232193Z Wrote inspect data to must-gather.
2026-06-12T21:52:13.833268196Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-12T21:52:13.844124071Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:13.847362890Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-12T21:52:13.862832549Z tar: Removing leading `/' from member names
2026-06-12T21:52:13.867007452Z tar: Removing leading `/' from member names
2026-06-12T21:52:13.872216714Z tar: Removing leading `/' from member names
2026-06-12T21:52:13.888195361Z tar: Removing leading `/' from member names
2026-06-12T21:52:13.891949199Z tar: Removing leading `/' from member names
2026-06-12T21:52:13.913784924Z tar: Removing leading `/' from member names
2026-06-12T21:52:14.059424167Z Wrote inspect data to must-gather.
2026-06-12T21:52:14.074383979Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-12T21:52:14.095649512Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:14.301399963Z INFO: Getting status from alertmanager-main-0
2026-06-12T21:52:14.324857829Z Wrote inspect data to must-gather.
2026-06-12T21:52:14.327807501Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:14.330588346Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-12T21:52:14.437465891Z INFO: Waiting for network log collection to complete ...
2026-06-12T21:52:14.437500737Z INFO: Waiting for ovnk database copies to complete ...
2026-06-12T21:52:14.437882789Z INFO: Copying ovnk databases complete.
2026-06-12T21:52:14.439844315Z 2.6M	must-gather/network_logs/ovnk_database_store
2026-06-12T21:52:14.442714902Z ovnk_database_store/
2026-06-12T21:52:14.442764511Z ovnk_database_store/ovnkube-node-rlk66_nbdb
2026-06-12T21:52:14.455309977Z ovnk_database_store/ovnkube-node-s694q_sbdb
2026-06-12T21:52:14.471030591Z ovnk_database_store/ovnkube-node-rlk66_sbdb
2026-06-12T21:52:14.485958493Z ovnk_database_store/ovnkube-node-s694q_nbdb
2026-06-12T21:52:14.491685693Z ovnk_database_store/ovnkube-node-fnlbf_nbdb
2026-06-12T21:52:14.498146102Z ovnk_database_store/ovnkube-node-fnlbf_sbdb
2026-06-12T21:52:14.521296016Z INFO: Network log collection complete.
2026-06-12T21:52:14.531123059Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:14.565750843Z Wrote inspect data to must-gather.
2026-06-12T21:52:14.729075262Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:14.730636228Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-12T21:52:14.732390256Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-12T21:52:14.830656194Z Wrote inspect data to must-gather.
2026-06-12T21:52:14.889357868Z Gathering data for ns/openshift-network-console...
2026-06-12T21:52:14.952875390Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:15.081326454Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-12T21:52:15.083724435Z INFO: Fallback to identify the container image from release info
2026-06-12T21:52:15.153121722Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:15.156395413Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-12T21:52:15.297008648Z Gathering data for ns/openshift-console-operator...
2026-06-12T21:52:15.314972566Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:15.492854830Z Wrote inspect data to /must-gather/istio.
2026-06-12T21:52:15.671925221Z Gathering data for ns/openshift-console...
2026-06-12T21:52:15.873972055Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d66a6b2ec52dede5d83ce04f6abfc519df1fd7dc36248741e03ecb9bf8d1762
2026-06-12T21:52:15.995693083Z daemonset.apps/perf-node-gather-daemonset created
2026-06-12T21:52:16.128693977Z Waiting for performance profile collector pods to become ready: 1
2026-06-12T21:52:16.162947444Z Done executing Istio gather script
2026-06-12T21:52:16.210598660Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-12T21:52:16.681920648Z Gathering data for ns/openshift-dns-operator...
2026-06-12T21:52:16.928282929Z Gathering data for ns/openshift-dns...
2026-06-12T21:52:17.237773350Z Waiting for performance profile collector pods to become ready: 2
2026-06-12T21:52:17.442656575Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T21:52:17.526351634Z Gathering data for ns/openshift-image-registry...
2026-06-12T21:52:17.944220890Z Gathering data for ns/openshift-ingress-operator...
2026-06-12T21:52:18.240323541Z Gathering data for ns/openshift-ingress...
2026-06-12T21:52:18.357388776Z Waiting for performance profile collector pods to become ready: 3
2026-06-12T21:52:18.538890970Z Gathering data for ns/openshift-ingress-canary...
2026-06-12T21:52:18.883318880Z Gathering data for ns/openshift-insights...
2026-06-12T21:52:19.472480379Z Waiting for performance profile collector pods to become ready: 4
2026-06-12T21:52:20.577326349Z Waiting for performance profile collector pods to become ready: 5
2026-06-12T21:52:20.650363797Z Gathering data for ns/openshift-config...
2026-06-12T21:52:20.881529436Z Gathering data for ns/openshift-config-managed...
2026-06-12T21:52:21.272611764Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-12T21:52:21.509078870Z Gathering data for ns/openshift-kube-apiserver...
2026-06-12T21:52:21.687483088Z Waiting for performance profile collector pods to become ready: 6
2026-06-12T21:52:21.757085287Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-12T21:52:22.004936869Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-12T21:52:22.300353402Z Gathering data for ns/openshift-kube-scheduler...
2026-06-12T21:52:22.448927060Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T21:52:22.527169910Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-12T21:52:22.796908621Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-12T21:52:22.807158599Z Waiting for performance profile collector pods to become ready: 7
2026-06-12T21:52:23.096693424Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-12T21:52:23.373638387Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-12T21:52:23.810142083Z Gathering data for ns/openshift-multus...
2026-06-12T21:52:23.910492046Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-12T21:52:24.121964620Z Collecting performance related data for node ip-10-0-133-229.ec2.internal
2026-06-12T21:52:24.128748447Z Collecting performance related data for node ip-10-0-137-209.ec2.internal
2026-06-12T21:52:24.135689011Z Collecting performance related data for node ip-10-0-128-93.ec2.internal
2026-06-12T21:52:25.268109074Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-12T21:52:26.525864453Z Gathering data for ns/openshift-host-network...
2026-06-12T21:52:26.878212063Z Gathering data for ns/openshift-network-diagnostics...
2026-06-12T21:52:27.379059650Z Gathering data for ns/openshift-network-node-identity...
2026-06-12T21:52:27.453783293Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T21:52:27.784897621Z Gathering data for ns/openshift-network-operator...
2026-06-12T21:52:28.126064746Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-12T21:52:28.397477981Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-12T21:52:28.864388225Z Gathering data for ns/openshift-apiserver-operator...
2026-06-12T21:52:29.157614675Z Gathering data for ns/openshift-apiserver...
2026-06-12T21:52:29.528299273Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-12T21:52:29.855399137Z Gathering data for ns/openshift-controller-manager...
2026-06-12T21:52:30.100413664Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-12T21:52:30.693428688Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-12T21:52:30.962088171Z Gathering data for ns/openshift-service-ca-operator...
2026-06-12T21:52:31.266138691Z Gathering data for ns/openshift-service-ca...
2026-06-12T21:52:31.586722385Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-12T21:52:32.022577703Z Collecting kubelet logs for node ip-10-0-133-229.ec2.internal
2026-06-12T21:52:32.024251750Z Collecting kubelet logs for node ip-10-0-137-209.ec2.internal
2026-06-12T21:52:32.025918628Z Collecting kubelet logs for node ip-10-0-128-93.ec2.internal
2026-06-12T21:52:32.348797193Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-jtn4b namespace
2026-06-12T21:52:32.354625917Z INFO: Node performance data collection complete.
2026-06-12T21:52:32.460324614Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T21:52:32.543994162Z Wrote inspect data to must-gather.
2026-06-12T21:52:32.544026219Z error: inspection completed with the errors occurred while gathering data:
2026-06-12T21:52:32.544026219Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-12T21:52:32.672385883Z error: the server doesn't have a resource type "clusters"
2026-06-12T21:52:32.808190939Z Caches written to disk