2026-06-11T09:05:11.556643283Z [disk usage checker] Started
2026-06-11T09:05:11.560849625Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-11T09:05:11.746528249Z Gathering data for ns/openshift-cluster-version...
2026-06-11T09:05:11.879146248Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-11T09:05:11.993499087Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-11T09:05:12.073853882Z Gathering data for ns/default...
2026-06-11T09:05:12.399507548Z Gathering data for ns/openshift...
2026-06-11T09:05:12.867405046Z Gathering data for ns/kube-system...
2026-06-11T09:05:13.611555794Z Gathering data for ns/openshift-etcd...
2026-06-11T09:05:13.909788640Z Wrote inspect data to must-gather.
2026-06-11T09:05:13.909823623Z error: inspection completed with the errors occurred while gathering data:
2026-06-11T09:05:13.909823623Z     namespaces "assisted-installer" not found
2026-06-11T09:05:14.095451056Z Waiting on subprocesses to finish execution.
2026-06-11T09:05:14.106727430Z INFO: Collecting host service logs for crio
2026-06-11T09:05:14.107142527Z INFO: Collecting host service logs for kubelet
2026-06-11T09:05:14.107478159Z INFO: Collecting host service logs for rpm-ostreed
2026-06-11T09:05:14.107976609Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-11T09:05:14.109243064Z INFO: Gathering HAProxy config files
2026-06-11T09:05:14.109677127Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-11T09:05:14.110129791Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-11T09:05:14.110487241Z INFO: Collecting host service logs for NetworkManager
2026-06-11T09:05:14.110828675Z INFO: Collecting host service logs for openvswitch
2026-06-11T09:05:14.111186667Z INFO: Collecting host service logs for ovs-configuration
2026-06-11T09:05:14.111536922Z INFO: Collecting host service logs for ovsdb-server
2026-06-11T09:05:14.111923198Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-11T09:05:14.112361300Z INFO: Waiting for worker host service log collection to complete ...
2026-06-11T09:05:14.114206557Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-11T09:05:14.117141012Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-11T09:05:14.133787107Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-11T09:05:14.205387106Z Executing Istio gather script
2026-06-11T09:05:14.265279744Z INFO: Waiting for node performance related collection to complete ...
2026-06-11T09:05:14.696571691Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-11T09:05:14.696604950Z INFO: on-disk MachineConfig config collection complete.
2026-06-11T09:05:14.780788573Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-11T09:05:15.017967392Z INFO: "metallb-operator" not detected. Skipping.
2026-06-11T09:05:15.075588191Z No resources found in openshift-etcd namespace.
2026-06-11T09:05:15.094110355Z INFO: Collecting Insights Archives from insights-operator-896549976-zf56w
2026-06-11T09:05:15.094165376Z insights-runtime-extractor-75fjj
2026-06-11T09:05:15.094185749Z insights-runtime-extractor-77tv8
2026-06-11T09:05:15.094206218Z insights-runtime-extractor-zm4vp
2026-06-11T09:05:15.141778936Z No resources found
2026-06-11T09:05:15.166178036Z error: the server doesn't have a resource type "performanceprofile"
2026-06-11T09:05:15.322053686Z Wrote inspect data to must-gather.
2026-06-11T09:05:15.365487256Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-11T09:05:15.632281827Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-11T09:05:15.673024354Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-11T09:05:15.680801004Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-11T09:05:15.680801004Z See 'oc rsync -h' for help and examples
2026-06-11T09:05:15.718716499Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-11T09:05:15.806683312Z INFO: Worker host service log collection to complete.
2026-06-11T09:05:15.870692702Z INFO: 'previous-logs' folder not found on ip-10-0-128-166.ec2.internal, skipping...
2026-06-11T09:05:15.955051639Z ERROR: No running kube-apiserver pods found
2026-06-11T09:05:16.047447678Z Wrote inspect data to must-gather.
2026-06-11T09:05:16.127709213Z tar: Removing leading `/' from member names
2026-06-11T09:05:16.132723566Z INFO: HAProxy config collection complete.
2026-06-11T09:05:16.249377352Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-11T09:05:16.270106114Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-11T09:05:16.419508188Z Wrote inspect data to must-gather.
2026-06-11T09:05:16.451564516Z Gathering data for ns/openshift-monitoring...
2026-06-11T09:05:16.522361897Z error: the server doesn't have a resource type "machineconfigs"
2026-06-11T09:05:16.548455919Z Wrote inspect data to must-gather.
2026-06-11T09:05:16.649054786Z Wrote inspect data to must-gather.
2026-06-11T09:05:16.650213009Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-11T09:05:16.650935951Z No resources found
2026-06-11T09:05:16.668451284Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-11T09:05:16.674258682Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-11T09:05:16.728990338Z Wrote inspect data to must-gather.
2026-06-11T09:05:16.865179247Z INFO: 'previous-logs' folder not found on ip-10-0-133-186.ec2.internal, skipping...
2026-06-11T09:05:16.884381536Z Wrote inspect data to must-gather.
2026-06-11T09:05:16.892616314Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-11T09:05:17.021941578Z Wrote inspect data to must-gather.
2026-06-11T09:05:17.132573835Z Wrote inspect data to must-gather.
2026-06-11T09:05:17.136850864Z INFO: 'previous-logs' folder not found on ip-10-0-142-180.ec2.internal, skipping...
2026-06-11T09:05:17.136890110Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-11T09:05:17.136922755Z INFO: Machine Config Daemon termination log collection complete.
2026-06-11T09:05:17.137730462Z INFO: Getting rules from prometheus-k8s-0
2026-06-11T09:05:17.266261552Z Wrote inspect data to must-gather.
2026-06-11T09:05:17.280127518Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-11T09:05:17.490951822Z Wrote inspect data to must-gather.
2026-06-11T09:05:17.509942192Z Wrote inspect data to must-gather.
2026-06-11T09:05:17.517088660Z INFO: Getting status/config from prometheus-k8s-0
2026-06-11T09:05:17.691314229Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-11T09:05:17.692403147Z Wrote inspect data to must-gather.
2026-06-11T09:05:17.770005664Z INFO: INTERCONNECT MODE
2026-06-11T09:05:17.770051669Z INFO: Gathering ovn-kubernetes DBs
2026-06-11T09:05:17.895201826Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:17.917269429Z Wrote inspect data to must-gather.
2026-06-11T09:05:17.928880963Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-11T09:05:17.950888226Z INFO: Gathering OVN_Northbound from ovnkube-node-5t5s4...
2026-06-11T09:05:17.951200430Z INFO: Gathering OVN_Northbound from ovnkube-node-gxm6m...
2026-06-11T09:05:17.951473713Z INFO: Gathering OVN_Northbound from ovnkube-node-h9l6d...
2026-06-11T09:05:17.951928039Z INFO: Gathering OVN_Southbound from ovnkube-node-5t5s4...
2026-06-11T09:05:17.952224052Z INFO: Gathering OVN_Southbound from ovnkube-node-gxm6m...
2026-06-11T09:05:17.952492974Z INFO: Gathering OVN_Southbound from ovnkube-node-h9l6d...
2026-06-11T09:05:18.032338314Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-11T09:05:18.256789891Z Wrote inspect data to must-gather.
2026-06-11T09:05:18.272479638Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:18.275657324Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-11T09:05:18.290522935Z tar: Removing leading `/' from member names
2026-06-11T09:05:18.313728645Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-11T09:05:18.347427033Z tar: Removing leading `/' from member names
2026-06-11T09:05:18.347427033Z tar: Removing leading `/' from member names
2026-06-11T09:05:18.347466001Z tar: Removing leading `/' from member names
2026-06-11T09:05:18.356720252Z tar: Removing leading `/' from member names
2026-06-11T09:05:18.365119727Z tar: Removing leading `/' from member names
2026-06-11T09:05:18.512958101Z Wrote inspect data to must-gather.
2026-06-11T09:05:18.525953387Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:18.601735311Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-11T09:05:18.758347516Z W0611 09:05:18.758289    1452 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-11T09:05:18.765726676Z Wrote inspect data to must-gather.
2026-06-11T09:05:18.771419676Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:18.774312842Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-11T09:05:18.848290439Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-11T09:05:18.877101326Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-11T09:05:18.878793020Z INFO: Waiting for network log collection to complete ...
2026-06-11T09:05:18.878848833Z INFO: Waiting for ovnk database copies to complete ...
2026-06-11T09:05:18.879525709Z INFO: Copying ovnk databases complete.
2026-06-11T09:05:18.881553238Z 2.6M	must-gather/network_logs/ovnk_database_store
2026-06-11T09:05:18.884715303Z ovnk_database_store/
2026-06-11T09:05:18.884765081Z ovnk_database_store/ovnkube-node-5t5s4_sbdb
2026-06-11T09:05:18.906807791Z ovnk_database_store/ovnkube-node-gxm6m_sbdb
2026-06-11T09:05:18.923240146Z ovnk_database_store/ovnkube-node-5t5s4_nbdb
2026-06-11T09:05:18.930657910Z ovnk_database_store/ovnkube-node-gxm6m_nbdb
2026-06-11T09:05:18.939593276Z ovnk_database_store/ovnkube-node-h9l6d_sbdb
2026-06-11T09:05:18.956110936Z ovnk_database_store/ovnkube-node-h9l6d_nbdb
2026-06-11T09:05:18.967118669Z INFO: Network log collection complete.
2026-06-11T09:05:18.986820564Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:19.059151660Z Gathering data for ns/openshift-network-console...
2026-06-11T09:05:19.088819117Z Wrote inspect data to must-gather.
2026-06-11T09:05:19.195120988Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:19.197473213Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-11T09:05:19.276339000Z INFO: Getting status from alertmanager-main-0
2026-06-11T09:05:19.363614715Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-11T09:05:19.367350500Z INFO: Fallback to identify the container image from release info
2026-06-11T09:05:19.441354818Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:19.610500360Z Gathering data for ns/openshift-console-operator...
2026-06-11T09:05:19.629348680Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:19.631393516Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-11T09:05:19.783055509Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:19.957174401Z Wrote inspect data to /must-gather/istio.
2026-06-11T09:05:20.017575428Z Gathering data for ns/openshift-console...
2026-06-11T09:05:20.088915475Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75a8fe9618bb81a42d565c535f20bf55d78662baa7f32548859596b4c5aa793e
2026-06-11T09:05:20.213290464Z daemonset.apps/perf-node-gather-daemonset created
2026-06-11T09:05:20.332641683Z Waiting for performance profile collector pods to become ready: 1
2026-06-11T09:05:20.638920293Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-11T09:05:20.641397425Z Done executing Istio gather script
2026-06-11T09:05:21.127033276Z Gathering data for ns/openshift-dns-operator...
2026-06-11T09:05:21.454352089Z Waiting for performance profile collector pods to become ready: 2
2026-06-11T09:05:21.464321000Z Gathering data for ns/openshift-dns...
2026-06-11T09:05:21.684648339Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-11T09:05:22.143394010Z Gathering data for ns/openshift-image-registry...
2026-06-11T09:05:22.566486582Z Waiting for performance profile collector pods to become ready: 3
2026-06-11T09:05:22.601422207Z Gathering data for ns/openshift-ingress-operator...
2026-06-11T09:05:22.897270480Z Gathering data for ns/openshift-ingress...
2026-06-11T09:05:23.230952387Z Gathering data for ns/openshift-ingress-canary...
2026-06-11T09:05:23.662421609Z Gathering data for ns/openshift-insights...
2026-06-11T09:05:23.684946379Z Waiting for performance profile collector pods to become ready: 4
2026-06-11T09:05:24.792570437Z Waiting for performance profile collector pods to become ready: 5
2026-06-11T09:05:25.551524182Z Gathering data for ns/openshift-config...
2026-06-11T09:05:25.815259140Z Gathering data for ns/openshift-config-managed...
2026-06-11T09:05:25.912855055Z Waiting for performance profile collector pods to become ready: 6
2026-06-11T09:05:26.260790173Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-11T09:05:26.562855963Z Gathering data for ns/openshift-kube-apiserver...
2026-06-11T09:05:26.689283035Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-11T09:05:26.834643935Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-11T09:05:27.018387973Z Waiting for performance profile collector pods to become ready: 7
2026-06-11T09:05:27.140839589Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-11T09:05:27.411498693Z Gathering data for ns/openshift-kube-scheduler...
2026-06-11T09:05:27.759211598Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-11T09:05:28.100089727Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-11T09:05:28.132404251Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-11T09:05:28.377269891Z Collecting performance related data for node ip-10-0-128-166.ec2.internal
2026-06-11T09:05:28.385903754Z Collecting performance related data for node ip-10-0-142-180.ec2.internal
2026-06-11T09:05:28.395279288Z Collecting performance related data for node ip-10-0-133-186.ec2.internal
2026-06-11T09:05:28.470746243Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-11T09:05:28.822464106Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-11T09:05:29.388843968Z Gathering data for ns/openshift-multus...
2026-06-11T09:05:30.797266127Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-11T09:05:31.694006641Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-11T09:05:32.089848503Z Gathering data for ns/openshift-host-network...
2026-06-11T09:05:32.439841609Z Gathering data for ns/openshift-network-diagnostics...
2026-06-11T09:05:32.962273877Z Gathering data for ns/openshift-network-node-identity...
2026-06-11T09:05:33.377223178Z Gathering data for ns/openshift-network-operator...
2026-06-11T09:05:33.757556201Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-11T09:05:34.021890956Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-11T09:05:34.470106262Z Gathering data for ns/openshift-apiserver-operator...
2026-06-11T09:05:34.801281929Z Gathering data for ns/openshift-apiserver...
2026-06-11T09:05:35.193131360Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-11T09:05:35.448346079Z Gathering data for ns/openshift-controller-manager...
2026-06-11T09:05:35.748094063Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-11T09:05:36.304854982Z Collecting kubelet logs for node ip-10-0-128-166.ec2.internal
2026-06-11T09:05:36.306730133Z Collecting kubelet logs for node ip-10-0-142-180.ec2.internal
2026-06-11T09:05:36.308873601Z Collecting kubelet logs for node ip-10-0-133-186.ec2.internal
2026-06-11T09:05:36.441435810Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-11T09:05:36.611965902Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-zxnvr namespace
2026-06-11T09:05:36.616695083Z INFO: Node performance data collection complete.
2026-06-11T09:05:36.700342366Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-11T09:05:36.838270495Z Gathering data for ns/openshift-service-ca-operator...
2026-06-11T09:05:37.162113135Z Gathering data for ns/openshift-service-ca...
2026-06-11T09:05:37.504120809Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-11T09:05:38.377999991Z Wrote inspect data to must-gather.
2026-06-11T09:05:38.378046201Z error: inspection completed with the errors occurred while gathering data:
2026-06-11T09:05:38.378046201Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-11T09:05:38.493675604Z error: the server doesn't have a resource type "clusters"
2026-06-11T09:05:38.615663249Z Caches written to disk