2026-06-09T14:58:25.436062452Z [disk usage checker] Started
2026-06-09T14:58:25.439695402Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T14:58:25.666425709Z Gathering data for ns/openshift-cluster-version...
2026-06-09T14:58:25.814128940Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-09T14:58:25.913279387Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-09T14:58:25.992227303Z Gathering data for ns/default...
2026-06-09T14:58:26.297405117Z Gathering data for ns/openshift...
2026-06-09T14:58:26.714766980Z Gathering data for ns/kube-system...
2026-06-09T14:58:27.352710620Z Gathering data for ns/openshift-etcd...
2026-06-09T14:58:27.625789688Z Wrote inspect data to must-gather.
2026-06-09T14:58:27.625822843Z error: inspection completed with the errors occurred while gathering data:
2026-06-09T14:58:27.625822843Z     namespaces "assisted-installer" not found
2026-06-09T14:58:28.042490507Z Waiting on subprocesses to finish execution.
2026-06-09T14:58:28.046153272Z INFO: Collecting host service logs for crio
2026-06-09T14:58:28.046426978Z INFO: Collecting host service logs for kubelet
2026-06-09T14:58:28.046809166Z INFO: Collecting host service logs for rpm-ostreed
2026-06-09T14:58:28.047166883Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-09T14:58:28.047529149Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-09T14:58:28.047907502Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-09T14:58:28.048283380Z INFO: Collecting host service logs for NetworkManager
2026-06-09T14:58:28.048650357Z INFO: Collecting host service logs for openvswitch
2026-06-09T14:58:28.049104399Z INFO: Collecting host service logs for ovs-configuration
2026-06-09T14:58:28.049489451Z INFO: Collecting host service logs for ovsdb-server
2026-06-09T14:58:28.049880521Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-09T14:58:28.050298328Z INFO: Waiting for worker host service log collection to complete ...
2026-06-09T14:58:28.051935896Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-09T14:58:28.058795351Z INFO: Gathering HAProxy config files
2026-06-09T14:58:28.060320129Z Executing Istio gather script
2026-06-09T14:58:28.089031104Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-09T14:58:28.120666552Z INFO: Waiting for node performance related collection to complete ...
2026-06-09T14:58:28.226895061Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-09T14:58:28.667039989Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-09T14:58:28.859226312Z No resources found
2026-06-09T14:58:29.163992100Z INFO: Worker host service log collection to complete.
2026-06-09T14:58:29.243390624Z INFO: Collecting Insights Archives from insights-operator-896549976-snxrt
2026-06-09T14:58:29.243390624Z insights-runtime-extractor-2vjxs
2026-06-09T14:58:29.243390624Z insights-runtime-extractor-g6tvn
2026-06-09T14:58:29.243390624Z insights-runtime-extractor-w4hv8
2026-06-09T14:58:29.299399397Z INFO: "metallb-operator" not detected. Skipping.
2026-06-09T14:58:29.414530339Z error: the server doesn't have a resource type "performanceprofile"
2026-06-09T14:58:29.501142675Z Wrote inspect data to must-gather.
2026-06-09T14:58:29.510654384Z Wrote inspect data to must-gather.
2026-06-09T14:58:29.518292838Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-09T14:58:29.594651083Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-09T14:58:29.596467580Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-09T14:58:29.619435938Z No resources found in openshift-etcd namespace.
2026-06-09T14:58:29.689652377Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-09T14:58:29.689652377Z See 'oc rsync -h' for help and examples
2026-06-09T14:58:29.801995469Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-09T14:58:29.802208356Z INFO: on-disk MachineConfig config collection complete.
2026-06-09T14:58:30.094013678Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-09T14:58:30.094918873Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-09T14:58:30.258290336Z ERROR: No running kube-apiserver pods found
2026-06-09T14:58:30.316178337Z INFO: 'previous-logs' folder not found on ip-10-0-129-18.ec2.internal, skipping...
2026-06-09T14:58:30.332931708Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-09T14:58:30.368535613Z Wrote inspect data to must-gather.
2026-06-09T14:58:30.404908675Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-09T14:58:30.456257685Z No resources found
2026-06-09T14:58:30.461895688Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T14:58:30.471221111Z Wrote inspect data to must-gather.
2026-06-09T14:58:30.543672278Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-09T14:58:30.580206124Z Gathering data for ns/openshift-monitoring...
2026-06-09T14:58:30.644228597Z Wrote inspect data to must-gather.
2026-06-09T14:58:30.697870519Z Wrote inspect data to must-gather.
2026-06-09T14:58:30.726498195Z Wrote inspect data to must-gather.
2026-06-09T14:58:30.736842008Z tar: Removing leading `/' from member names
2026-06-09T14:58:30.743099523Z INFO: HAProxy config collection complete.
2026-06-09T14:58:30.830205020Z INFO: 'previous-logs' folder not found on ip-10-0-135-90.ec2.internal, skipping...
2026-06-09T14:58:30.851089448Z Wrote inspect data to must-gather.
2026-06-09T14:58:30.873168186Z error: the server doesn't have a resource type "machineconfigs"
2026-06-09T14:58:31.000295837Z INFO: Getting rules from prometheus-k8s-0
2026-06-09T14:58:31.054081434Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-09T14:58:31.109514358Z INFO: 'previous-logs' folder not found on ip-10-0-139-190.ec2.internal, skipping...
2026-06-09T14:58:31.109643414Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-09T14:58:31.109667041Z INFO: Machine Config Daemon termination log collection complete.
2026-06-09T14:58:31.131348006Z Wrote inspect data to must-gather.
2026-06-09T14:58:31.280339664Z Wrote inspect data to must-gather.
2026-06-09T14:58:31.375101557Z Wrote inspect data to must-gather.
2026-06-09T14:58:31.405926766Z INFO: Getting status/config from prometheus-k8s-0
2026-06-09T14:58:31.430830973Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-09T14:58:31.641802485Z Wrote inspect data to must-gather.
2026-06-09T14:58:31.661846169Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-09T14:58:31.671204844Z INFO: INTERCONNECT MODE
2026-06-09T14:58:31.671245426Z INFO: Gathering ovn-kubernetes DBs
2026-06-09T14:58:31.801564019Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-09T14:58:31.844973894Z INFO: Gathering OVN_Northbound from ovnkube-node-5k6qx...
2026-06-09T14:58:31.845300485Z INFO: Gathering OVN_Northbound from ovnkube-node-76hrk...
2026-06-09T14:58:31.845536661Z INFO: Gathering OVN_Northbound from ovnkube-node-nc4z6...
2026-06-09T14:58:31.845807482Z INFO: Gathering OVN_Southbound from ovnkube-node-5k6qx...
2026-06-09T14:58:31.846050691Z INFO: Gathering OVN_Southbound from ovnkube-node-76hrk...
2026-06-09T14:58:31.846359516Z INFO: Gathering OVN_Southbound from ovnkube-node-nc4z6...
2026-06-09T14:58:31.852793772Z Wrote inspect data to must-gather.
2026-06-09T14:58:31.873529436Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:32.138313376Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-09T14:58:32.156629313Z tar: Removing leading `/' from member names
2026-06-09T14:58:32.158024629Z tar: Removing leading `/' from member names
2026-06-09T14:58:32.158192423Z tar: Removing leading `/' from member names
2026-06-09T14:58:32.169038982Z tar: Removing leading `/' from member names
2026-06-09T14:58:32.183249666Z tar: Removing leading `/' from member names
2026-06-09T14:58:32.231651841Z tar: Removing leading `/' from member names
2026-06-09T14:58:32.235527076Z Wrote inspect data to must-gather.
2026-06-09T14:58:32.272575008Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:32.275625222Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-09T14:58:32.382903848Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-09T14:58:32.438831124Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-09T14:58:32.483561976Z Wrote inspect data to must-gather.
2026-06-09T14:58:32.494088415Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:32.652595251Z INFO: Waiting for network log collection to complete ...
2026-06-09T14:58:32.652710030Z INFO: Waiting for ovnk database copies to complete ...
2026-06-09T14:58:32.653326404Z INFO: Copying ovnk databases complete.
2026-06-09T14:58:32.655815353Z 2.6M	must-gather/network_logs/ovnk_database_store
2026-06-09T14:58:32.658610590Z ovnk_database_store/
2026-06-09T14:58:32.658738124Z ovnk_database_store/ovnkube-node-76hrk_nbdb
2026-06-09T14:58:32.666486588Z ovnk_database_store/ovnkube-node-nc4z6_nbdb
2026-06-09T14:58:32.674093073Z ovnk_database_store/ovnkube-node-76hrk_sbdb
2026-06-09T14:58:32.692398231Z ovnk_database_store/ovnkube-node-5k6qx_nbdb
2026-06-09T14:58:32.699129610Z ovnk_database_store/ovnkube-node-5k6qx_sbdb
2026-06-09T14:58:32.703080286Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-09T14:58:32.715890550Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:32.718114801Z ovnk_database_store/ovnkube-node-nc4z6_sbdb
2026-06-09T14:58:32.718961464Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-09T14:58:32.734748792Z Wrote inspect data to must-gather.
2026-06-09T14:58:32.741824454Z INFO: Network log collection complete.
2026-06-09T14:58:32.913658621Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:32.916489048Z W0609 14:58:32.916450    1519 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-09T14:58:32.921259493Z Wrote inspect data to must-gather.
2026-06-09T14:58:33.029890338Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-09T14:58:33.114564314Z INFO: Getting status from alertmanager-main-0
2026-06-09T14:58:33.147517331Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:33.151310169Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-09T14:58:33.228426161Z Wrote inspect data to must-gather.
2026-06-09T14:58:33.229067310Z Gathering data for ns/openshift-network-console...
2026-06-09T14:58:33.378323927Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:33.495086157Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-09T14:58:33.497285614Z INFO: Fallback to identify the container image from release info
2026-06-09T14:58:33.588537684Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:33.590784521Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-09T14:58:33.669559600Z Gathering data for ns/openshift-console-operator...
2026-06-09T14:58:33.757794470Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:33.933455620Z Wrote inspect data to /must-gather/istio.
2026-06-09T14:58:34.036199301Z Gathering data for ns/openshift-console...
2026-06-09T14:58:34.211477830Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75a8fe9618bb81a42d565c535f20bf55d78662baa7f32548859596b4c5aa793e
2026-06-09T14:58:34.326270465Z daemonset.apps/perf-node-gather-daemonset created
2026-06-09T14:58:34.466381082Z Waiting for performance profile collector pods to become ready: 1
2026-06-09T14:58:34.609281743Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-09T14:58:34.645079587Z Done executing Istio gather script
2026-06-09T14:58:35.075185032Z Gathering data for ns/openshift-dns-operator...
2026-06-09T14:58:35.308418757Z Gathering data for ns/openshift-dns...
2026-06-09T14:58:35.472697487Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T14:58:35.586017127Z Waiting for performance profile collector pods to become ready: 2
2026-06-09T14:58:35.915212346Z Gathering data for ns/openshift-image-registry...
2026-06-09T14:58:36.358828016Z Gathering data for ns/openshift-ingress-operator...
2026-06-09T14:58:36.663268496Z Gathering data for ns/openshift-ingress...
2026-06-09T14:58:36.705419314Z Waiting for performance profile collector pods to become ready: 3
2026-06-09T14:58:36.963287607Z Gathering data for ns/openshift-ingress-canary...
2026-06-09T14:58:37.409246870Z Gathering data for ns/openshift-insights...
2026-06-09T14:58:37.807010568Z Waiting for performance profile collector pods to become ready: 4
2026-06-09T14:58:38.932785154Z Waiting for performance profile collector pods to become ready: 5
2026-06-09T14:58:39.217482978Z Gathering data for ns/openshift-config...
2026-06-09T14:58:39.554644924Z Gathering data for ns/openshift-config-managed...
2026-06-09T14:58:39.952197570Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-09T14:58:40.053592171Z Waiting for performance profile collector pods to become ready: 6
2026-06-09T14:58:40.236056917Z Gathering data for ns/openshift-kube-apiserver...
2026-06-09T14:58:40.477674497Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T14:58:40.479261398Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-09T14:58:40.747589813Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-09T14:58:41.007420434Z Gathering data for ns/openshift-kube-scheduler...
2026-06-09T14:58:41.151162146Z Waiting for performance profile collector pods to become ready: 7
2026-06-09T14:58:41.269637102Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-09T14:58:41.521480162Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-09T14:58:41.810165471Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-09T14:58:42.108712528Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-09T14:58:42.252321683Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-09T14:58:42.502995592Z Collecting performance related data for node ip-10-0-135-90.ec2.internal
2026-06-09T14:58:42.514657655Z Collecting performance related data for node ip-10-0-139-190.ec2.internal
2026-06-09T14:58:42.524752279Z Collecting performance related data for node ip-10-0-129-18.ec2.internal
2026-06-09T14:58:42.661092860Z Gathering data for ns/openshift-multus...
2026-06-09T14:58:44.240629114Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-09T14:58:45.483840821Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T14:58:45.594342264Z Gathering data for ns/openshift-host-network...
2026-06-09T14:58:45.941785315Z Gathering data for ns/openshift-network-diagnostics...
2026-06-09T14:58:46.570144377Z Gathering data for ns/openshift-network-node-identity...
2026-06-09T14:58:47.016118915Z Gathering data for ns/openshift-network-operator...
2026-06-09T14:58:47.408570850Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-09T14:58:47.786228779Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-09T14:58:48.221218399Z Gathering data for ns/openshift-apiserver-operator...
2026-06-09T14:58:48.492576349Z Gathering data for ns/openshift-apiserver...
2026-06-09T14:58:48.833976376Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-09T14:58:49.071897069Z Gathering data for ns/openshift-controller-manager...
2026-06-09T14:58:49.323985957Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-09T14:58:49.926083485Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-09T14:58:50.173979373Z Gathering data for ns/openshift-service-ca-operator...
2026-06-09T14:58:50.469534048Z Gathering data for ns/openshift-service-ca...
2026-06-09T14:58:50.488810291Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-09T14:58:50.673948412Z Collecting kubelet logs for node ip-10-0-135-90.ec2.internal
2026-06-09T14:58:50.677185368Z Collecting kubelet logs for node ip-10-0-139-190.ec2.internal
2026-06-09T14:58:50.679088381Z Collecting kubelet logs for node ip-10-0-129-18.ec2.internal
2026-06-09T14:58:50.830969798Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-09T14:58:50.999659586Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-r24xc namespace
2026-06-09T14:58:51.003791625Z INFO: Node performance data collection complete.
2026-06-09T14:58:51.654563632Z Wrote inspect data to must-gather.
2026-06-09T14:58:51.654620251Z error: inspection completed with the errors occurred while gathering data:
2026-06-09T14:58:51.654620251Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-09T14:58:51.772431677Z error: the server doesn't have a resource type "clusters"
2026-06-09T14:58:51.901268428Z Caches written to disk