2026-09-18T13:39:14.780884858Z [disk usage checker] Started
2026-09-18T13:39:14.784134575Z [disk usage checker] Volume usage percentage: current = 47 ; allowed = 70
2026-09-18T13:39:15.213853831Z Gathering data for ns/openshift-cluster-version...
2026-09-18T13:39:15.360993814Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T13:39:15.451736921Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T13:39:15.579841625Z Gathering data for ns/default...
2026-09-18T13:39:15.881316063Z Gathering data for ns/openshift...
2026-09-18T13:39:16.271155284Z Gathering data for ns/kube-system...
2026-09-18T13:39:17.020498607Z Gathering data for ns/openshift-etcd...
2026-09-18T13:39:17.415106089Z Wrote inspect data to must-gather.
2026-09-18T13:39:17.415139220Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T13:39:17.415139220Z     namespaces "assisted-installer" not found
2026-09-18T13:39:17.554217910Z Waiting on subprocesses to finish execution.
2026-09-18T13:39:17.561148743Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-18T13:39:17.564698247Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-18T13:39:17.564882472Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-18T13:39:17.568236942Z INFO: Gathering HAProxy config files
2026-09-18T13:39:17.580764476Z INFO: Collecting host service logs for crio
2026-09-18T13:39:17.581124127Z INFO: Collecting host service logs for kubelet
2026-09-18T13:39:17.581455483Z INFO: Collecting host service logs for rpm-ostreed
2026-09-18T13:39:17.581795323Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-18T13:39:17.582126894Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-18T13:39:17.582452759Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-18T13:39:17.582805861Z INFO: Collecting host service logs for NetworkManager
2026-09-18T13:39:17.583146037Z INFO: Collecting host service logs for openvswitch
2026-09-18T13:39:17.583505703Z INFO: Collecting host service logs for ovs-configuration
2026-09-18T13:39:17.583926990Z INFO: Collecting host service logs for ovsdb-server
2026-09-18T13:39:17.584336512Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-18T13:39:17.585399208Z INFO: Waiting for worker host service log collection to complete ...
2026-09-18T13:39:17.589468346Z Executing Istio gather script
2026-09-18T13:39:17.620466141Z INFO: Waiting for node performance related collection to complete ...
2026-09-18T13:39:17.999493473Z No resources found
2026-09-18T13:39:18.218156405Z INFO: "metallb-operator" not detected. Skipping.
2026-09-18T13:39:18.285512399Z Wrote inspect data to must-gather.
2026-09-18T13:39:18.302174613Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-18T13:39:18.427206326Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-18T13:39:18.457627419Z No resources found in openshift-etcd namespace.
2026-09-18T13:39:18.509633681Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-18T13:39:18.509727286Z INFO: on-disk MachineConfig config collection complete.
2026-09-18T13:39:18.705044095Z error: the server doesn't have a resource type "performanceprofile"
2026-09-18T13:39:18.829117867Z INFO: Collecting Insights Archives from insights-operator-6f9c644dd9-6xb8r
2026-09-18T13:39:18.829189186Z insights-runtime-extractor-5s72c
2026-09-18T13:39:18.829209059Z insights-runtime-extractor-vghsw
2026-09-18T13:39:18.829228187Z insights-runtime-extractor-vz2tt
2026-09-18T13:39:18.841957769Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-18T13:39:18.937559104Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-18T13:39:19.001405704Z ERROR: No running kube-apiserver pods found
2026-09-18T13:39:19.024848374Z INFO: Worker host service log collection to complete.
2026-09-18T13:39:19.177535482Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-18T13:39:19.345131115Z No resources found
2026-09-18T13:39:19.376932157Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-18T13:39:19.470627633Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-18T13:39:19.470940308Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T13:39:19.503952309Z Wrote inspect data to must-gather.
2026-09-18T13:39:19.545084073Z INFO: 'previous-logs' folder not found on ip-10-0-129-232.ec2.internal, skipping...
2026-09-18T13:39:19.787268607Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-18T13:39:19.787268607Z See 'oc rsync -h' for help and examples
2026-09-18T13:39:19.806938941Z [disk usage checker] Volume usage percentage: current = 47 ; allowed = 70
2026-09-18T13:39:19.866342080Z Gathering data for ns/openshift-monitoring...
2026-09-18T13:39:19.870850870Z Wrote inspect data to must-gather.
2026-09-18T13:39:19.924020509Z error: the server doesn't have a resource type "machineconfigs"
2026-09-18T13:39:20.024136133Z Wrote inspect data to must-gather.
2026-09-18T13:39:20.040782868Z Wrote inspect data to must-gather.
2026-09-18T13:39:20.076767877Z Wrote inspect data to must-gather.
2026-09-18T13:39:20.078269360Z Wrote inspect data to must-gather.
2026-09-18T13:39:20.115556072Z tar: Removing leading `/' from member names
2026-09-18T13:39:20.123351278Z INFO: HAProxy config collection complete.
2026-09-18T13:39:20.195683480Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-18T13:39:20.246022233Z INFO: 'previous-logs' folder not found on ip-10-0-136-52.ec2.internal, skipping...
2026-09-18T13:39:20.396964959Z Wrote inspect data to must-gather.
2026-09-18T13:39:20.440677107Z INFO: Getting rules from prometheus-k8s-0
2026-09-18T13:39:20.484590869Z Wrote inspect data to must-gather.
2026-09-18T13:39:20.531833396Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-18T13:39:20.561898321Z INFO: 'previous-logs' folder not found on ip-10-0-139-48.ec2.internal, skipping...
2026-09-18T13:39:20.561997702Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-18T13:39:20.562046692Z INFO: Machine Config Daemon termination log collection complete.
2026-09-18T13:39:20.653844240Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-18T13:39:20.679879435Z Wrote inspect data to must-gather.
2026-09-18T13:39:20.854615629Z INFO: Getting status/config from prometheus-k8s-0
2026-09-18T13:39:20.903343072Z Wrote inspect data to must-gather.
2026-09-18T13:39:20.939120590Z Wrote inspect data to must-gather.
2026-09-18T13:39:21.126923211Z Wrote inspect data to must-gather.
2026-09-18T13:39:21.225480166Z INFO: INTERCONNECT MODE
2026-09-18T13:39:21.225577482Z INFO: Gathering ovn-kubernetes DBs
2026-09-18T13:39:21.264617236Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-18T13:39:21.350568941Z Wrote inspect data to must-gather.
2026-09-18T13:39:21.394011226Z INFO: Gathering OVN_Northbound from ovnkube-node-7q2dm...
2026-09-18T13:39:21.394278346Z INFO: Gathering OVN_Northbound from ovnkube-node-8767g...
2026-09-18T13:39:21.394579439Z INFO: Gathering OVN_Northbound from ovnkube-node-lsq6h...
2026-09-18T13:39:21.394921662Z INFO: Gathering OVN_Southbound from ovnkube-node-7q2dm...
2026-09-18T13:39:21.395214925Z INFO: Gathering OVN_Southbound from ovnkube-node-8767g...
2026-09-18T13:39:21.395485705Z INFO: Gathering OVN_Southbound from ovnkube-node-lsq6h...
2026-09-18T13:39:21.504356275Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-18T13:39:21.578233168Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-18T13:39:21.708622284Z tar: Removing leading `/' from member names
2026-09-18T13:39:21.746809229Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-18T13:39:21.752922136Z Wrote inspect data to must-gather.
2026-09-18T13:39:21.766823405Z tar: Removing leading `/' from member names
2026-09-18T13:39:21.776641832Z tar: Removing leading `/' from member names
2026-09-18T13:39:21.793952572Z tar: Removing leading `/' from member names
2026-09-18T13:39:21.833158036Z tar: Removing leading `/' from member names
2026-09-18T13:39:21.840675780Z tar: Removing leading `/' from member names
2026-09-18T13:39:21.855643890Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:21.973661136Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-18T13:39:22.031361494Z Wrote inspect data to must-gather.
2026-09-18T13:39:22.142603627Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:22.145734613Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-18T13:39:22.244253624Z INFO: Waiting for network log collection to complete ...
2026-09-18T13:39:22.244287483Z INFO: Waiting for ovnk database copies to complete ...
2026-09-18T13:39:22.244655836Z INFO: Copying ovnk databases complete.
2026-09-18T13:39:22.246199944Z 3.3M	must-gather/network_logs/ovnk_database_store
2026-09-18T13:39:22.248170316Z ovnk_database_store/
2026-09-18T13:39:22.248220400Z ovnk_database_store/ovnkube-node-8767g_nbdb
2026-09-18T13:39:22.258645126Z ovnk_database_store/ovnkube-node-7q2dm_sbdb
2026-09-18T13:39:22.268361996Z Wrote inspect data to must-gather.
2026-09-18T13:39:22.279765376Z ovnk_database_store/ovnkube-node-7q2dm_nbdb
2026-09-18T13:39:22.281493570Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-18T13:39:22.287712820Z ovnk_database_store/ovnkube-node-8767g_sbdb
2026-09-18T13:39:22.307514687Z ovnk_database_store/ovnkube-node-lsq6h_sbdb
2026-09-18T13:39:22.330611168Z ovnk_database_store/ovnkube-node-lsq6h_nbdb
2026-09-18T13:39:22.343759626Z INFO: Network log collection complete.
2026-09-18T13:39:22.360815083Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:22.469751996Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-18T13:39:22.572814306Z Wrote inspect data to must-gather.
2026-09-18T13:39:22.578841886Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:22.581356638Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-18T13:39:22.667606190Z Gathering data for ns/openshift-network-console...
2026-09-18T13:39:22.706595133Z INFO: Getting status from alertmanager-main-0
2026-09-18T13:39:22.805470376Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:22.860113473Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-18T13:39:22.863105129Z INFO: Fallback to identify the container image from release info
2026-09-18T13:39:23.002871028Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:23.007377476Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-18T13:39:23.228476452Z Gathering data for ns/openshift-console-operator...
2026-09-18T13:39:23.237598233Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:23.436926954Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:23.440134649Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-18T13:39:23.457665485Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea
2026-09-18T13:39:23.587203357Z daemonset.apps/perf-node-gather-daemonset created
2026-09-18T13:39:23.624437156Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:23.650147678Z Gathering data for ns/openshift-console...
2026-09-18T13:39:23.718858088Z Waiting for performance profile collector pods to become ready: 1
2026-09-18T13:39:23.824386153Z Wrote inspect data to /must-gather/istio.
2026-09-18T13:39:24.196021812Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-18T13:39:24.494308738Z Done executing Istio gather script
2026-09-18T13:39:24.685406246Z Gathering data for ns/openshift-dns-operator...
2026-09-18T13:39:24.813979325Z [disk usage checker] Volume usage percentage: current = 47 ; allowed = 70
2026-09-18T13:39:24.830321066Z Waiting for performance profile collector pods to become ready: 2
2026-09-18T13:39:24.962042967Z Gathering data for ns/openshift-dns...
2026-09-18T13:39:25.554297004Z Gathering data for ns/openshift-image-registry...
2026-09-18T13:39:25.947657495Z Waiting for performance profile collector pods to become ready: 3
2026-09-18T13:39:26.025294963Z Gathering data for ns/openshift-ingress-operator...
2026-09-18T13:39:26.342626266Z Gathering data for ns/openshift-ingress...
2026-09-18T13:39:26.684140065Z Gathering data for ns/openshift-ingress-canary...
2026-09-18T13:39:27.076747512Z Waiting for performance profile collector pods to become ready: 4
2026-09-18T13:39:27.086021622Z Gathering data for ns/openshift-insights...
2026-09-18T13:39:28.178980026Z Waiting for performance profile collector pods to become ready: 5
2026-09-18T13:39:28.921011883Z Gathering data for ns/openshift-jobset-operator...
2026-09-18T13:39:29.292081750Z Waiting for performance profile collector pods to become ready: 6
2026-09-18T13:39:29.754194165Z Gathering data for ns/openshift-config...
2026-09-18T13:39:29.818975972Z [disk usage checker] Volume usage percentage: current = 47 ; allowed = 70
2026-09-18T13:39:30.016788993Z Gathering data for ns/openshift-config-managed...
2026-09-18T13:39:30.413322134Z Waiting for performance profile collector pods to become ready: 7
2026-09-18T13:39:30.497379602Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-18T13:39:30.749619344Z Gathering data for ns/openshift-kube-apiserver...
2026-09-18T13:39:31.002696142Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-18T13:39:31.288232352Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-18T13:39:31.544334254Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-18T13:39:31.575980631Z Gathering data for ns/openshift-kube-scheduler...
2026-09-18T13:39:31.826531682Z Collecting performance related data for node ip-10-0-129-232.ec2.internal
2026-09-18T13:39:31.835328300Z Collecting performance related data for node ip-10-0-136-52.ec2.internal
2026-09-18T13:39:31.844657052Z Collecting performance related data for node ip-10-0-139-48.ec2.internal
2026-09-18T13:39:31.857388477Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-18T13:39:32.201843899Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-18T13:39:32.595911418Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-18T13:39:32.999330742Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-18T13:39:33.592422514Z Gathering data for ns/openshift-multus...
2026-09-18T13:39:34.825277620Z [disk usage checker] Volume usage percentage: current = 47 ; allowed = 70
2026-09-18T13:39:35.187161286Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-18T13:39:36.544664668Z Gathering data for ns/openshift-host-network...
2026-09-18T13:39:36.878218574Z Gathering data for ns/openshift-network-diagnostics...
2026-09-18T13:39:37.479884243Z Gathering data for ns/openshift-network-node-identity...
2026-09-18T13:39:37.950070220Z Gathering data for ns/openshift-network-operator...
2026-09-18T13:39:38.341973283Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-18T13:39:38.608587537Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-18T13:39:39.112852781Z Gathering data for ns/openshift-apiserver-operator...
2026-09-18T13:39:39.399633738Z Gathering data for ns/openshift-apiserver...
2026-09-18T13:39:39.782927025Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-18T13:39:39.832332224Z [disk usage checker] Volume usage percentage: current = 47 ; allowed = 70
2026-09-18T13:39:40.028431077Z Gathering data for ns/openshift-controller-manager...
2026-09-18T13:39:40.337398614Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-18T13:39:40.882411961Z Collecting kubelet logs for node ip-10-0-129-232.ec2.internal
2026-09-18T13:39:40.884065314Z Collecting kubelet logs for node ip-10-0-136-52.ec2.internal
2026-09-18T13:39:40.885693849Z Collecting kubelet logs for node ip-10-0-139-48.ec2.internal
2026-09-18T13:39:41.057075177Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-18T13:39:41.236006789Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-4r6kb namespace
2026-09-18T13:39:41.241327315Z INFO: Node performance data collection complete.
2026-09-18T13:39:41.403540771Z Gathering data for ns/openshift-service-ca-operator...
2026-09-18T13:39:41.739256294Z Gathering data for ns/openshift-service-ca...
2026-09-18T13:39:42.082763968Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-18T13:39:42.983551398Z Wrote inspect data to must-gather.
2026-09-18T13:39:42.983596194Z error: inspection completed with the errors occurred while gathering data:
2026-09-18T13:39:42.983596194Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-18T13:39:43.105160035Z error: the server doesn't have a resource type "clusters"
2026-09-18T13:39:43.230890502Z Caches written to disk