2026-09-09T10:18:16.230157070Z [disk usage checker] Started
2026-09-09T10:18:16.233878769Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T10:18:16.419103179Z Gathering data for ns/openshift-cluster-version...
2026-09-09T10:18:16.556564396Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-09T10:18:16.642591648Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-09T10:18:16.727059087Z Gathering data for ns/default...
2026-09-09T10:18:17.009810801Z Gathering data for ns/openshift...
2026-09-09T10:18:17.396301777Z Gathering data for ns/kube-system...
2026-09-09T10:18:18.092852475Z Gathering data for ns/openshift-etcd...
2026-09-09T10:18:18.390341736Z Wrote inspect data to must-gather.
2026-09-09T10:18:18.390374444Z error: inspection completed with the errors occurred while gathering data:
2026-09-09T10:18:18.390374444Z     namespaces "assisted-installer" not found
2026-09-09T10:18:18.724411552Z Waiting on subprocesses to finish execution.
2026-09-09T10:18:18.729428993Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-09-09T10:18:18.745201555Z Executing Istio gather script
2026-09-09T10:18:18.745785047Z INFO: Gathering machine config daemon's old logs from all nodes
2026-09-09T10:18:18.749488142Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-09-09T10:18:18.752081221Z INFO: Gathering HAProxy config files
2026-09-09T10:18:18.787955759Z INFO: Collecting host service logs for crio
2026-09-09T10:18:18.788307864Z INFO: Collecting host service logs for kubelet
2026-09-09T10:18:18.788636972Z INFO: Collecting host service logs for rpm-ostreed
2026-09-09T10:18:18.788968407Z INFO: Collecting host service logs for ostree-finalize-staged
2026-09-09T10:18:18.789296976Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-09-09T10:18:18.789593540Z INFO: Collecting host service logs for machine-config-daemon-host
2026-09-09T10:18:18.789928326Z INFO: Collecting host service logs for NetworkManager
2026-09-09T10:18:18.790233812Z INFO: Collecting host service logs for openvswitch
2026-09-09T10:18:18.790528399Z INFO: Collecting host service logs for ovs-configuration
2026-09-09T10:18:18.790849636Z INFO: Collecting host service logs for ovsdb-server
2026-09-09T10:18:18.791157090Z INFO: Collecting host service logs for ovs-vswitchd
2026-09-09T10:18:18.791512176Z INFO: Waiting for worker host service log collection to complete ...
2026-09-09T10:18:18.940324616Z INFO: Waiting for node performance related collection to complete ...
2026-09-09T10:18:19.622603054Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-09-09T10:18:19.622713505Z INFO: on-disk MachineConfig config collection complete.
2026-09-09T10:18:19.713899877Z INFO: "sriov-network-operator" not detected. Skipping.
2026-09-09T10:18:19.739117493Z INFO: "metallb-operator" not detected. Skipping.
2026-09-09T10:18:19.741092131Z INFO: Found 1 replicas - prometheus-k8s-0
2026-09-09T10:18:19.746314931Z No resources found in openshift-etcd namespace.
2026-09-09T10:18:19.794412901Z INFO: Collecting Insights Archives from insights-operator-76bcd6ccf5-wzm4v
2026-09-09T10:18:19.794412901Z insights-runtime-extractor-2msmf
2026-09-09T10:18:19.794412901Z insights-runtime-extractor-f7778
2026-09-09T10:18:19.794412901Z insights-runtime-extractor-rx25j
2026-09-09T10:18:19.817871880Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-09-09T10:18:19.879653367Z Wrote inspect data to must-gather.
2026-09-09T10:18:19.979384184Z No resources found
2026-09-09T10:18:20.230283933Z ERROR: No running kube-apiserver pods found
2026-09-09T10:18:20.353022313Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-09-09T10:18:20.353022313Z See 'oc rsync -h' for help and examples
2026-09-09T10:18:20.430608776Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-09-09T10:18:20.498846372Z INFO: Worker host service log collection to complete.
2026-09-09T10:18:20.564459299Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-09T10:18:20.596386699Z error: the server doesn't have a resource type "performanceprofile"
2026-09-09T10:18:20.621504457Z Wrote inspect data to must-gather.
2026-09-09T10:18:20.691246990Z INFO: 'previous-logs' folder not found on ip-10-0-132-51.ec2.internal, skipping...
2026-09-09T10:18:20.748196613Z Wrote inspect data to must-gather.
2026-09-09T10:18:20.771106101Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-09-09T10:18:20.828888516Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-09-09T10:18:20.965613698Z No resources found
2026-09-09T10:18:20.969751839Z Wrote inspect data to must-gather.
2026-09-09T10:18:21.074495503Z Gathering data for ns/openshift-monitoring...
2026-09-09T10:18:21.102862667Z Wrote inspect data to must-gather.
2026-09-09T10:18:21.157390768Z Wrote inspect data to must-gather.
2026-09-09T10:18:21.168996839Z INFO: Waiting for HAProxy config collection to complete ...
2026-09-09T10:18:21.242037153Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T10:18:21.276912476Z Wrote inspect data to must-gather.
2026-09-09T10:18:21.277416155Z INFO: 'previous-logs' folder not found on ip-10-0-135-209.ec2.internal, skipping...
2026-09-09T10:18:21.437852620Z tar: Removing leading `/' from member names
2026-09-09T10:18:21.452054288Z INFO: HAProxy config collection complete.
2026-09-09T10:18:21.473520634Z Wrote inspect data to must-gather.
2026-09-09T10:18:21.485477922Z INFO: Getting rules from prometheus-k8s-0
2026-09-09T10:18:21.486757232Z error: the server doesn't have a resource type "machineconfigs"
2026-09-09T10:18:21.534013292Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-09-09T10:18:21.589294547Z INFO: 'previous-logs' folder not found on ip-10-0-143-228.ec2.internal, skipping...
2026-09-09T10:18:21.589338783Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-09-09T10:18:21.589338783Z INFO: Machine Config Daemon termination log collection complete.
2026-09-09T10:18:21.654855871Z error: the server doesn't have a resource type "machineconfigpools"
2026-09-09T10:18:21.723292439Z Wrote inspect data to must-gather.
2026-09-09T10:18:21.874517662Z Wrote inspect data to must-gather.
2026-09-09T10:18:21.900011802Z INFO: Getting status/config from prometheus-k8s-0
2026-09-09T10:18:21.975830703Z Wrote inspect data to must-gather.
2026-09-09T10:18:22.020363010Z error: the server doesn't have a resource type "kubeletconfigs"
2026-09-09T10:18:22.230807544Z Wrote inspect data to must-gather.
2026-09-09T10:18:22.246326714Z INFO: INTERCONNECT MODE
2026-09-09T10:18:22.246363889Z INFO: Gathering ovn-kubernetes DBs
2026-09-09T10:18:22.284334010Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-09-09T10:18:22.294364615Z INFO: Getting status/flags from prometheus-k8s-0
2026-09-09T10:18:22.398106227Z INFO: Gathering OVN_Northbound from ovnkube-node-gp9jd...
2026-09-09T10:18:22.398311843Z INFO: Gathering OVN_Northbound from ovnkube-node-r4x99...
2026-09-09T10:18:22.398542477Z INFO: Gathering OVN_Northbound from ovnkube-node-sbpcq...
2026-09-09T10:18:22.398932272Z INFO: Gathering OVN_Southbound from ovnkube-node-gp9jd...
2026-09-09T10:18:22.399134902Z INFO: Gathering OVN_Southbound from ovnkube-node-r4x99...
2026-09-09T10:18:22.400499381Z INFO: Gathering OVN_Southbound from ovnkube-node-sbpcq...
2026-09-09T10:18:22.477561656Z Wrote inspect data to must-gather.
2026-09-09T10:18:22.555754160Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:22.563423681Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-09-09T10:18:22.711129973Z tar: Removing leading `/' from member names
2026-09-09T10:18:22.711591578Z tar: Removing leading `/' from member names
2026-09-09T10:18:22.718453787Z tar: Removing leading `/' from member names
2026-09-09T10:18:22.718559397Z tar: Removing leading `/' from member names
2026-09-09T10:18:22.723869822Z tar: Removing leading `/' from member names
2026-09-09T10:18:22.783339885Z tar: Removing leading `/' from member names
2026-09-09T10:18:22.816004678Z Wrote inspect data to must-gather.
2026-09-09T10:18:22.830558777Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-09-09T10:18:22.864959427Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:22.867428601Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-09-09T10:18:22.882901361Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-09-09T10:18:23.059151579Z Wrote inspect data to must-gather.
2026-09-09T10:18:23.108982012Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:23.143844684Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-09-09T10:18:23.292584982Z INFO: Waiting for network log collection to complete ...
2026-09-09T10:18:23.292776717Z INFO: Waiting for ovnk database copies to complete ...
2026-09-09T10:18:23.293309220Z INFO: Copying ovnk databases complete.
2026-09-09T10:18:23.295551235Z 3.6M	must-gather/network_logs/ovnk_database_store
2026-09-09T10:18:23.298093032Z ovnk_database_store/
2026-09-09T10:18:23.298093032Z ovnk_database_store/ovnkube-node-gp9jd_sbdb
2026-09-09T10:18:23.310084886Z Wrote inspect data to must-gather.
2026-09-09T10:18:23.327175475Z ovnk_database_store/ovnkube-node-gp9jd_nbdb
2026-09-09T10:18:23.336553863Z ovnk_database_store/ovnkube-node-sbpcq_nbdb
2026-09-09T10:18:23.344597846Z ovnk_database_store/ovnkube-node-r4x99_nbdb
2026-09-09T10:18:23.348034633Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:23.350130514Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-09-09T10:18:23.352721507Z ovnk_database_store/ovnkube-node-r4x99_sbdb
2026-09-09T10:18:23.375900019Z ovnk_database_store/ovnkube-node-sbpcq_sbdb
2026-09-09T10:18:23.404801966Z INFO: Network log collection complete.
2026-09-09T10:18:23.533003409Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-09-09T10:18:23.556339020Z INFO: Getting status from alertmanager-main-0
2026-09-09T10:18:23.559343908Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:23.625933619Z Wrote inspect data to must-gather.
2026-09-09T10:18:23.723879553Z Gathering data for ns/openshift-network-console...
2026-09-09T10:18:23.769453330Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:23.773133849Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-09-09T10:18:23.909558325Z Wrote inspect data to must-gather.
2026-09-09T10:18:23.986338094Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:24.170148453Z Gathering data for ns/openshift-console-operator...
2026-09-09T10:18:24.177203222Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-09-09T10:18:24.180225307Z INFO: Fallback to identify the container image from release info
2026-09-09T10:18:24.196241093Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:24.198855915Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-09-09T10:18:24.363651598Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:24.552984983Z Wrote inspect data to /must-gather/istio.
2026-09-09T10:18:24.572907430Z Gathering data for ns/openshift-console...
2026-09-09T10:18:24.812436970Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399
2026-09-09T10:18:24.944973533Z daemonset.apps/perf-node-gather-daemonset created
2026-09-09T10:18:25.094697875Z Waiting for performance profile collector pods to become ready: 1
2026-09-09T10:18:25.168752168Z Gathering data for ns/openshift-cluster-storage-operator...
2026-09-09T10:18:25.212619127Z Done executing Istio gather script
2026-09-09T10:18:25.666101014Z Gathering data for ns/openshift-dns-operator...
2026-09-09T10:18:26.201026439Z Gathering data for ns/openshift-dns...
2026-09-09T10:18:26.217057692Z Waiting for performance profile collector pods to become ready: 2
2026-09-09T10:18:26.247061216Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T10:18:26.984268397Z Gathering data for ns/openshift-image-registry...
2026-09-09T10:18:27.336542287Z Waiting for performance profile collector pods to become ready: 3
2026-09-09T10:18:27.441712901Z Gathering data for ns/openshift-ingress-operator...
2026-09-09T10:18:27.755571377Z Gathering data for ns/openshift-ingress...
2026-09-09T10:18:28.075832290Z Gathering data for ns/openshift-ingress-canary...
2026-09-09T10:18:28.461468244Z Gathering data for ns/openshift-insights...
2026-09-09T10:18:28.467368523Z Waiting for performance profile collector pods to become ready: 4
2026-09-09T10:18:29.575594886Z Waiting for performance profile collector pods to become ready: 5
2026-09-09T10:18:30.545538821Z Gathering data for ns/openshift-config...
2026-09-09T10:18:30.689113578Z Waiting for performance profile collector pods to become ready: 6
2026-09-09T10:18:30.806446432Z Gathering data for ns/openshift-config-managed...
2026-09-09T10:18:31.183536222Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-09-09T10:18:31.251818492Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T10:18:31.429253405Z Gathering data for ns/openshift-kube-apiserver...
2026-09-09T10:18:31.663908301Z Gathering data for ns/openshift-kube-controller-manager...
2026-09-09T10:18:31.795434136Z Waiting for performance profile collector pods to become ready: 7
2026-09-09T10:18:31.931222539Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-09-09T10:18:32.189145501Z Gathering data for ns/openshift-kube-scheduler...
2026-09-09T10:18:32.445492317Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-09-09T10:18:32.702032909Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-09-09T10:18:32.905437957Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-09-09T10:18:33.003283613Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-09-09T10:18:33.152838703Z Collecting performance related data for node ip-10-0-132-51.ec2.internal
2026-09-09T10:18:33.160181308Z Collecting performance related data for node ip-10-0-143-228.ec2.internal
2026-09-09T10:18:33.168245242Z Collecting performance related data for node ip-10-0-135-209.ec2.internal
2026-09-09T10:18:33.354653474Z Gathering data for ns/openshift-user-workload-monitoring...
2026-09-09T10:18:33.890759933Z Gathering data for ns/openshift-multus...
2026-09-09T10:18:35.245692741Z Gathering data for ns/openshift-ovn-kubernetes...
2026-09-09T10:18:36.257594157Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T10:18:36.465844089Z Gathering data for ns/openshift-host-network...
2026-09-09T10:18:36.757196911Z Gathering data for ns/openshift-network-diagnostics...
2026-09-09T10:18:37.325014280Z Gathering data for ns/openshift-network-node-identity...
2026-09-09T10:18:37.761618498Z Gathering data for ns/openshift-network-operator...
2026-09-09T10:18:38.162209921Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-09-09T10:18:38.430330319Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-09-09T10:18:38.959458401Z Gathering data for ns/openshift-apiserver-operator...
2026-09-09T10:18:39.250989474Z Gathering data for ns/openshift-apiserver...
2026-09-09T10:18:39.611867164Z Gathering data for ns/openshift-controller-manager-operator...
2026-09-09T10:18:39.915879955Z Gathering data for ns/openshift-controller-manager...
2026-09-09T10:18:40.201528433Z Gathering data for ns/openshift-cluster-samples-operator...
2026-09-09T10:18:40.837764058Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-09-09T10:18:41.028370597Z Collecting kubelet logs for node ip-10-0-132-51.ec2.internal
2026-09-09T10:18:41.030601569Z Collecting kubelet logs for node ip-10-0-143-228.ec2.internal
2026-09-09T10:18:41.032621683Z Collecting kubelet logs for node ip-10-0-135-209.ec2.internal
2026-09-09T10:18:41.168841452Z Gathering data for ns/openshift-service-ca-operator...
2026-09-09T10:18:41.267078355Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-09-09T10:18:41.375095517Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-p2zm4 namespace
2026-09-09T10:18:41.380353038Z INFO: Node performance data collection complete.
2026-09-09T10:18:41.491772786Z Gathering data for ns/openshift-service-ca...
2026-09-09T10:18:41.821310150Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-09-09T10:18:42.648005858Z Wrote inspect data to must-gather.
2026-09-09T10:18:42.648047861Z error: inspection completed with the errors occurred while gathering data:
2026-09-09T10:18:42.648047861Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-09-09T10:18:42.765602035Z error: the server doesn't have a resource type "clusters"
2026-09-09T10:18:42.891898027Z Caches written to disk