2026-11-02T23:11:14.877406831Z [disk usage checker] Started 2026-11-02T23:11:14.880804016Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-11-02T23:11:15.103532905Z Gathering data for ns/openshift-cluster-version... 2026-11-02T23:11:15.314106528Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-11-02T23:11:15.412409601Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-11-02T23:11:15.523955982Z Gathering data for ns/default... 2026-11-02T23:11:15.855385926Z Gathering data for ns/openshift... 2026-11-02T23:11:16.295034577Z Gathering data for ns/kube-system... 2026-11-02T23:11:17.326122334Z Gathering data for ns/openshift-etcd... 2026-11-02T23:11:17.454754367Z Waiting on subprocesses to finish execution. 2026-11-02T23:11:17.460997073Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-11-02T23:11:17.463391543Z INFO: Gathering machine config daemon's old logs from all nodes 2026-11-02T23:11:17.465874051Z Executing Istio gather script 2026-11-02T23:11:17.467233814Z INFO: Collecting host service logs for crio 2026-11-02T23:11:17.467445092Z INFO: Gathering HAProxy config files 2026-11-02T23:11:17.467527750Z INFO: Collecting host service logs for kubelet 2026-11-02T23:11:17.467986418Z INFO: Collecting host service logs for rpm-ostreed 2026-11-02T23:11:17.468327565Z INFO: Collecting host service logs for ostree-finalize-staged 2026-11-02T23:11:17.468707783Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-11-02T23:11:17.469044767Z INFO: Collecting host service logs for machine-config-daemon-host 2026-11-02T23:11:17.469376793Z INFO: Collecting host service logs for NetworkManager 2026-11-02T23:11:17.469711921Z INFO: Collecting host service logs for openvswitch 2026-11-02T23:11:17.470176902Z INFO: Collecting host service logs for ovs-configuration 2026-11-02T23:11:17.470516479Z INFO: Collecting host service logs for ovsdb-server 2026-11-02T23:11:17.470891790Z INFO: Collecting host service logs for ovs-vswitchd 2026-11-02T23:11:17.471280151Z INFO: Waiting for worker host service log collection to complete ... 2026-11-02T23:11:17.481003160Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-11-02T23:11:17.507565142Z INFO: Waiting for node performance related collection to complete ... 2026-11-02T23:11:17.794847333Z No resources found in openshift-etcd namespace. 2026-11-02T23:11:17.988445688Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-11-02T23:11:18.208889933Z No resources found 2026-11-02T23:11:18.242935013Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-11-02T23:11:18.243025674Z INFO: on-disk MachineConfig config collection complete. 2026-11-02T23:11:18.443078819Z INFO: Collecting Insights Archives from insights-operator-7c4986d449-59nkb 2026-11-02T23:11:18.443113378Z Wrote inspect data to must-gather. 2026-11-02T23:11:18.443126491Z error: inspection completed with the errors occurred while gathering data: 2026-11-02T23:11:18.443126491Z namespaces "assisted-installer" not found 2026-11-02T23:11:18.443147482Z insights-runtime-extractor-2jphw 2026-11-02T23:11:18.443165440Z insights-runtime-extractor-2xg4l 2026-11-02T23:11:18.443184158Z insights-runtime-extractor-nltff 2026-11-02T23:11:18.585464607Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-11-02T23:11:18.586658578Z INFO: Found 1 replicas - prometheus-k8s-0 2026-11-02T23:11:18.636717242Z INFO: "metallb-operator" not detected. Skipping. 2026-11-02T23:11:18.905635206Z INFO: "nfd" not detected. Skipping. 2026-11-02T23:11:18.922231471Z INFO: "sriov-network-operator" not detected. Skipping. 2026-11-02T23:11:18.987513416Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-11-02T23:11:19.005254940Z error: the server doesn't have a resource type "performanceprofile" 2026-11-02T23:11:19.080605686Z INFO: Worker host service log collection to complete. 2026-11-02T23:11:19.171832721Z INFO: Waiting for HAProxy config collection to complete ... 2026-11-02T23:11:19.172932444Z ERROR: No running kube-apiserver pods found 2026-11-02T23:11:19.356157576Z Wrote inspect data to must-gather. 2026-11-02T23:11:19.686997471Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-11-02T23:11:19.716457938Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-11-02T23:11:19.749127292Z Wrote inspect data to must-gather. 2026-11-02T23:11:19.835821238Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-11-02T23:11:19.835821238Z See 'oc rsync -h' for help and examples 2026-11-02T23:11:19.989818761Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-11-02T23:11:20.135704046Z No resources found 2026-11-02T23:11:20.160977955Z Wrote inspect data to must-gather. 2026-11-02T23:11:20.209495999Z Wrote inspect data to must-gather. 2026-11-02T23:11:20.474052713Z tar: Removing leading `/' from member names 2026-11-02T23:11:20.479416559Z INFO: HAProxy config collection complete. 2026-11-02T23:11:20.536549324Z INFO: 'previous-logs' folder not found on ip-10-0-130-133.us-east-2.compute.internal, skipping... 2026-11-02T23:11:20.541763592Z Wrote inspect data to must-gather. 2026-11-02T23:11:20.593020721Z error: the server doesn't have a resource type "machineconfigs" 2026-11-02T23:11:20.702129520Z Wrote inspect data to must-gather. 2026-11-02T23:11:20.725778704Z Wrote inspect data to must-gather. 2026-11-02T23:11:20.744998158Z Gathering data for ns/openshift-cloud-credential-operator... 2026-11-02T23:11:20.785690699Z INFO: Getting rules from prometheus-k8s-0 2026-11-02T23:11:20.804953046Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-11-02T23:11:20.899100163Z error: the server doesn't have a resource type "machineconfigpools" 2026-11-02T23:11:20.979837641Z INFO: 'previous-logs' folder not found on ip-10-0-131-91.us-east-2.compute.internal, skipping... 2026-11-02T23:11:21.042485611Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-11-02T23:11:21.090514022Z Wrote inspect data to must-gather. 2026-11-02T23:11:21.246076122Z Wrote inspect data to must-gather. 2026-11-02T23:11:21.252825960Z Wrote inspect data to must-gather. 2026-11-02T23:11:21.254233171Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-11-02T23:11:21.295147798Z INFO: 'previous-logs' folder not found on ip-10-0-139-99.us-east-2.compute.internal, skipping... 2026-11-02T23:11:21.295280338Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-11-02T23:11:21.295401959Z INFO: Machine Config Daemon termination log collection complete. 2026-11-02T23:11:21.364088247Z INFO: Getting status/config from prometheus-k8s-0 2026-11-02T23:11:21.471114048Z error: the server doesn't have a resource type "kubeletconfigs" 2026-11-02T23:11:21.479805798Z Wrote inspect data to must-gather. 2026-11-02T23:11:21.761436763Z Gathering data for ns/openshift-monitoring... 2026-11-02T23:11:21.774228030Z Wrote inspect data to must-gather. 2026-11-02T23:11:21.819543313Z INFO: Getting status/flags from prometheus-k8s-0 2026-11-02T23:11:21.829677939Z INFO: LEGACY MODE 2026-11-02T23:11:21.829772509Z INFO: Gathering ovn-kubernetes master data 2026-11-02T23:11:22.024345762Z Wrote inspect data to must-gather. 2026-11-02T23:11:22.032321587Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-11-02T23:11:22.213916073Z Inspecting resource crd/backendtlspolicies.gateway.networking.k8s.io 2026-11-02T23:11:22.255740274Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-11-02T23:11:22.267520538Z Wrote inspect data to must-gather. 2026-11-02T23:11:22.455618334Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:22.488127875Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-11-02T23:11:22.543567108Z Wrote inspect data to must-gather. 2026-11-02T23:11:22.649117996Z INFO: Waiting for network log collection to complete ... 2026-11-02T23:11:22.649165231Z INFO: Waiting for ovnk database copies to complete ... 2026-11-02T23:11:22.649690546Z INFO: Copying ovnk databases complete. 2026-11-02T23:11:22.651670997Z du: cannot access 'must-gather/network_logs/ovnk_database_store': No such file or directory 2026-11-02T23:11:22.652267529Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 769 is not a child of this shell 2026-11-02T23:11:22.652267529Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 770 is not a child of this shell 2026-11-02T23:11:22.652267529Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 771 is not a child of this shell 2026-11-02T23:11:22.652282990Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 772 is not a child of this shell 2026-11-02T23:11:22.652282990Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 773 is not a child of this shell 2026-11-02T23:11:22.652282990Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 774 is not a child of this shell 2026-11-02T23:11:22.652282990Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 775 is not a child of this shell 2026-11-02T23:11:22.652282990Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 776 is not a child of this shell 2026-11-02T23:11:22.652294004Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 780 is not a child of this shell 2026-11-02T23:11:22.652294004Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 781 is not a child of this shell 2026-11-02T23:11:22.652294004Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 782 is not a child of this shell 2026-11-02T23:11:22.652303817Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 783 is not a child of this shell 2026-11-02T23:11:22.652303817Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 784 is not a child of this shell 2026-11-02T23:11:22.653798379Z tar: ovnk_database_store: Cannot stat: No such file or directory 2026-11-02T23:11:22.657562409Z tar: Exiting with failure status due to previous errors 2026-11-02T23:11:22.658318833Z INFO: Network log collection complete. 2026-11-02T23:11:22.687265260Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:22.690709147Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-11-02T23:11:22.771034348Z Wrote inspect data to must-gather. 2026-11-02T23:11:22.840673251Z INFO: Getting status from alertmanager-main-0 2026-11-02T23:11:22.857909629Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:22.988003789Z Wrote inspect data to must-gather. 2026-11-02T23:11:23.065541519Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:23.068002437Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-11-02T23:11:23.177438152Z Wrote inspect data to must-gather. 2026-11-02T23:11:23.261428939Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:23.460399556Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:23.464157081Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-11-02T23:11:23.475332140Z INFO: Hosted cluster detected, get NTO container image from the TuneD pod 2026-11-02T23:11:23.618966506Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c 2026-11-02T23:11:23.663666138Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:23.737114096Z daemonset.apps/perf-node-gather-daemonset created 2026-11-02T23:11:23.873601490Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:23.875888260Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-11-02T23:11:23.891168120Z Waiting for performance profile collector pods to become ready: 1 2026-11-02T23:11:24.101383992Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:24.201573636Z Gathering data for ns/openshift-network-console... 2026-11-02T23:11:24.329312462Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:24.331716215Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-11-02T23:11:24.493865870Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:24.686810540Z Gathering data for ns/openshift-console-operator... 2026-11-02T23:11:24.697204476Z Wrote inspect data to /must-gather/istio. 2026-11-02T23:11:25.039956036Z Waiting for performance profile collector pods to become ready: 2 2026-11-02T23:11:25.073224171Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-11-02T23:11:25.132908929Z Gathering data for ns/openshift-console... 2026-11-02T23:11:25.524261984Z Done executing Istio gather script 2026-11-02T23:11:25.664295475Z Gathering data for ns/openshift-cluster-storage-operator... 2026-11-02T23:11:26.176037332Z Waiting for performance profile collector pods to become ready: 3 2026-11-02T23:11:26.187115797Z Gathering data for ns/openshift-dns-operator... 2026-11-02T23:11:26.517847611Z Gathering data for ns/openshift-dns... 2026-11-02T23:11:27.173410549Z Gathering data for ns/openshift-image-registry... 2026-11-02T23:11:27.287398996Z Waiting for performance profile collector pods to become ready: 4 2026-11-02T23:11:27.773300524Z Gathering data for ns/openshift-ingress-operator... 2026-11-02T23:11:28.185433941Z Gathering data for ns/openshift-ingress... 2026-11-02T23:11:28.393076376Z Waiting for performance profile collector pods to become ready: 5 2026-11-02T23:11:28.561215617Z Gathering data for ns/openshift-ingress-canary... 2026-11-02T23:11:28.976861058Z Gathering data for ns/openshift-insights... 2026-11-02T23:11:29.506855115Z Waiting for performance profile collector pods to become ready: 6 2026-11-02T23:11:30.078603990Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-11-02T23:11:30.619232542Z Waiting for performance profile collector pods to become ready: 7 2026-11-02T23:11:30.698986809Z Gathering data for ns/openshift-kueue-operator... 2026-11-02T23:11:31.584345919Z Gathering data for ns/openshift-jobset-operator... 2026-11-02T23:11:31.743989035Z Waiting for performance profile collector pods to become ready: 8 2026-11-02T23:11:32.542639347Z Gathering data for ns/openshift-config... 2026-11-02T23:11:32.844232097Z Gathering data for ns/openshift-config-managed... 2026-11-02T23:11:32.873509677Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-11-02T23:11:33.118405419Z Collecting performance related data for node ip-10-0-139-99.us-east-2.compute.internal 2026-11-02T23:11:33.126282705Z Collecting performance related data for node ip-10-0-130-133.us-east-2.compute.internal 2026-11-02T23:11:33.133717769Z Collecting performance related data for node ip-10-0-131-91.us-east-2.compute.internal 2026-11-02T23:11:33.360374083Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-11-02T23:11:33.704043148Z Gathering data for ns/openshift-kube-apiserver... 2026-11-02T23:11:34.198778665Z Gathering data for ns/openshift-kube-controller-manager... 2026-11-02T23:11:34.641593724Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-11-02T23:11:34.963094573Z Gathering data for ns/openshift-kube-scheduler... 2026-11-02T23:11:35.083214166Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-11-02T23:11:35.237322923Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-11-02T23:11:35.579202910Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-11-02T23:11:36.024689581Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-11-02T23:11:36.401194917Z Gathering data for ns/openshift-user-workload-monitoring... 2026-11-02T23:11:36.970872835Z Gathering data for ns/openshift-multus... 2026-11-02T23:11:38.569240110Z Gathering data for ns/openshift-ovn-kubernetes... 2026-11-02T23:11:40.087867282Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-11-02T23:11:40.104114005Z Gathering data for ns/openshift-host-network... 2026-11-02T23:11:40.230390521Z Collecting kubelet logs for node ip-10-0-139-99.us-east-2.compute.internal 2026-11-02T23:11:40.232275067Z Collecting kubelet logs for node ip-10-0-130-133.us-east-2.compute.internal 2026-11-02T23:11:40.234039782Z Collecting kubelet logs for node ip-10-0-131-91.us-east-2.compute.internal 2026-11-02T23:11:40.531603767Z Gathering data for ns/openshift-network-diagnostics... 2026-11-02T23:11:40.665993762Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-xs6vt namespace 2026-11-02T23:11:40.674498165Z INFO: Node performance data collection complete. 2026-11-02T23:11:41.178444166Z Gathering data for ns/openshift-network-node-identity... 2026-11-02T23:11:41.686037459Z Gathering data for ns/openshift-network-operator... 2026-11-02T23:11:42.087050008Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-11-02T23:11:42.382257928Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-11-02T23:11:42.892354460Z Gathering data for ns/openshift-apiserver-operator... 2026-11-02T23:11:43.249435272Z Gathering data for ns/openshift-apiserver... 2026-11-02T23:11:43.671156524Z Gathering data for ns/openshift-controller-manager-operator... 2026-11-02T23:11:43.952465398Z Gathering data for ns/openshift-controller-manager... 2026-11-02T23:11:44.248177084Z Gathering data for ns/openshift-cluster-samples-operator... 2026-11-02T23:11:44.915992356Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-11-02T23:11:45.094715510Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70 2026-11-02T23:11:45.219900653Z Gathering data for ns/openshift-service-ca-operator... 2026-11-02T23:11:45.549514915Z Gathering data for ns/openshift-service-ca... 2026-11-02T23:11:45.930572510Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-11-02T23:11:46.908341950Z Wrote inspect data to must-gather. 2026-11-02T23:11:46.908381623Z error: inspection completed with the errors occurred while gathering data: 2026-11-02T23:11:46.908381623Z skipping gathering secrets/support due to error: secrets "support" not found 2026-11-02T23:11:47.038832934Z error: the server doesn't have a resource type "clusters" 2026-11-02T23:11:47.186511782Z Caches written to disk