2026-10-30T19:27:24.558268018Z [disk usage checker] Started 2026-10-30T19:27:24.561722450Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-30T19:27:24.793546926Z Gathering data for ns/openshift-cluster-version... 2026-10-30T19:27:24.942463217Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-30T19:27:25.041041892Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-30T19:27:25.147069671Z Gathering data for ns/default... 2026-10-30T19:27:25.515445928Z Gathering data for ns/openshift... 2026-10-30T19:27:25.987411497Z Gathering data for ns/kube-system... 2026-10-30T19:27:26.916883809Z Gathering data for ns/openshift-etcd... 2026-10-30T19:27:27.288046453Z Wrote inspect data to must-gather. 2026-10-30T19:27:27.288083836Z error: inspection completed with the errors occurred while gathering data: 2026-10-30T19:27:27.288083836Z namespaces "assisted-installer" not found 2026-10-30T19:27:27.368404523Z Waiting on subprocesses to finish execution. 2026-10-30T19:27:27.375308550Z INFO: Gathering machine config daemon's old logs from all nodes 2026-10-30T19:27:27.376517869Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time. 2026-10-30T19:27:27.378580494Z INFO: Gathering on-disk MachineConfig from degraded nodes 2026-10-30T19:27:27.382221759Z INFO: Gathering HAProxy config files 2026-10-30T19:27:27.383612102Z Executing Istio gather script 2026-10-30T19:27:27.401761987Z INFO: Collecting host service logs for crio 2026-10-30T19:27:27.402106800Z INFO: Collecting host service logs for kubelet 2026-10-30T19:27:27.402443175Z INFO: Collecting host service logs for rpm-ostreed 2026-10-30T19:27:27.402767591Z INFO: Collecting host service logs for ostree-finalize-staged 2026-10-30T19:27:27.403083985Z INFO: Collecting host service logs for machine-config-daemon-firstboot 2026-10-30T19:27:27.403413393Z INFO: Collecting host service logs for machine-config-daemon-host 2026-10-30T19:27:27.403730759Z INFO: Collecting host service logs for NetworkManager 2026-10-30T19:27:27.404031464Z INFO: Collecting host service logs for openvswitch 2026-10-30T19:27:27.404339107Z INFO: Collecting host service logs for ovs-configuration 2026-10-30T19:27:27.404650008Z INFO: Collecting host service logs for ovsdb-server 2026-10-30T19:27:27.404962411Z INFO: Collecting host service logs for ovs-vswitchd 2026-10-30T19:27:27.405323372Z INFO: Waiting for worker host service log collection to complete ... 2026-10-30T19:27:27.507638275Z INFO: Waiting for node performance related collection to complete ... 2026-10-30T19:27:28.238558652Z INFO: Waiting for on-disk MachineConfig collection to complete ... 2026-10-30T19:27:28.238638864Z INFO: on-disk MachineConfig config collection complete. 2026-10-30T19:27:28.378105413Z INFO: "kubernetes-nmstate-operator" not detected. Skipping. 2026-10-30T19:27:28.555948337Z No resources found in openshift-etcd namespace. 2026-10-30T19:27:28.694566958Z No resources found 2026-10-30T19:27:28.748949224Z INFO: "sriov-network-operator" not detected. Skipping. 2026-10-30T19:27:28.886449000Z INFO: Collecting Insights Archives from insights-operator-7c4986d449-7mkw7 2026-10-30T19:27:28.886449000Z insights-runtime-extractor-68l56 2026-10-30T19:27:28.886449000Z insights-runtime-extractor-gr2wl 2026-10-30T19:27:28.886449000Z insights-runtime-extractor-qxn6g 2026-10-30T19:27:28.900551316Z INFO: "nfd" not detected. Skipping. 2026-10-30T19:27:29.158727553Z INFO: "metallb-operator" not detected. Skipping. 2026-10-30T19:27:29.216443515Z INFO: Found 1 replicas - prometheus-k8s-0 2026-10-30T19:27:29.243380850Z INFO: namespace openshift-frr-k8s not detected. Skipping. 2026-10-30T19:27:29.271139420Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-30T19:27:29.445333880Z No resources found 2026-10-30T19:27:29.498088881Z error: the server doesn't have a resource type "performanceprofile" 2026-10-30T19:27:29.589809191Z Wrote inspect data to must-gather. 2026-10-30T19:27:29.592233732Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-30T19:27:29.724574033Z Wrote inspect data to must-gather. 2026-10-30T19:27:29.764979199Z INFO: Worker host service log collection to complete. 2026-10-30T19:27:29.834584119Z Wrote inspect data to must-gather. 2026-10-30T19:27:29.921277084Z ERROR: No running kube-apiserver pods found 2026-10-30T19:27:29.923258909Z INFO: Waiting for HAProxy config collection to complete ... 2026-10-30T19:27:30.069525739Z error: the server doesn't have a resource type "multi-networkpolicy" 2026-10-30T19:27:30.076641695Z Wrote inspect data to must-gather. 2026-10-30T19:27:30.079401733Z Wrote inspect data to must-gather. 2026-10-30T19:27:30.133371372Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments 2026-10-30T19:27:30.133371372Z See 'oc rsync -h' for help and examples 2026-10-30T19:27:30.151558361Z Wrote inspect data to must-gather. 2026-10-30T19:27:30.255635871Z INFO: Getting alertmanagers from prometheus-k8s-0 2026-10-30T19:27:30.277521266Z Wrote inspect data to must-gather. 2026-10-30T19:27:30.336408256Z tar: Removing leading `/' from member names 2026-10-30T19:27:30.342379180Z INFO: HAProxy config collection complete. 2026-10-30T19:27:30.397433711Z Gathering data for ns/openshift-cloud-credential-operator... 2026-10-30T19:27:30.437140430Z INFO: 'previous-logs' folder not found on ip-10-0-131-204.us-east-2.compute.internal, skipping... 2026-10-30T19:27:30.513574703Z error: the server doesn't have a resource type "machineconfigs" 2026-10-30T19:27:30.541993853Z Wrote inspect data to must-gather. 2026-10-30T19:27:30.659231500Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable no sooner than v6.0+ 2026-10-30T19:27:30.768199662Z error: the server doesn't have a resource type "machineconfigpools" 2026-10-30T19:27:30.778652719Z INFO: 'previous-logs' folder not found on ip-10-0-138-133.us-east-2.compute.internal, skipping... 2026-10-30T19:27:30.789200492Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection. 2026-10-30T19:27:30.826633026Z INFO: Getting rules from prometheus-k8s-0 2026-10-30T19:27:30.854601064Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2026-10-30T19:27:30.920609123Z Wrote inspect data to must-gather. 2026-10-30T19:27:31.079317969Z Wrote inspect data to must-gather. 2026-10-30T19:27:31.141115130Z INFO: 'previous-logs' folder not found on ip-10-0-142-227.us-east-2.compute.internal, skipping... 2026-10-30T19:27:31.141137395Z INFO: Waiting for Machine Config Daemon termination log collection to complete ... 2026-10-30T19:27:31.141184832Z INFO: Machine Config Daemon termination log collection complete. 2026-10-30T19:27:31.261526479Z Wrote inspect data to must-gather. 2026-10-30T19:27:31.321892839Z error: the server doesn't have a resource type "kubeletconfigs" 2026-10-30T19:27:31.330274345Z INFO: Getting status/config from prometheus-k8s-0 2026-10-30T19:27:31.398987011Z Gathering data for ns/openshift-monitoring... 2026-10-30T19:27:31.593539708Z INFO: LEGACY MODE 2026-10-30T19:27:31.593572966Z INFO: Gathering ovn-kubernetes master data 2026-10-30T19:27:31.602455467Z Wrote inspect data to must-gather. 2026-10-30T19:27:31.794748255Z INFO: Getting status/flags from prometheus-k8s-0 2026-10-30T19:27:31.851307253Z Wrote inspect data to must-gather. 2026-10-30T19:27:32.035547329Z INFO: Getting status/runtimeinfo from prometheus-k8s-0 2026-10-30T19:27:32.098419985Z Wrote inspect data to must-gather. 2026-10-30T19:27:32.292692432Z INFO: Getting targets?state=active from prometheus-k8s-0 2026-10-30T19:27:32.356256449Z Wrote inspect data to must-gather. 2026-10-30T19:27:32.466407384Z INFO: Waiting for network log collection to complete ... 2026-10-30T19:27:32.466527259Z INFO: Waiting for ovnk database copies to complete ... 2026-10-30T19:27:32.467036604Z INFO: Copying ovnk databases complete. 2026-10-30T19:27:32.469081912Z du: cannot access 'must-gather/network_logs/ovnk_database_store': No such file or directory 2026-10-30T19:27:32.469640675Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 681 is not a child of this shell 2026-10-30T19:27:32.469640675Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 682 is not a child of this shell 2026-10-30T19:27:32.469640675Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 683 is not a child of this shell 2026-10-30T19:27:32.469640675Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 684 is not a child of this shell 2026-10-30T19:27:32.469640675Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 685 is not a child of this shell 2026-10-30T19:27:32.469660468Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 686 is not a child of this shell 2026-10-30T19:27:32.469660468Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 687 is not a child of this shell 2026-10-30T19:27:32.469660468Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 688 is not a child of this shell 2026-10-30T19:27:32.469660468Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 704 is not a child of this shell 2026-10-30T19:27:32.469660468Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 705 is not a child of this shell 2026-10-30T19:27:32.469660468Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 706 is not a child of this shell 2026-10-30T19:27:32.469660468Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 707 is not a child of this shell 2026-10-30T19:27:32.469660468Z /usr/bin/gather_network_logs_basics: line 190: wait: pid 708 is not a child of this shell 2026-10-30T19:27:32.472787342Z tar: ovnk_database_store: Cannot stat: No such file or directory 2026-10-30T19:27:32.476040971Z tar: Exiting with failure status due to previous errors 2026-10-30T19:27:32.476530905Z INFO: Network log collection complete. 2026-10-30T19:27:32.478902858Z Inspecting resource crd/backendtlspolicies.gateway.networking.k8s.io 2026-10-30T19:27:32.536624288Z INFO: Getting status/tsdb from prometheus-k8s-0 2026-10-30T19:27:32.601847054Z Wrote inspect data to must-gather. 2026-10-30T19:27:32.678383786Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:32.839440405Z Wrote inspect data to must-gather. 2026-10-30T19:27:32.911939327Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:32.914659967Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io 2026-10-30T19:27:32.943520513Z INFO: Getting status from alertmanager-main-0 2026-10-30T19:27:33.101543558Z Wrote inspect data to must-gather. 2026-10-30T19:27:33.155075016Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:33.352502061Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:33.355339588Z Inspecting resource crd/gateways.gateway.networking.k8s.io 2026-10-30T19:27:33.435780773Z INFO: Hosted cluster detected, get NTO container image from the TuneD pod 2026-10-30T19:27:33.554067288Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:33.588516244Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36f60e56e0594610b09d7a64639223d0a6a314315bca9313914f95c902a1597c 2026-10-30T19:27:33.735114020Z daemonset.apps/perf-node-gather-daemonset created 2026-10-30T19:27:33.765777041Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:33.769216823Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io 2026-10-30T19:27:33.876762987Z Waiting for performance profile collector pods to become ready: 1 2026-10-30T19:27:33.976556456Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:34.185205390Z Gathering data for ns/openshift-network-console... 2026-10-30T19:27:34.212513916Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:34.215002103Z Inspecting resource crd/httproutes.gateway.networking.k8s.io 2026-10-30T19:27:34.453218339Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:34.598985600Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-30T19:27:34.683869763Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:34.686971310Z Inspecting resource crd/inferencepools.inference.networking.k8s.io 2026-10-30T19:27:34.717266296Z Gathering data for ns/openshift-console-operator... 2026-10-30T19:27:34.864847752Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:35.007988110Z Waiting for performance profile collector pods to become ready: 2 2026-10-30T19:27:35.079953103Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:35.083294406Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io 2026-10-30T19:27:35.196822143Z Gathering data for ns/openshift-console... 2026-10-30T19:27:35.254716424Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:35.447279955Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:35.450179255Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io 2026-10-30T19:27:35.630704337Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:35.791678103Z Gathering data for ns/openshift-cluster-storage-operator... 2026-10-30T19:27:35.831484941Z Wrote inspect data to /must-gather/istio. 2026-10-30T19:27:36.154278197Z Waiting for performance profile collector pods to become ready: 3 2026-10-30T19:27:36.380692562Z Gathering data for ns/openshift-dns-operator... 2026-10-30T19:27:36.748351612Z Done executing Istio gather script 2026-10-30T19:27:36.757401598Z Gathering data for ns/openshift-dns... 2026-10-30T19:27:37.281394998Z Waiting for performance profile collector pods to become ready: 4 2026-10-30T19:27:37.441273202Z Gathering data for ns/openshift-image-registry... 2026-10-30T19:27:37.943095629Z Gathering data for ns/openshift-ingress-operator... 2026-10-30T19:27:38.281016008Z Gathering data for ns/openshift-ingress... 2026-10-30T19:27:38.414770925Z Waiting for performance profile collector pods to become ready: 5 2026-10-30T19:27:38.660053543Z Gathering data for ns/openshift-ingress-canary... 2026-10-30T19:27:39.073525232Z Gathering data for ns/openshift-insights... 2026-10-30T19:27:39.554209076Z Waiting for performance profile collector pods to become ready: 6 2026-10-30T19:27:39.605796668Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-30T19:27:40.678592988Z Waiting for performance profile collector pods to become ready: 7 2026-10-30T19:27:41.796521476Z Daemonset perf-node-gather-daemonset ready 3 out of 3 2026-10-30T19:27:41.855681065Z Gathering data for ns/kserve... 2026-10-30T19:27:42.096613156Z Collecting performance related data for node ip-10-0-131-204.us-east-2.compute.internal 2026-10-30T19:27:42.104296047Z Collecting performance related data for node ip-10-0-138-133.us-east-2.compute.internal 2026-10-30T19:27:42.112184211Z Collecting performance related data for node ip-10-0-142-227.us-east-2.compute.internal 2026-10-30T19:27:44.001471163Z Gathering data for ns/openshift-config... 2026-10-30T19:27:44.305968129Z Gathering data for ns/openshift-config-managed... 2026-10-30T19:27:44.610445515Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-30T19:27:44.851782252Z Gathering data for ns/openshift-kube-apiserver-operator... 2026-10-30T19:27:45.233986676Z Gathering data for ns/openshift-kube-apiserver... 2026-10-30T19:27:45.588389538Z Gathering data for ns/openshift-kube-controller-manager... 2026-10-30T19:27:45.912095746Z Gathering data for ns/openshift-kube-controller-manager-operator... 2026-10-30T19:27:46.254549066Z Gathering data for ns/openshift-kube-scheduler... 2026-10-30T19:27:46.563372227Z Gathering data for ns/openshift-kube-scheduler-operator... 2026-10-30T19:27:46.943441386Z Gathering data for ns/openshift-kube-storage-version-migrator... 2026-10-30T19:27:47.352233341Z Gathering data for ns/openshift-kube-storage-version-migrator-operator... 2026-10-30T19:27:47.705437507Z Gathering data for ns/openshift-user-workload-monitoring... 2026-10-30T19:27:48.257787043Z Gathering data for ns/openshift-multus... 2026-10-30T19:27:49.146786413Z Collecting kubelet logs for node ip-10-0-131-204.us-east-2.compute.internal 2026-10-30T19:27:49.148392303Z Collecting kubelet logs for node ip-10-0-138-133.us-east-2.compute.internal 2026-10-30T19:27:49.150537123Z Collecting kubelet logs for node ip-10-0-142-227.us-east-2.compute.internal 2026-10-30T19:27:49.583507925Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-cz28q namespace 2026-10-30T19:27:49.589491446Z INFO: Node performance data collection complete. 2026-10-30T19:27:49.615351059Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-30T19:27:49.993617940Z Gathering data for ns/openshift-ovn-kubernetes... 2026-10-30T19:27:51.382730537Z Gathering data for ns/openshift-host-network... 2026-10-30T19:27:51.703557132Z Gathering data for ns/openshift-network-diagnostics... 2026-10-30T19:27:52.293908821Z Gathering data for ns/openshift-network-node-identity... 2026-10-30T19:27:52.794532156Z Gathering data for ns/openshift-network-operator... 2026-10-30T19:27:53.200993381Z Gathering data for ns/openshift-cloud-network-config-controller... 2026-10-30T19:27:53.482277918Z Gathering data for ns/openshift-cluster-node-tuning-operator... 2026-10-30T19:27:54.064402852Z Gathering data for ns/openshift-apiserver-operator... 2026-10-30T19:27:54.365512152Z Gathering data for ns/openshift-apiserver... 2026-10-30T19:27:54.621289833Z [disk usage checker] Volume usage percentage: current = 13 ; allowed = 70 2026-10-30T19:27:54.811525423Z Gathering data for ns/openshift-controller-manager-operator... 2026-10-30T19:27:55.090247464Z Gathering data for ns/openshift-controller-manager... 2026-10-30T19:27:55.397091303Z Gathering data for ns/openshift-cluster-samples-operator... 2026-10-30T19:27:56.205986685Z Gathering data for ns/openshift-operator-lifecycle-manager... 2026-10-30T19:27:56.513910882Z Gathering data for ns/openshift-service-ca-operator... 2026-10-30T19:27:56.845715945Z Gathering data for ns/openshift-service-ca... 2026-10-30T19:27:57.253384174Z Gathering data for ns/openshift-cluster-csi-drivers... 2026-10-30T19:27:58.223934159Z Wrote inspect data to must-gather. 2026-10-30T19:27:58.223974726Z error: inspection completed with the errors occurred while gathering data: 2026-10-30T19:27:58.223974726Z skipping gathering secrets/support due to error: secrets "support" not found 2026-10-30T19:27:58.356125861Z error: the server doesn't have a resource type "clusters" 2026-10-30T19:27:58.481117602Z Caches written to disk