2026-06-08T15:07:25.240411791Z [disk usage checker] Started
2026-06-08T15:07:25.244421262Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:07:25.461950902Z Gathering data for ns/openshift-cluster-version...
2026-06-08T15:07:25.675029869Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-08T15:07:25.859481375Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-08T15:07:25.989819571Z Gathering data for ns/default...
2026-06-08T15:07:26.445784929Z Gathering data for ns/openshift...
2026-06-08T15:07:27.027350781Z Gathering data for ns/kube-system...
2026-06-08T15:07:27.918600121Z Waiting on subprocesses to finish execution.
2026-06-08T15:07:27.926233763Z Executing Istio gather script
2026-06-08T15:07:27.929639745Z INFO: Gathering HAProxy config files
2026-06-08T15:07:27.929924152Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-08T15:07:27.932495816Z INFO: Collecting host service logs for crio
2026-06-08T15:07:27.932815120Z INFO: Collecting host service logs for kubelet
2026-06-08T15:07:27.933262968Z INFO: Collecting host service logs for rpm-ostreed
2026-06-08T15:07:27.933552422Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-08T15:07:27.933850430Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-08T15:07:27.934166938Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-08T15:07:27.934458388Z INFO: Collecting host service logs for NetworkManager
2026-06-08T15:07:27.934735354Z INFO: Collecting host service logs for openvswitch
2026-06-08T15:07:27.935045570Z INFO: Collecting host service logs for ovs-configuration
2026-06-08T15:07:27.935389774Z INFO: Collecting host service logs for ovsdb-server
2026-06-08T15:07:27.935694411Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-08T15:07:27.936047721Z INFO: Waiting for worker host service log collection to complete ...
2026-06-08T15:07:27.947855010Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-08T15:07:27.951349732Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-08T15:07:28.127605309Z INFO: Waiting for node performance related collection to complete ...
2026-06-08T15:07:28.172671965Z No resources found in openshift-etcd namespace.
2026-06-08T15:07:28.322273835Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-08T15:07:28.502467249Z No resources found
2026-06-08T15:07:28.657496288Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-08T15:07:28.894895436Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-08T15:07:28.894980775Z INFO: on-disk MachineConfig config collection complete.
2026-06-08T15:07:29.081198138Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-08T15:07:29.166313128Z ERROR: No running kube-apiserver pods found
2026-06-08T15:07:29.185341735Z INFO: Collecting Insights Archives from insights-operator-896549976-zlpwr
2026-06-08T15:07:29.185341735Z insights-runtime-extractor-87m2b
2026-06-08T15:07:29.185341735Z insights-runtime-extractor-dck7z
2026-06-08T15:07:29.185341735Z insights-runtime-extractor-pwbvw
2026-06-08T15:07:29.236884801Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-08T15:07:29.266983900Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-08T15:07:29.380005740Z Wrote inspect data to must-gather.
2026-06-08T15:07:29.442747072Z INFO: Worker host service log collection to complete.
2026-06-08T15:07:29.459823627Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-08T15:07:29.542911027Z Wrote inspect data to must-gather.
2026-06-08T15:07:29.543468111Z INFO: "metallb-operator" not detected. Skipping.
2026-06-08T15:07:29.574320720Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-08T15:07:29.574320720Z See 'oc rsync -h' for help and examples
2026-06-08T15:07:29.597224660Z error: the server doesn't have a resource type "performanceprofile"
2026-06-08T15:07:29.691473045Z Gathering data for ns/openshift-etcd...
2026-06-08T15:07:29.859008681Z tar: Removing leading `/' from member names
2026-06-08T15:07:29.868141889Z INFO: HAProxy config collection complete.
2026-06-08T15:07:30.241555795Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-08T15:07:30.275279716Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:07:30.321049967Z Wrote inspect data to must-gather.
2026-06-08T15:07:30.329516568Z Wrote inspect data to must-gather.
2026-06-08T15:07:30.540978218Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-08T15:07:30.545993122Z No resources found
2026-06-08T15:07:30.556681307Z Wrote inspect data to must-gather.
2026-06-08T15:07:30.608251006Z INFO: Getting rules from prometheus-k8s-0
2026-06-08T15:07:30.648402730Z Wrote inspect data to must-gather.
2026-06-08T15:07:30.674042338Z INFO: 'previous-logs' folder not found on ip-10-0-138-183.ec2.internal, skipping...
2026-06-08T15:07:30.723136760Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-08T15:07:30.727786651Z error: the server doesn't have a resource type "machineconfigs"
2026-06-08T15:07:30.773890674Z Wrote inspect data to must-gather.
2026-06-08T15:07:30.899066583Z Wrote inspect data to must-gather.
2026-06-08T15:07:30.899114507Z error: inspection completed with the errors occurred while gathering data:
2026-06-08T15:07:30.899114507Z     namespaces "assisted-installer" not found
2026-06-08T15:07:30.908025199Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-08T15:07:30.912907608Z Gathering data for ns/openshift-monitoring...
2026-06-08T15:07:30.996889701Z INFO: 'previous-logs' folder not found on ip-10-0-138-249.ec2.internal, skipping...
2026-06-08T15:07:31.022477639Z Wrote inspect data to must-gather.
2026-06-08T15:07:31.117393472Z Wrote inspect data to must-gather.
2026-06-08T15:07:31.253517231Z INFO: 'previous-logs' folder not found on ip-10-0-142-74.ec2.internal, skipping...
2026-06-08T15:07:31.253549385Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-08T15:07:31.253581800Z INFO: Machine Config Daemon termination log collection complete.
2026-06-08T15:07:31.275365076Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-08T15:07:31.315569930Z Wrote inspect data to must-gather.
2026-06-08T15:07:31.411979755Z INFO: Getting status/config from prometheus-k8s-0
2026-06-08T15:07:31.499202940Z Wrote inspect data to must-gather.
2026-06-08T15:07:31.572172607Z Wrote inspect data to must-gather.
2026-06-08T15:07:31.715866964Z Wrote inspect data to must-gather.
2026-06-08T15:07:31.863740297Z INFO: INTERCONNECT MODE
2026-06-08T15:07:31.863782647Z INFO: Gathering ovn-kubernetes DBs
2026-06-08T15:07:31.886893185Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-08T15:07:31.941647754Z Wrote inspect data to must-gather.
2026-06-08T15:07:31.998867268Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-08T15:07:32.028468309Z INFO: Gathering OVN_Northbound from ovnkube-node-99chv...
2026-06-08T15:07:32.028724713Z INFO: Gathering OVN_Northbound from ovnkube-node-d24ts...
2026-06-08T15:07:32.028980270Z INFO: Gathering OVN_Northbound from ovnkube-node-dwmgp...
2026-06-08T15:07:32.029288208Z INFO: Gathering OVN_Southbound from ovnkube-node-99chv...
2026-06-08T15:07:32.029538842Z INFO: Gathering OVN_Southbound from ovnkube-node-d24ts...
2026-06-08T15:07:32.029778723Z INFO: Gathering OVN_Southbound from ovnkube-node-dwmgp...
2026-06-08T15:07:32.234639796Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-08T15:07:32.240994362Z Wrote inspect data to must-gather.
2026-06-08T15:07:32.295808878Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:32.458979014Z tar: Removing leading `/' from member names
2026-06-08T15:07:32.474643150Z tar: Removing leading `/' from member names
2026-06-08T15:07:32.478273096Z tar: Removing leading `/' from member names
2026-06-08T15:07:32.488346801Z tar: Removing leading `/' from member names
2026-06-08T15:07:32.489035713Z tar: Removing leading `/' from member names
2026-06-08T15:07:32.498648217Z Wrote inspect data to must-gather.
2026-06-08T15:07:32.526249165Z tar: Removing leading `/' from member names
2026-06-08T15:07:32.539554052Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:32.542881793Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-08T15:07:32.614969324Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-08T15:07:32.769734500Z Wrote inspect data to must-gather.
2026-06-08T15:07:32.779378234Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:32.856487096Z INFO: Waiting for network log collection to complete ...
2026-06-08T15:07:32.856533250Z INFO: Waiting for ovnk database copies to complete ...
2026-06-08T15:07:32.856903044Z INFO: Copying ovnk databases complete.
2026-06-08T15:07:32.858563207Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-06-08T15:07:32.860532599Z ovnk_database_store/
2026-06-08T15:07:32.860532599Z ovnk_database_store/ovnkube-node-99chv_sbdb
2026-06-08T15:07:32.877066045Z ovnk_database_store/ovnkube-node-d24ts_nbdb
2026-06-08T15:07:32.884828922Z ovnk_database_store/ovnkube-node-d24ts_sbdb
2026-06-08T15:07:32.898676267Z ovnk_database_store/ovnkube-node-dwmgp_nbdb
2026-06-08T15:07:32.904490119Z ovnk_database_store/ovnkube-node-99chv_nbdb
2026-06-08T15:07:32.910455647Z ovnk_database_store/ovnkube-node-dwmgp_sbdb
2026-06-08T15:07:32.929964379Z INFO: Network log collection complete.
2026-06-08T15:07:32.945119020Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-08T15:07:32.983796382Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:32.986474811Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-08T15:07:32.993162652Z Wrote inspect data to must-gather.
2026-06-08T15:07:33.183096535Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:33.250062403Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-08T15:07:33.252179086Z INFO: Fallback to identify the container image from release info
2026-06-08T15:07:33.386002843Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:33.389073244Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-08T15:07:33.391404899Z INFO: Getting status from alertmanager-main-0
2026-06-08T15:07:33.587873540Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:33.760457822Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:33.762826799Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-08T15:07:33.920200489Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:33.996735089Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-08T15:07:34.020485169Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:75a8fe9618bb81a42d565c535f20bf55d78662baa7f32548859596b4c5aa793e
2026-06-08T15:07:34.107639495Z Wrote inspect data to /must-gather/istio.
2026-06-08T15:07:34.149323405Z daemonset.apps/perf-node-gather-daemonset created
2026-06-08T15:07:34.282988024Z Waiting for performance profile collector pods to become ready: 1
2026-06-08T15:07:34.610640667Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-08T15:07:34.805133385Z Gathering data for ns/openshift-network-console...
2026-06-08T15:07:34.818938048Z Done executing Istio gather script
2026-06-08T15:07:35.291078425Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:07:35.292252493Z Gathering data for ns/openshift-console-operator...
2026-06-08T15:07:35.411719301Z Waiting for performance profile collector pods to become ready: 2
2026-06-08T15:07:35.725563798Z Gathering data for ns/openshift-console...
2026-06-08T15:07:36.226519049Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-08T15:07:36.517434602Z Waiting for performance profile collector pods to become ready: 3
2026-06-08T15:07:36.820728047Z Gathering data for ns/openshift-dns-operator...
2026-06-08T15:07:37.106091613Z Gathering data for ns/openshift-dns...
2026-06-08T15:07:37.629562867Z Waiting for performance profile collector pods to become ready: 4
2026-06-08T15:07:37.850688895Z Gathering data for ns/openshift-image-registry...
2026-06-08T15:07:38.480711353Z Gathering data for ns/openshift-ingress-operator...
2026-06-08T15:07:38.748283860Z Waiting for performance profile collector pods to become ready: 5
2026-06-08T15:07:38.875588992Z Gathering data for ns/openshift-ingress...
2026-06-08T15:07:39.270707179Z Gathering data for ns/openshift-ingress-canary...
2026-06-08T15:07:39.875590281Z Waiting for performance profile collector pods to become ready: 6
2026-06-08T15:07:39.888835067Z Gathering data for ns/openshift-insights...
2026-06-08T15:07:40.297522213Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:07:40.989464619Z Waiting for performance profile collector pods to become ready: 7
2026-06-08T15:07:41.904641510Z Gathering data for ns/openshift-config...
2026-06-08T15:07:42.100854356Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-08T15:07:42.214792742Z Gathering data for ns/openshift-config-managed...
2026-06-08T15:07:42.354011179Z Collecting performance related data for node ip-10-0-142-74.ec2.internal
2026-06-08T15:07:42.360748521Z Collecting performance related data for node ip-10-0-138-249.ec2.internal
2026-06-08T15:07:42.367868691Z Collecting performance related data for node ip-10-0-138-183.ec2.internal
2026-06-08T15:07:42.704529291Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-08T15:07:43.105505581Z Gathering data for ns/openshift-kube-apiserver...
2026-06-08T15:07:43.489810748Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-08T15:07:43.902709537Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-08T15:07:44.350664959Z Gathering data for ns/openshift-kube-scheduler...
2026-06-08T15:07:44.663853454Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-08T15:07:45.131198711Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-08T15:07:45.303931798Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:07:45.695151276Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-08T15:07:46.346672835Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-08T15:07:47.100480203Z Gathering data for ns/openshift-multus...
2026-06-08T15:07:49.794464916Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-08T15:07:50.309411323Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:07:50.668243430Z Collecting kubelet logs for node ip-10-0-142-74.ec2.internal
2026-06-08T15:07:50.669931180Z Collecting kubelet logs for node ip-10-0-138-249.ec2.internal
2026-06-08T15:07:50.671635469Z Collecting kubelet logs for node ip-10-0-138-183.ec2.internal
2026-06-08T15:07:51.020001714Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-pkknd namespace
2026-06-08T15:07:51.030770689Z INFO: Node performance data collection complete.
2026-06-08T15:07:52.372547016Z Gathering data for ns/openshift-host-network...
2026-06-08T15:07:52.757450867Z Gathering data for ns/openshift-network-diagnostics...
2026-06-08T15:07:53.479319250Z Gathering data for ns/openshift-network-node-identity...
2026-06-08T15:07:54.016801159Z Gathering data for ns/openshift-network-operator...
2026-06-08T15:07:54.589152747Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-08T15:07:54.981428055Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-08T15:07:55.313971034Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:07:55.615982628Z Gathering data for ns/openshift-apiserver-operator...
2026-06-08T15:07:56.107133078Z Gathering data for ns/openshift-apiserver...
2026-06-08T15:07:56.662820603Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-08T15:07:57.151818625Z Gathering data for ns/openshift-controller-manager...
2026-06-08T15:07:57.581719839Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-08T15:07:58.385390672Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-08T15:07:58.796087738Z Gathering data for ns/openshift-service-ca-operator...
2026-06-08T15:07:59.234800634Z Gathering data for ns/openshift-service-ca...
2026-06-08T15:07:59.755047671Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-08T15:08:00.318645845Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-08T15:08:00.978656031Z Wrote inspect data to must-gather.
2026-06-08T15:08:00.978704455Z error: inspection completed with the errors occurred while gathering data:
2026-06-08T15:08:00.978704455Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-08T15:08:01.113325310Z error: the server doesn't have a resource type "clusters"
2026-06-08T15:08:01.251520460Z Caches written to disk