2026-06-12T17:38:35.564585341Z [disk usage checker] Started
2026-06-12T17:38:35.567907938Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T17:38:35.754445997Z Gathering data for ns/openshift-cluster-version...
2026-06-12T17:38:35.899551716Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-12T17:38:35.980209426Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-12T17:38:36.072357313Z Gathering data for ns/default...
2026-06-12T17:38:36.400568114Z Gathering data for ns/openshift...
2026-06-12T17:38:36.792970824Z Gathering data for ns/kube-system...
2026-06-12T17:38:37.430076826Z Gathering data for ns/openshift-etcd...
2026-06-12T17:38:37.705801981Z Wrote inspect data to must-gather.
2026-06-12T17:38:37.705903010Z error: inspection completed with the errors occurred while gathering data:
2026-06-12T17:38:37.705903010Z     namespaces "assisted-installer" not found
2026-06-12T17:38:38.147655188Z Waiting on subprocesses to finish execution.
2026-06-12T17:38:38.156390381Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-12T17:38:38.161477648Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-12T17:38:38.163423581Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-12T17:38:38.166280691Z INFO: Gathering HAProxy config files
2026-06-12T17:38:38.176563226Z Executing Istio gather script
2026-06-12T17:38:38.262674234Z INFO: Collecting host service logs for crio
2026-06-12T17:38:38.263092046Z INFO: Collecting host service logs for kubelet
2026-06-12T17:38:38.263461966Z INFO: Collecting host service logs for rpm-ostreed
2026-06-12T17:38:38.263799523Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-12T17:38:38.264124940Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-12T17:38:38.264480489Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-12T17:38:38.264819422Z INFO: Collecting host service logs for NetworkManager
2026-06-12T17:38:38.265130538Z INFO: Collecting host service logs for openvswitch
2026-06-12T17:38:38.265450735Z INFO: Collecting host service logs for ovs-configuration
2026-06-12T17:38:38.265769676Z INFO: Collecting host service logs for ovsdb-server
2026-06-12T17:38:38.266075246Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-12T17:38:38.266457936Z INFO: Waiting for worker host service log collection to complete ...
2026-06-12T17:38:38.340908272Z INFO: Waiting for node performance related collection to complete ...
2026-06-12T17:38:38.654791004Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-12T17:38:38.654874439Z INFO: on-disk MachineConfig config collection complete.
2026-06-12T17:38:38.675209829Z INFO: Collecting Insights Archives from insights-operator-5bbd86d6bd-n9dgn
2026-06-12T17:38:38.675262467Z insights-runtime-extractor-79vql
2026-06-12T17:38:38.675284766Z insights-runtime-extractor-gf7l8
2026-06-12T17:38:38.675325959Z insights-runtime-extractor-gtvlw
2026-06-12T17:38:38.732759206Z No resources found in openshift-etcd namespace.
2026-06-12T17:38:38.846981824Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-12T17:38:38.937116238Z INFO: "metallb-operator" not detected. Skipping.
2026-06-12T17:38:39.105286244Z No resources found
2026-06-12T17:38:39.304658494Z Wrote inspect data to must-gather.
2026-06-12T17:38:39.360349809Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-12T17:38:39.394714081Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-12T17:38:39.551566157Z error: the server doesn't have a resource type "performanceprofile"
2026-06-12T17:38:39.625280531Z INFO: Worker host service log collection to complete.
2026-06-12T17:38:39.711264010Z Wrote inspect data to must-gather.
2026-06-12T17:38:39.714406337Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-12T17:38:39.714406337Z See 'oc rsync -h' for help and examples
2026-06-12T17:38:39.977339944Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-12T17:38:40.028291522Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-12T17:38:40.042272709Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-12T17:38:40.051313699Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-12T17:38:40.131778356Z ERROR: No running kube-apiserver pods found
2026-06-12T17:38:40.279650916Z Wrote inspect data to must-gather.
2026-06-12T17:38:40.320978145Z Wrote inspect data to must-gather.
2026-06-12T17:38:40.450132459Z Wrote inspect data to must-gather.
2026-06-12T17:38:40.456788818Z Wrote inspect data to must-gather.
2026-06-12T17:38:40.493942829Z No resources found
2026-06-12T17:38:40.525274081Z tar: Removing leading `/' from member names
2026-06-12T17:38:40.526009555Z INFO: 'previous-logs' folder not found on ip-10-0-130-38.ec2.internal, skipping...
2026-06-12T17:38:40.533241742Z INFO: HAProxy config collection complete.
2026-06-12T17:38:40.574872375Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T17:38:40.592613815Z Wrote inspect data to must-gather.
2026-06-12T17:38:40.643891810Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-12T17:38:40.667003868Z error: the server doesn't have a resource type "machineconfigs"
2026-06-12T17:38:40.715706691Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-12T17:38:40.862005235Z INFO: 'previous-logs' folder not found on ip-10-0-135-180.ec2.internal, skipping...
2026-06-12T17:38:40.863017813Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-12T17:38:40.865335350Z Gathering data for ns/openshift-monitoring...
2026-06-12T17:38:40.896247839Z Wrote inspect data to must-gather.
2026-06-12T17:38:41.098284537Z INFO: Getting rules from prometheus-k8s-0
2026-06-12T17:38:41.116976042Z Wrote inspect data to must-gather.
2026-06-12T17:38:41.164336147Z INFO: 'previous-logs' folder not found on ip-10-0-140-155.ec2.internal, skipping...
2026-06-12T17:38:41.164373104Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-12T17:38:41.164384012Z INFO: Machine Config Daemon termination log collection complete.
2026-06-12T17:38:41.177525684Z Wrote inspect data to must-gather.
2026-06-12T17:38:41.278416199Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-12T17:38:41.424366860Z Wrote inspect data to must-gather.
2026-06-12T17:38:41.488125387Z Wrote inspect data to must-gather.
2026-06-12T17:38:41.504032899Z INFO: Getting status/config from prometheus-k8s-0
2026-06-12T17:38:41.662817957Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-12T17:38:41.687800449Z Wrote inspect data to must-gather.
2026-06-12T17:38:41.721655786Z INFO: INTERCONNECT MODE
2026-06-12T17:38:41.721697082Z INFO: Gathering ovn-kubernetes DBs
2026-06-12T17:38:41.867592918Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:41.905141612Z INFO: Gathering OVN_Northbound from ovnkube-node-8bbdt...
2026-06-12T17:38:41.905410205Z INFO: Gathering OVN_Northbound from ovnkube-node-n7b4v...
2026-06-12T17:38:41.905640045Z INFO: Gathering OVN_Northbound from ovnkube-node-tj4z2...
2026-06-12T17:38:41.905956189Z INFO: Gathering OVN_Southbound from ovnkube-node-8bbdt...
2026-06-12T17:38:41.906252099Z INFO: Gathering OVN_Southbound from ovnkube-node-n7b4v...
2026-06-12T17:38:41.906560642Z INFO: Gathering OVN_Southbound from ovnkube-node-tj4z2...
2026-06-12T17:38:41.926454196Z Wrote inspect data to must-gather.
2026-06-12T17:38:41.941613325Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-12T17:38:42.191534751Z tar: Removing leading `/' from member names
2026-06-12T17:38:42.231034525Z tar: Removing leading `/' from member names
2026-06-12T17:38:42.235734087Z tar: Removing leading `/' from member names
2026-06-12T17:38:42.251440143Z tar: Removing leading `/' from member names
2026-06-12T17:38:42.254949462Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:42.261145673Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-12T17:38:42.266643426Z tar: Removing leading `/' from member names
2026-06-12T17:38:42.290622314Z tar: Removing leading `/' from member names
2026-06-12T17:38:42.330703637Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-12T17:38:42.347564645Z Wrote inspect data to must-gather.
2026-06-12T17:38:42.415429469Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-12T17:38:42.512685527Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:42.609212889Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-12T17:38:42.612276771Z Wrote inspect data to must-gather.
2026-06-12T17:38:42.756660616Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:42.759720095Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-12T17:38:42.766197355Z INFO: Waiting for network log collection to complete ...
2026-06-12T17:38:42.766252919Z INFO: Waiting for ovnk database copies to complete ...
2026-06-12T17:38:42.766758634Z INFO: Copying ovnk databases complete.
2026-06-12T17:38:42.768450656Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-06-12T17:38:42.773689634Z ovnk_database_store/
2026-06-12T17:38:42.773767011Z ovnk_database_store/ovnkube-node-8bbdt_sbdb
2026-06-12T17:38:42.789544833Z ovnk_database_store/ovnkube-node-8bbdt_nbdb
2026-06-12T17:38:42.795018517Z ovnk_database_store/ovnkube-node-tj4z2_sbdb
2026-06-12T17:38:42.811639612Z ovnk_database_store/ovnkube-node-n7b4v_sbdb
2026-06-12T17:38:42.829013204Z ovnk_database_store/ovnkube-node-tj4z2_nbdb
2026-06-12T17:38:42.834590008Z ovnk_database_store/ovnkube-node-n7b4v_nbdb
2026-06-12T17:38:42.844241385Z Wrote inspect data to must-gather.
2026-06-12T17:38:42.845627966Z INFO: Network log collection complete.
2026-06-12T17:38:42.871596523Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-12T17:38:42.972654157Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:43.043751944Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-12T17:38:43.142945003Z Wrote inspect data to must-gather.
2026-06-12T17:38:43.205135831Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:43.208369811Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-12T17:38:43.241886185Z Gathering data for ns/openshift-network-console...
2026-06-12T17:38:43.266255340Z INFO: Getting status from alertmanager-main-0
2026-06-12T17:38:43.422759859Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-12T17:38:43.425484863Z INFO: Fallback to identify the container image from release info
2026-06-12T17:38:43.452475835Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:43.668586703Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:43.671494083Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-12T17:38:43.682505092Z Gathering data for ns/openshift-console-operator...
2026-06-12T17:38:43.836406587Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:44.004558650Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d66a6b2ec52dede5d83ce04f6abfc519df1fd7dc36248741e03ecb9bf8d1762
2026-06-12T17:38:44.030551538Z Wrote inspect data to /must-gather/istio.
2026-06-12T17:38:44.072528519Z Gathering data for ns/openshift-console...
2026-06-12T17:38:44.128573114Z daemonset.apps/perf-node-gather-daemonset created
2026-06-12T17:38:44.266109159Z Waiting for performance profile collector pods to become ready: 1
2026-06-12T17:38:44.625750259Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-12T17:38:44.742479016Z Done executing Istio gather script
2026-06-12T17:38:45.138523260Z Gathering data for ns/openshift-dns-operator...
2026-06-12T17:38:45.394004603Z Waiting for performance profile collector pods to become ready: 2
2026-06-12T17:38:45.409443130Z Gathering data for ns/openshift-dns...
2026-06-12T17:38:45.579844420Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T17:38:45.956494855Z Gathering data for ns/openshift-image-registry...
2026-06-12T17:38:46.374604342Z Gathering data for ns/openshift-ingress-operator...
2026-06-12T17:38:46.508729088Z Waiting for performance profile collector pods to become ready: 3
2026-06-12T17:38:46.673879571Z Gathering data for ns/openshift-ingress...
2026-06-12T17:38:46.960253718Z Gathering data for ns/openshift-ingress-canary...
2026-06-12T17:38:47.350084213Z Gathering data for ns/openshift-insights...
2026-06-12T17:38:47.617647916Z Waiting for performance profile collector pods to become ready: 4
2026-06-12T17:38:48.728844614Z Waiting for performance profile collector pods to become ready: 5
2026-06-12T17:38:49.107945145Z Gathering data for ns/openshift-config...
2026-06-12T17:38:49.347688789Z Gathering data for ns/openshift-config-managed...
2026-06-12T17:38:49.803603379Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-12T17:38:49.851528850Z Waiting for performance profile collector pods to become ready: 6
2026-06-12T17:38:50.043710842Z Gathering data for ns/openshift-kube-apiserver...
2026-06-12T17:38:50.281841871Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-12T17:38:50.529095001Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-12T17:38:50.585990569Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T17:38:50.783276448Z Gathering data for ns/openshift-kube-scheduler...
2026-06-12T17:38:50.967192518Z Waiting for performance profile collector pods to become ready: 7
2026-06-12T17:38:51.019893525Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-12T17:38:51.271293076Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-12T17:38:51.562481739Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-12T17:38:51.845975056Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-12T17:38:52.093540474Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-12T17:38:52.326908412Z Gathering data for ns/openshift-multus...
2026-06-12T17:38:52.350491744Z Collecting performance related data for node ip-10-0-130-38.ec2.internal
2026-06-12T17:38:52.358131246Z Collecting performance related data for node ip-10-0-140-155.ec2.internal
2026-06-12T17:38:52.366925369Z Collecting performance related data for node ip-10-0-135-180.ec2.internal
2026-06-12T17:38:53.835466345Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-12T17:38:55.014091627Z Gathering data for ns/openshift-host-network...
2026-06-12T17:38:55.341613168Z Gathering data for ns/openshift-network-diagnostics...
2026-06-12T17:38:55.590593904Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T17:38:55.899534012Z Gathering data for ns/openshift-network-node-identity...
2026-06-12T17:38:56.263823380Z Gathering data for ns/openshift-network-operator...
2026-06-12T17:38:56.640437569Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-12T17:38:56.884907866Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-12T17:38:57.408218397Z Gathering data for ns/openshift-apiserver-operator...
2026-06-12T17:38:57.681042015Z Gathering data for ns/openshift-apiserver...
2026-06-12T17:38:58.048614710Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-12T17:38:58.289432142Z Gathering data for ns/openshift-controller-manager...
2026-06-12T17:38:58.535834121Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-12T17:38:59.162571663Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-12T17:38:59.426637897Z Gathering data for ns/openshift-service-ca-operator...
2026-06-12T17:38:59.704343435Z Gathering data for ns/openshift-service-ca...
2026-06-12T17:39:00.034507933Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-12T17:39:00.595231211Z [disk usage checker] Volume usage percentage: current = 15 ; allowed = 70
2026-06-12T17:39:00.680902481Z Collecting kubelet logs for node ip-10-0-130-38.ec2.internal
2026-06-12T17:39:00.682649398Z Collecting kubelet logs for node ip-10-0-140-155.ec2.internal
2026-06-12T17:39:00.684359126Z Collecting kubelet logs for node ip-10-0-135-180.ec2.internal
2026-06-12T17:39:00.945961151Z Wrote inspect data to must-gather.
2026-06-12T17:39:00.946004267Z error: inspection completed with the errors occurred while gathering data:
2026-06-12T17:39:00.946004267Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-12T17:39:01.001922230Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-sr2mk namespace
2026-06-12T17:39:01.006609545Z INFO: Node performance data collection complete.
2026-06-12T17:39:01.132430814Z error: the server doesn't have a resource type "clusters"
2026-06-12T17:39:01.258703683Z Caches written to disk