2026-06-02T07:40:01.462393598Z [disk usage checker] Started
2026-06-02T07:40:01.465998098Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T07:40:01.669238097Z Gathering data for ns/openshift-cluster-version...
2026-06-02T07:40:01.795255042Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T07:40:01.878978374Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T07:40:01.967891534Z Gathering data for ns/default...
2026-06-02T07:40:02.244247412Z Gathering data for ns/openshift...
2026-06-02T07:40:02.636042173Z Gathering data for ns/kube-system...
2026-06-02T07:40:03.279074472Z Gathering data for ns/openshift-etcd...
2026-06-02T07:40:03.616286076Z Wrote inspect data to must-gather.
2026-06-02T07:40:03.616318800Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T07:40:03.616318800Z     namespaces "assisted-installer" not found
2026-06-02T07:40:03.720519753Z Waiting on subprocesses to finish execution.
2026-06-02T07:40:03.729679356Z INFO: Collecting host service logs for crio
2026-06-02T07:40:03.729992612Z INFO: Collecting host service logs for kubelet
2026-06-02T07:40:03.730309568Z INFO: Collecting host service logs for rpm-ostreed
2026-06-02T07:40:03.730602293Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-02T07:40:03.730924735Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-02T07:40:03.731234573Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-02T07:40:03.731487723Z INFO: Collecting host service logs for NetworkManager
2026-06-02T07:40:03.731742697Z INFO: Collecting host service logs for openvswitch
2026-06-02T07:40:03.732015822Z INFO: Collecting host service logs for ovs-configuration
2026-06-02T07:40:03.732122265Z INFO: Gathering HAProxy config files
2026-06-02T07:40:03.732145588Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-02T07:40:03.732263158Z INFO: Collecting host service logs for ovsdb-server
2026-06-02T07:40:03.732518080Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-02T07:40:03.732842034Z INFO: Waiting for worker host service log collection to complete ...
2026-06-02T07:40:03.742054885Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-02T07:40:03.752394533Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-02T07:40:03.951974797Z INFO: Waiting for node performance related collection to complete ...
2026-06-02T07:40:04.349099055Z No resources found in openshift-etcd namespace.
2026-06-02T07:40:04.415673399Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-02T07:40:04.415727171Z INFO: on-disk MachineConfig config collection complete.
2026-06-02T07:40:04.613751284Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-02T07:40:04.626347175Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-02T07:40:04.649475307Z No resources found
2026-06-02T07:40:04.668888228Z error: the server doesn't have a resource type "performanceprofile"
2026-06-02T07:40:04.686228279Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-02T07:40:04.774075235Z INFO: "metallb-operator" not detected. Skipping.
2026-06-02T07:40:04.873608289Z INFO: Collecting Insights Archives from insights-operator-788bf58df5-54sng
2026-06-02T07:40:04.873608289Z insights-runtime-extractor-2tpsl
2026-06-02T07:40:04.873608289Z insights-runtime-extractor-mnk76
2026-06-02T07:40:04.873608289Z insights-runtime-extractor-q95l9
2026-06-02T07:40:04.895414600Z INFO: Worker host service log collection to complete.
2026-06-02T07:40:05.073190247Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-02T07:40:05.146346060Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-02T07:40:05.353765557Z Wrote inspect data to must-gather.
2026-06-02T07:40:05.365298569Z No resources found
2026-06-02T07:40:05.415594509Z Wrote inspect data to must-gather.
2026-06-02T07:40:05.517568193Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-02T07:40:05.517568193Z See 'oc rsync -h' for help and examples
2026-06-02T07:40:05.544432049Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-02T07:40:05.613258010Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-02T07:40:05.665769165Z INFO: 'previous-logs' folder not found on ip-10-0-131-193.ec2.internal, skipping...
2026-06-02T07:40:05.729083855Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T07:40:05.766022640Z ERROR: No running kube-apiserver pods found
2026-06-02T07:40:05.827494620Z Wrote inspect data to must-gather.
2026-06-02T07:40:05.833694834Z Wrote inspect data to must-gather.
2026-06-02T07:40:05.867894805Z Wrote inspect data to must-gather.
2026-06-02T07:40:05.882400613Z Wrote inspect data to must-gather.
2026-06-02T07:40:05.893694491Z tar: Removing leading `/' from member names
2026-06-02T07:40:05.898609852Z INFO: HAProxy config collection complete.
2026-06-02T07:40:05.939734208Z Wrote inspect data to must-gather.
2026-06-02T07:40:06.004205998Z Gathering data for ns/openshift-monitoring...
2026-06-02T07:40:06.019765761Z error: the server doesn't have a resource type "machineconfigs"
2026-06-02T07:40:06.082125375Z INFO: 'previous-logs' folder not found on ip-10-0-136-245.ec2.internal, skipping...
2026-06-02T07:40:06.142980962Z INFO: Getting rules from prometheus-k8s-0
2026-06-02T07:40:06.155750555Z Wrote inspect data to must-gather.
2026-06-02T07:40:06.262435028Z Wrote inspect data to must-gather.
2026-06-02T07:40:06.332848540Z INFO: 'previous-logs' folder not found on ip-10-0-137-42.ec2.internal, skipping...
2026-06-02T07:40:06.332955397Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-02T07:40:06.333005415Z INFO: Machine Config Daemon termination log collection complete.
2026-06-02T07:40:06.382156187Z Wrote inspect data to must-gather.
2026-06-02T07:40:06.455273432Z Wrote inspect data to must-gather.
2026-06-02T07:40:06.471686706Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T07:40:06.513869386Z INFO: Getting status/config from prometheus-k8s-0
2026-06-02T07:40:06.604314674Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-02T07:40:06.609068299Z Wrote inspect data to must-gather.
2026-06-02T07:40:06.796752170Z Wrote inspect data to must-gather.
2026-06-02T07:40:06.858537356Z INFO: INTERCONNECT MODE
2026-06-02T07:40:06.858537356Z INFO: Gathering ovn-kubernetes DBs
2026-06-02T07:40:06.876350190Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-02T07:40:07.001415442Z Wrote inspect data to must-gather.
2026-06-02T07:40:07.007206506Z INFO: Gathering OVN_Northbound from ovnkube-node-67z2f...
2026-06-02T07:40:07.007421600Z INFO: Gathering OVN_Northbound from ovnkube-node-7vlwd...
2026-06-02T07:40:07.007597491Z INFO: Gathering OVN_Northbound from ovnkube-node-tjvw4...
2026-06-02T07:40:07.007946391Z INFO: Gathering OVN_Southbound from ovnkube-node-67z2f...
2026-06-02T07:40:07.008170401Z INFO: Gathering OVN_Southbound from ovnkube-node-7vlwd...
2026-06-02T07:40:07.008528662Z INFO: Gathering OVN_Southbound from ovnkube-node-tjvw4...
2026-06-02T07:40:07.128715864Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-02T07:40:07.309575868Z tar: Removing leading `/' from member names
2026-06-02T07:40:07.328439943Z tar: Removing leading `/' from member names
2026-06-02T07:40:07.336153933Z Wrote inspect data to must-gather.
2026-06-02T07:40:07.340348891Z tar: Removing leading `/' from member names
2026-06-02T07:40:07.350888133Z tar: Removing leading `/' from member names
2026-06-02T07:40:07.355665679Z tar: Removing leading `/' from member names
2026-06-02T07:40:07.357064666Z tar: Removing leading `/' from member names
2026-06-02T07:40:07.447048496Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-02T07:40:07.456406037Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-02T07:40:07.563603802Z Wrote inspect data to must-gather.
2026-06-02T07:40:07.699625111Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-02T07:40:07.772072726Z INFO: Waiting for network log collection to complete ...
2026-06-02T07:40:07.772102905Z INFO: Waiting for ovnk database copies to complete ...
2026-06-02T07:40:07.772484714Z INFO: Copying ovnk databases complete.
2026-06-02T07:40:07.774183500Z 2.8M	must-gather/network_logs/ovnk_database_store
2026-06-02T07:40:07.776274993Z ovnk_database_store/
2026-06-02T07:40:07.776274993Z ovnk_database_store/ovnkube-node-tjvw4_nbdb
2026-06-02T07:40:07.784795744Z Wrote inspect data to must-gather.
2026-06-02T07:40:07.785974729Z ovnk_database_store/ovnkube-node-67z2f_nbdb
2026-06-02T07:40:07.792889454Z ovnk_database_store/ovnkube-node-67z2f_sbdb
2026-06-02T07:40:07.811788630Z ovnk_database_store/ovnkube-node-tjvw4_sbdb
2026-06-02T07:40:07.831572244Z ovnk_database_store/ovnkube-node-7vlwd_nbdb
2026-06-02T07:40:07.839105201Z ovnk_database_store/ovnkube-node-7vlwd_sbdb
2026-06-02T07:40:07.860313431Z INFO: Network log collection complete.
2026-06-02T07:40:07.972554523Z W0602 07:40:07.972503    1383 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-02T07:40:07.979378055Z Wrote inspect data to must-gather.
2026-06-02T07:40:08.027337106Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-02T07:40:08.068072977Z INFO: Getting status from alertmanager-main-0
2026-06-02T07:40:08.199261819Z Gathering data for ns/openshift-network-console...
2026-06-02T07:40:08.239232285Z Wrote inspect data to must-gather.
2026-06-02T07:40:08.487075551Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-02T07:40:08.489486550Z INFO: Fallback to identify the container image from release info
2026-06-02T07:40:08.569523027Z Gathering data for ns/openshift-console-operator...
2026-06-02T07:40:08.911812127Z Gathering data for ns/openshift-console...
2026-06-02T07:40:09.095239215Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d8381cb85e479760bd6b601e111b39e6c56a632bfa298867f4197ec4421e9f5
2026-06-02T07:40:09.199320968Z daemonset.apps/perf-node-gather-daemonset created
2026-06-02T07:40:09.322627776Z Waiting for performance profile collector pods to become ready: 1
2026-06-02T07:40:09.414812133Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-02T07:40:09.767437411Z Gathering data for ns/openshift-dns-operator...
2026-06-02T07:40:10.064431902Z Gathering data for ns/openshift-dns...
2026-06-02T07:40:10.437507862Z Waiting for performance profile collector pods to become ready: 2
2026-06-02T07:40:10.620904294Z Gathering data for ns/openshift-image-registry...
2026-06-02T07:40:11.047855776Z Gathering data for ns/openshift-ingress-operator...
2026-06-02T07:40:11.342975832Z Gathering data for ns/openshift-ingress...
2026-06-02T07:40:11.476778609Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T07:40:11.547218094Z Waiting for performance profile collector pods to become ready: 3
2026-06-02T07:40:11.669314948Z Gathering data for ns/openshift-ingress-canary...
2026-06-02T07:40:12.031860272Z Gathering data for ns/openshift-insights...
2026-06-02T07:40:12.668352379Z Waiting for performance profile collector pods to become ready: 4
2026-06-02T07:40:13.771697119Z Gathering data for ns/openshift-jobset-operator...
2026-06-02T07:40:13.783550284Z Waiting for performance profile collector pods to become ready: 5
2026-06-02T07:40:14.543721415Z Gathering data for ns/openshift-config...
2026-06-02T07:40:14.777152766Z Gathering data for ns/openshift-config-managed...
2026-06-02T07:40:14.897406229Z Waiting for performance profile collector pods to become ready: 6
2026-06-02T07:40:15.172220419Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-02T07:40:15.410696893Z Gathering data for ns/openshift-kube-apiserver...
2026-06-02T07:40:15.638048050Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-02T07:40:15.915095251Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-02T07:40:16.025577565Z Waiting for performance profile collector pods to become ready: 7
2026-06-02T07:40:16.184267927Z Gathering data for ns/openshift-kube-scheduler...
2026-06-02T07:40:16.434282018Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-02T07:40:16.484235805Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T07:40:16.697696212Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-02T07:40:16.986427926Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-02T07:40:17.143939892Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-02T07:40:17.344314071Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-02T07:40:17.410552528Z Collecting performance related data for node ip-10-0-137-42.ec2.internal
2026-06-02T07:40:17.418051008Z Collecting performance related data for node ip-10-0-131-193.ec2.internal
2026-06-02T07:40:17.430136218Z Collecting performance related data for node ip-10-0-136-245.ec2.internal
2026-06-02T07:40:17.882222546Z Gathering data for ns/openshift-multus...
2026-06-02T07:40:19.291624061Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-02T07:40:20.747747144Z Gathering data for ns/openshift-host-network...
2026-06-02T07:40:21.091213825Z Gathering data for ns/openshift-network-diagnostics...
2026-06-02T07:40:21.492031640Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T07:40:21.623245444Z Gathering data for ns/openshift-network-node-identity...
2026-06-02T07:40:22.064092645Z Gathering data for ns/openshift-network-operator...
2026-06-02T07:40:22.416976402Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-02T07:40:22.665113718Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-02T07:40:23.105262893Z Gathering data for ns/openshift-apiserver-operator...
2026-06-02T07:40:23.368968149Z Gathering data for ns/openshift-apiserver...
2026-06-02T07:40:23.767569598Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-02T07:40:24.003084274Z Gathering data for ns/openshift-controller-manager...
2026-06-02T07:40:24.297671617Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-02T07:40:24.856965147Z Collecting kubelet logs for node ip-10-0-137-42.ec2.internal
2026-06-02T07:40:24.858858397Z Collecting kubelet logs for node ip-10-0-131-193.ec2.internal
2026-06-02T07:40:24.861116115Z Collecting kubelet logs for node ip-10-0-136-245.ec2.internal
2026-06-02T07:40:24.937306265Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-02T07:40:25.204538728Z daemonset.apps "perf-node-gather-daemonset" deleted
2026-06-02T07:40:25.209411491Z INFO: Node performance data collection complete.
2026-06-02T07:40:25.232207431Z Gathering data for ns/openshift-service-ca-operator...
2026-06-02T07:40:25.542103396Z Gathering data for ns/openshift-service-ca...
2026-06-02T07:40:25.879917423Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-02T07:40:26.497047525Z [disk usage checker] Volume usage percentage: current = 11 ; allowed = 70
2026-06-02T07:40:26.681962288Z Wrote inspect data to must-gather.
2026-06-02T07:40:26.682013190Z error: inspection completed with the errors occurred while gathering data:
2026-06-02T07:40:26.682013190Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-02T07:40:26.806690862Z error: the server doesn't have a resource type "clusters"
2026-06-02T07:40:26.936980833Z Caches written to disk