2026-07-13T12:07:24.841556700Z [disk usage checker] Started
2026-07-13T12:07:24.845100067Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-13T12:07:25.054456473Z Gathering data for ns/openshift-cluster-version...
2026-07-13T12:07:25.281307570Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-13T12:07:25.398719458Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-13T12:07:25.479833989Z Gathering data for ns/default...
2026-07-13T12:07:25.766682423Z Gathering data for ns/openshift...
2026-07-13T12:07:26.161592380Z Gathering data for ns/kube-system...
2026-07-13T12:07:26.822019387Z Gathering data for ns/openshift-etcd...
2026-07-13T12:07:27.120615124Z Wrote inspect data to must-gather.
2026-07-13T12:07:27.120819034Z error: inspection completed with the errors occurred while gathering data:
2026-07-13T12:07:27.120819034Z     namespaces "assisted-installer" not found
2026-07-13T12:07:27.491625579Z Waiting on subprocesses to finish execution.
2026-07-13T12:07:27.497317493Z Executing Istio gather script
2026-07-13T12:07:27.502257689Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-07-13T12:07:27.507120481Z INFO: Collecting host service logs for crio
2026-07-13T12:07:27.507439792Z INFO: Collecting host service logs for kubelet
2026-07-13T12:07:27.507801685Z INFO: Collecting host service logs for rpm-ostreed
2026-07-13T12:07:27.508271679Z INFO: Collecting host service logs for ostree-finalize-staged
2026-07-13T12:07:27.508619687Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-07-13T12:07:27.508956021Z INFO: Collecting host service logs for machine-config-daemon-host
2026-07-13T12:07:27.509279074Z INFO: Collecting host service logs for NetworkManager
2026-07-13T12:07:27.509619434Z INFO: Collecting host service logs for openvswitch
2026-07-13T12:07:27.509925937Z INFO: Collecting host service logs for ovs-configuration
2026-07-13T12:07:27.510313357Z INFO: Collecting host service logs for ovsdb-server
2026-07-13T12:07:27.510666637Z INFO: Collecting host service logs for ovs-vswitchd
2026-07-13T12:07:27.511072595Z INFO: Waiting for worker host service log collection to complete ...
2026-07-13T12:07:27.519568843Z INFO: Gathering HAProxy config files
2026-07-13T12:07:27.521708575Z INFO: Waiting for node performance related collection to complete ...
2026-07-13T12:07:27.523984091Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-07-13T12:07:27.546636382Z INFO: Gathering machine config daemon's old logs from all nodes
2026-07-13T12:07:28.185799302Z Wrote inspect data to must-gather.
2026-07-13T12:07:28.212656176Z No resources found
2026-07-13T12:07:28.216715801Z INFO: "sriov-network-operator" not detected. Skipping.
2026-07-13T12:07:28.330378432Z INFO: Found 1 replicas - prometheus-k8s-0
2026-07-13T12:07:28.522797594Z INFO: "metallb-operator" not detected. Skipping.
2026-07-13T12:07:28.534885032Z INFO: Collecting Insights Archives from insights-operator-68d9dd94cf-rpfth
2026-07-13T12:07:28.534885032Z insights-runtime-extractor-ffzqq
2026-07-13T12:07:28.534885032Z insights-runtime-extractor-qldl2
2026-07-13T12:07:28.534885032Z insights-runtime-extractor-w76x7
2026-07-13T12:07:28.897366696Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-13T12:07:28.924359441Z Wrote inspect data to must-gather.
2026-07-13T12:07:29.042775205Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-07-13T12:07:29.042819422Z INFO: on-disk MachineConfig config collection complete.
2026-07-13T12:07:29.199881612Z Wrote inspect data to must-gather.
2026-07-13T12:07:29.204465652Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-07-13T12:07:29.208896250Z error: the server doesn't have a resource type "performanceprofile"
2026-07-13T12:07:29.256095926Z INFO: Worker host service log collection to complete.
2026-07-13T12:07:29.321415307Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-07-13T12:07:29.473594978Z No resources found in openshift-etcd namespace.
2026-07-13T12:07:29.487920396Z INFO: Waiting for HAProxy config collection to complete ...
2026-07-13T12:07:29.528349573Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-07-13T12:07:29.533880604Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-07-13T12:07:29.692034005Z ERROR: No running kube-apiserver pods found
2026-07-13T12:07:29.756158034Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-07-13T12:07:29.858709257Z Wrote inspect data to must-gather.
2026-07-13T12:07:29.869887994Z No resources found
2026-07-13T12:07:29.884563786Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-13T12:07:29.894271410Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-07-13T12:07:29.894271410Z See 'oc rsync -h' for help and examples
2026-07-13T12:07:29.913054122Z Wrote inspect data to must-gather.
2026-07-13T12:07:29.939064218Z Wrote inspect data to must-gather.
2026-07-13T12:07:29.942884446Z Wrote inspect data to must-gather.
2026-07-13T12:07:30.042582242Z INFO: 'previous-logs' folder not found on ip-10-0-131-235.ec2.internal, skipping...
2026-07-13T12:07:30.059694208Z Wrote inspect data to must-gather.
2026-07-13T12:07:30.070947798Z tar: Removing leading `/' from member names
2026-07-13T12:07:30.076693966Z INFO: HAProxy config collection complete.
2026-07-13T12:07:30.151233155Z INFO: Getting rules from prometheus-k8s-0
2026-07-13T12:07:30.230810715Z Wrote inspect data to must-gather.
2026-07-13T12:07:30.261201248Z error: the server doesn't have a resource type "machineconfigs"
2026-07-13T12:07:30.357156660Z Gathering data for ns/openshift-monitoring...
2026-07-13T12:07:30.372561982Z INFO: 'previous-logs' folder not found on ip-10-0-140-22.ec2.internal, skipping...
2026-07-13T12:07:30.439242913Z error: the server doesn't have a resource type "machineconfigpools"
2026-07-13T12:07:30.512143043Z Wrote inspect data to must-gather.
2026-07-13T12:07:30.617107565Z INFO: Getting status/config from prometheus-k8s-0
2026-07-13T12:07:30.632170230Z INFO: 'previous-logs' folder not found on ip-10-0-140-59.ec2.internal, skipping...
2026-07-13T12:07:30.632277830Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-07-13T12:07:30.632431053Z INFO: Machine Config Daemon termination log collection complete.
2026-07-13T12:07:30.686673771Z Wrote inspect data to must-gather.
2026-07-13T12:07:30.813987640Z INFO: INTERCONNECT MODE
2026-07-13T12:07:30.814082661Z INFO: Gathering ovn-kubernetes DBs
2026-07-13T12:07:30.844421246Z error: the server doesn't have a resource type "kubeletconfigs"
2026-07-13T12:07:30.976602507Z INFO: Gathering OVN_Northbound from ovnkube-node-4rrqq...
2026-07-13T12:07:30.976850854Z INFO: Gathering OVN_Northbound from ovnkube-node-d78nz...
2026-07-13T12:07:30.977155753Z INFO: Gathering OVN_Northbound from ovnkube-node-f74qb...
2026-07-13T12:07:30.977499147Z INFO: Gathering OVN_Southbound from ovnkube-node-4rrqq...
2026-07-13T12:07:30.977760738Z INFO: Gathering OVN_Southbound from ovnkube-node-d78nz...
2026-07-13T12:07:30.978043837Z INFO: Gathering OVN_Southbound from ovnkube-node-f74qb...
2026-07-13T12:07:31.068087333Z INFO: Getting status/flags from prometheus-k8s-0
2026-07-13T12:07:31.120812167Z Wrote inspect data to must-gather.
2026-07-13T12:07:31.215638700Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-07-13T12:07:31.336197802Z tar: Removing leading `/' from member names
2026-07-13T12:07:31.347262129Z tar: Removing leading `/' from member names
2026-07-13T12:07:31.350677511Z tar: Removing leading `/' from member names
2026-07-13T12:07:31.351052904Z tar: Removing leading `/' from member names
2026-07-13T12:07:31.387458079Z tar: Removing leading `/' from member names
2026-07-13T12:07:31.434064496Z Wrote inspect data to must-gather.
2026-07-13T12:07:31.442786098Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:31.450569222Z tar: Removing leading `/' from member names
2026-07-13T12:07:31.470818573Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-07-13T12:07:31.667382981Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:31.669730215Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-07-13T12:07:31.680215660Z Wrote inspect data to must-gather.
2026-07-13T12:07:31.742819051Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-07-13T12:07:31.755120780Z INFO: Waiting for network log collection to complete ...
2026-07-13T12:07:31.755181096Z INFO: Waiting for ovnk database copies to complete ...
2026-07-13T12:07:31.755740721Z INFO: Copying ovnk databases complete.
2026-07-13T12:07:31.757731885Z 2.5M	must-gather/network_logs/ovnk_database_store
2026-07-13T12:07:31.760073186Z ovnk_database_store/
2026-07-13T12:07:31.760120612Z ovnk_database_store/ovnkube-node-4rrqq_sbdb
2026-07-13T12:07:31.778828978Z ovnk_database_store/ovnkube-node-4rrqq_nbdb
2026-07-13T12:07:31.786397392Z ovnk_database_store/ovnkube-node-f74qb_nbdb
2026-07-13T12:07:31.795000466Z ovnk_database_store/ovnkube-node-d78nz_nbdb
2026-07-13T12:07:31.803124246Z ovnk_database_store/ovnkube-node-f74qb_sbdb
2026-07-13T12:07:31.821686621Z ovnk_database_store/ovnkube-node-d78nz_sbdb
2026-07-13T12:07:31.845082627Z INFO: Network log collection complete.
2026-07-13T12:07:31.899858119Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:31.923071299Z Wrote inspect data to must-gather.
2026-07-13T12:07:31.981536399Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-13T12:07:32.008934093Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-07-13T12:07:32.089403731Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:32.093150173Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-07-13T12:07:32.125778291Z Wrote inspect data to must-gather.
2026-07-13T12:07:32.300838606Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:32.340638333Z Wrote inspect data to must-gather.
2026-07-13T12:07:32.383625878Z INFO: Getting status from alertmanager-main-0
2026-07-13T12:07:32.508706389Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:32.511641643Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-07-13T12:07:32.547908742Z W0713 12:07:32.547865    1564 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-07-13T12:07:32.553317659Z Wrote inspect data to must-gather.
2026-07-13T12:07:32.611205993Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-13T12:07:32.725679682Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:32.785495951Z Gathering data for ns/openshift-network-console...
2026-07-13T12:07:32.803333730Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-07-13T12:07:32.806078166Z INFO: Fallback to identify the container image from release info
2026-07-13T12:07:32.930180819Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:32.933040332Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-07-13T12:07:33.095785868Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:33.179161835Z Gathering data for ns/openshift-console-operator...
2026-07-13T12:07:33.290314288Z Wrote inspect data to /must-gather/istio.
2026-07-13T12:07:33.451471059Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8d5dc4ea635b13544e6f92103089219e732369ae30557b7beee2e8a11bf500d
2026-07-13T12:07:33.580843394Z Gathering data for ns/openshift-console...
2026-07-13T12:07:33.588757379Z daemonset.apps/perf-node-gather-daemonset created
2026-07-13T12:07:33.725818332Z Waiting for performance profile collector pods to become ready: 1
2026-07-13T12:07:33.953463648Z Done executing Istio gather script
2026-07-13T12:07:34.122868451Z Gathering data for ns/openshift-cluster-storage-operator...
2026-07-13T12:07:34.582701202Z Gathering data for ns/openshift-dns-operator...
2026-07-13T12:07:34.846002965Z Waiting for performance profile collector pods to become ready: 2
2026-07-13T12:07:34.852078974Z Gathering data for ns/openshift-dns...
2026-07-13T12:07:34.910718474Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-13T12:07:35.468313089Z Gathering data for ns/openshift-image-registry...
2026-07-13T12:07:35.930854123Z Gathering data for ns/openshift-ingress-operator...
2026-07-13T12:07:35.970408937Z Waiting for performance profile collector pods to become ready: 3
2026-07-13T12:07:36.286364162Z Gathering data for ns/openshift-ingress...
2026-07-13T12:07:36.609151519Z Gathering data for ns/openshift-ingress-canary...
2026-07-13T12:07:36.985995347Z Gathering data for ns/openshift-insights...
2026-07-13T12:07:37.075857374Z Waiting for performance profile collector pods to become ready: 4
2026-07-13T12:07:38.192432906Z Waiting for performance profile collector pods to become ready: 5
2026-07-13T12:07:38.895196795Z Gathering data for ns/openshift-config...
2026-07-13T12:07:39.156576033Z Gathering data for ns/openshift-config-managed...
2026-07-13T12:07:39.303230087Z Waiting for performance profile collector pods to become ready: 6
2026-07-13T12:07:39.592515554Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-07-13T12:07:39.911847164Z Gathering data for ns/openshift-kube-apiserver...
2026-07-13T12:07:39.915250353Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-13T12:07:40.219645893Z Gathering data for ns/openshift-kube-controller-manager...
2026-07-13T12:07:40.408146296Z Waiting for performance profile collector pods to become ready: 7
2026-07-13T12:07:40.535266140Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-07-13T12:07:40.898330851Z Gathering data for ns/openshift-kube-scheduler...
2026-07-13T12:07:41.169312778Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-07-13T12:07:41.530397226Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-07-13T12:07:41.537351311Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-07-13T12:07:41.760249744Z Collecting performance related data for node ip-10-0-140-22.ec2.internal
2026-07-13T12:07:41.766982742Z Collecting performance related data for node ip-10-0-140-59.ec2.internal
2026-07-13T12:07:41.774055082Z Collecting performance related data for node ip-10-0-131-235.ec2.internal
2026-07-13T12:07:41.978712188Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-07-13T12:07:42.359140668Z Gathering data for ns/openshift-user-workload-monitoring...
2026-07-13T12:07:42.951935588Z Gathering data for ns/openshift-multus...
2026-07-13T12:07:44.639565074Z Gathering data for ns/openshift-ovn-kubernetes...
2026-07-13T12:07:44.919878263Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-13T12:07:45.996478936Z Gathering data for ns/openshift-host-network...
2026-07-13T12:07:46.298509464Z Gathering data for ns/openshift-network-diagnostics...
2026-07-13T12:07:46.905663737Z Gathering data for ns/openshift-network-node-identity...
2026-07-13T12:07:47.333329513Z Gathering data for ns/openshift-network-operator...
2026-07-13T12:07:47.728700830Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-07-13T12:07:47.982157737Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-07-13T12:07:48.463343849Z Gathering data for ns/openshift-apiserver-operator...
2026-07-13T12:07:48.802668085Z Gathering data for ns/openshift-apiserver...
2026-07-13T12:07:49.200630446Z Gathering data for ns/openshift-controller-manager-operator...
2026-07-13T12:07:49.463848415Z Gathering data for ns/openshift-controller-manager...
2026-07-13T12:07:49.733353168Z Gathering data for ns/openshift-cluster-samples-operator...
2026-07-13T12:07:49.772609351Z Collecting kubelet logs for node ip-10-0-140-22.ec2.internal
2026-07-13T12:07:49.774359815Z Collecting kubelet logs for node ip-10-0-140-59.ec2.internal
2026-07-13T12:07:49.776177342Z Collecting kubelet logs for node ip-10-0-131-235.ec2.internal
2026-07-13T12:07:49.924451882Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-13T12:07:50.128146079Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-h75gp namespace
2026-07-13T12:07:50.135314921Z INFO: Node performance data collection complete.
2026-07-13T12:07:50.428073787Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-07-13T12:07:50.701611225Z Gathering data for ns/openshift-service-ca-operator...
2026-07-13T12:07:51.024459909Z Gathering data for ns/openshift-service-ca...
2026-07-13T12:07:51.447976722Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-07-13T12:07:52.344448041Z Wrote inspect data to must-gather.
2026-07-13T12:07:52.344497022Z error: inspection completed with the errors occurred while gathering data:
2026-07-13T12:07:52.344497022Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-07-13T12:07:52.465328727Z error: the server doesn't have a resource type "clusters"
2026-07-13T12:07:52.595422068Z Caches written to disk