2026-07-31T14:42:22.731786965Z [disk usage checker] Started
2026-07-31T14:42:22.735214028Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:42:22.930646671Z Gathering data for ns/openshift-cluster-version...
2026-07-31T14:42:23.066610728Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-31T14:42:23.157395979Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-31T14:42:23.237028210Z Gathering data for ns/default...
2026-07-31T14:42:23.529551686Z Gathering data for ns/openshift...
2026-07-31T14:42:23.962388271Z Gathering data for ns/kube-system...
2026-07-31T14:42:24.714096012Z Gathering data for ns/openshift-etcd...
2026-07-31T14:42:25.029851891Z Wrote inspect data to must-gather.
2026-07-31T14:42:25.029886101Z error: inspection completed with the errors occurred while gathering data:
2026-07-31T14:42:25.029886101Z     namespaces "assisted-installer" not found
2026-07-31T14:42:25.301098104Z Waiting on subprocesses to finish execution.
2026-07-31T14:42:25.305633998Z INFO: Gathering HAProxy config files
2026-07-31T14:42:25.305669174Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-07-31T14:42:25.308318754Z INFO: Gathering machine config daemon's old logs from all nodes
2026-07-31T14:42:25.309237645Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-07-31T14:42:25.313455467Z INFO: Collecting host service logs for crio
2026-07-31T14:42:25.313772609Z INFO: Collecting host service logs for kubelet
2026-07-31T14:42:25.314126358Z INFO: Collecting host service logs for rpm-ostreed
2026-07-31T14:42:25.314495774Z INFO: Collecting host service logs for ostree-finalize-staged
2026-07-31T14:42:25.314836676Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-07-31T14:42:25.315199264Z INFO: Collecting host service logs for machine-config-daemon-host
2026-07-31T14:42:25.315547987Z INFO: Collecting host service logs for NetworkManager
2026-07-31T14:42:25.315885089Z INFO: Collecting host service logs for openvswitch
2026-07-31T14:42:25.316249122Z INFO: Collecting host service logs for ovs-configuration
2026-07-31T14:42:25.316716203Z INFO: Collecting host service logs for ovsdb-server
2026-07-31T14:42:25.317070212Z INFO: Collecting host service logs for ovs-vswitchd
2026-07-31T14:42:25.317486346Z INFO: Waiting for worker host service log collection to complete ...
2026-07-31T14:42:25.364147843Z Executing Istio gather script
2026-07-31T14:42:25.477375811Z INFO: Waiting for node performance related collection to complete ...
2026-07-31T14:42:26.148360544Z No resources found in openshift-etcd namespace.
2026-07-31T14:42:26.186317594Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-07-31T14:42:26.186358639Z INFO: on-disk MachineConfig config collection complete.
2026-07-31T14:42:26.269814276Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-07-31T14:42:26.320155517Z INFO: Found 1 replicas - prometheus-k8s-0
2026-07-31T14:42:26.448308980Z No resources found
2026-07-31T14:42:26.472313107Z INFO: "metallb-operator" not detected. Skipping.
2026-07-31T14:42:26.535367860Z Wrote inspect data to must-gather.
2026-07-31T14:42:26.546158318Z INFO: "sriov-network-operator" not detected. Skipping.
2026-07-31T14:42:26.607319978Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-07-31T14:42:26.638914702Z INFO: Collecting Insights Archives from insights-operator-77696685b-5g7k5
2026-07-31T14:42:26.638987978Z insights-runtime-extractor-84q9m
2026-07-31T14:42:26.639009749Z insights-runtime-extractor-cgj5h
2026-07-31T14:42:26.639027578Z insights-runtime-extractor-r6xdx
2026-07-31T14:42:26.665502510Z error: the server doesn't have a resource type "performanceprofile"
2026-07-31T14:42:26.672430528Z INFO: Worker host service log collection to complete.
2026-07-31T14:42:26.808423877Z ERROR: No running kube-apiserver pods found
2026-07-31T14:42:26.915690528Z INFO: Waiting for HAProxy config collection to complete ...
2026-07-31T14:42:26.948088672Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-07-31T14:42:26.948088672Z See 'oc rsync -h' for help and examples
2026-07-31T14:42:27.022482900Z Wrote inspect data to must-gather.
2026-07-31T14:42:27.024218388Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-07-31T14:42:27.354554997Z No resources found
2026-07-31T14:42:27.508198292Z Wrote inspect data to must-gather.
2026-07-31T14:42:27.510155098Z INFO: 'previous-logs' folder not found on ip-10-0-130-28.ec2.internal, skipping...
2026-07-31T14:42:27.532181535Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-31T14:42:27.790415924Z Wrote inspect data to must-gather.
2026-07-31T14:42:27.791035062Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:42:27.807780149Z Wrote inspect data to must-gather.
2026-07-31T14:42:27.858367339Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-07-31T14:42:27.876854387Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-07-31T14:42:27.899468212Z Gathering data for ns/openshift-monitoring...
2026-07-31T14:42:27.919827385Z Wrote inspect data to must-gather.
2026-07-31T14:42:27.938326900Z tar: Removing leading `/' from member names
2026-07-31T14:42:27.944757627Z INFO: HAProxy config collection complete.
2026-07-31T14:42:28.006235138Z Wrote inspect data to must-gather.
2026-07-31T14:42:28.039336932Z INFO: 'previous-logs' folder not found on ip-10-0-133-180.ec2.internal, skipping...
2026-07-31T14:42:28.061216448Z INFO: Getting rules from prometheus-k8s-0
2026-07-31T14:42:28.101321224Z error: the server doesn't have a resource type "machineconfigs"
2026-07-31T14:42:28.133397589Z Wrote inspect data to must-gather.
2026-07-31T14:42:28.260037142Z error: the server doesn't have a resource type "machineconfigpools"
2026-07-31T14:42:28.302321527Z INFO: 'previous-logs' folder not found on ip-10-0-138-146.ec2.internal, skipping...
2026-07-31T14:42:28.302366469Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-07-31T14:42:28.302366469Z INFO: Machine Config Daemon termination log collection complete.
2026-07-31T14:42:28.389523780Z Wrote inspect data to must-gather.
2026-07-31T14:42:28.470994737Z INFO: Getting status/config from prometheus-k8s-0
2026-07-31T14:42:28.492450427Z Wrote inspect data to must-gather.
2026-07-31T14:42:28.627715150Z Wrote inspect data to must-gather.
2026-07-31T14:42:28.640109269Z error: the server doesn't have a resource type "kubeletconfigs"
2026-07-31T14:42:28.773036388Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-07-31T14:42:28.861408255Z Wrote inspect data to must-gather.
2026-07-31T14:42:28.866698185Z INFO: Getting status/flags from prometheus-k8s-0
2026-07-31T14:42:28.913215994Z INFO: INTERCONNECT MODE
2026-07-31T14:42:28.913265267Z INFO: Gathering ovn-kubernetes DBs
2026-07-31T14:42:28.945180412Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:29.064489755Z Wrote inspect data to must-gather.
2026-07-31T14:42:29.072557355Z INFO: Gathering OVN_Northbound from ovnkube-node-65hrh...
2026-07-31T14:42:29.072784705Z INFO: Gathering OVN_Northbound from ovnkube-node-9mttx...
2026-07-31T14:42:29.073016025Z INFO: Gathering OVN_Northbound from ovnkube-node-k2ddm...
2026-07-31T14:42:29.073286444Z INFO: Gathering OVN_Southbound from ovnkube-node-65hrh...
2026-07-31T14:42:29.073545199Z INFO: Gathering OVN_Southbound from ovnkube-node-9mttx...
2026-07-31T14:42:29.073827859Z INFO: Gathering OVN_Southbound from ovnkube-node-k2ddm...
2026-07-31T14:42:29.122295440Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-07-31T14:42:29.269165790Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:29.272671335Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-07-31T14:42:29.365149744Z tar: Removing leading `/' from member names
2026-07-31T14:42:29.384387837Z tar: Removing leading `/' from member names
2026-07-31T14:42:29.389989463Z Wrote inspect data to must-gather.
2026-07-31T14:42:29.397063332Z tar: Removing leading `/' from member names
2026-07-31T14:42:29.406143617Z tar: Removing leading `/' from member names
2026-07-31T14:42:29.415066585Z tar: Removing leading `/' from member names
2026-07-31T14:42:29.415579367Z tar: Removing leading `/' from member names
2026-07-31T14:42:29.495297159Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-07-31T14:42:29.522010769Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:29.653683498Z Wrote inspect data to must-gather.
2026-07-31T14:42:29.682042960Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-31T14:42:29.757781920Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:29.761294585Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-07-31T14:42:29.762718990Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-07-31T14:42:29.871725929Z INFO: Waiting for network log collection to complete ...
2026-07-31T14:42:29.871850682Z INFO: Waiting for ovnk database copies to complete ...
2026-07-31T14:42:29.872387280Z INFO: Copying ovnk databases complete.
2026-07-31T14:42:29.875008085Z 2.4M	must-gather/network_logs/ovnk_database_store
2026-07-31T14:42:29.878926243Z ovnk_database_store/
2026-07-31T14:42:29.878926243Z ovnk_database_store/ovnkube-node-9mttx_sbdb
2026-07-31T14:42:29.886618882Z Wrote inspect data to must-gather.
2026-07-31T14:42:29.897755518Z ovnk_database_store/ovnkube-node-9mttx_nbdb
2026-07-31T14:42:29.903334707Z ovnk_database_store/ovnkube-node-k2ddm_sbdb
2026-07-31T14:42:29.920175433Z ovnk_database_store/ovnkube-node-k2ddm_nbdb
2026-07-31T14:42:29.925793475Z ovnk_database_store/ovnkube-node-65hrh_nbdb
2026-07-31T14:42:29.932610355Z ovnk_database_store/ovnkube-node-65hrh_sbdb
2026-07-31T14:42:29.952900914Z INFO: Network log collection complete.
2026-07-31T14:42:29.981496636Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:30.092780115Z Wrote inspect data to must-gather.
2026-07-31T14:42:30.177124097Z INFO: Getting status from alertmanager-main-0
2026-07-31T14:42:30.193340542Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:30.196651064Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-07-31T14:42:30.292467233Z W0731 14:42:30.292406    1593 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-07-31T14:42:30.298883881Z Wrote inspect data to must-gather.
2026-07-31T14:42:30.353886796Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-31T14:42:30.428341002Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:30.540398467Z Gathering data for ns/openshift-network-console...
2026-07-31T14:42:30.559699156Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-07-31T14:42:30.563045659Z INFO: Fallback to identify the container image from release info
2026-07-31T14:42:30.631328191Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:30.634557025Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-07-31T14:42:30.792892024Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:30.979316426Z Wrote inspect data to /must-gather/istio.
2026-07-31T14:42:30.982640424Z Gathering data for ns/openshift-console-operator...
2026-07-31T14:42:31.190428840Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f2eb1033f55d7129b37ecfc3e4e9a306e42e5ab3dd7d2fe0ff08c8b45ea2b675
2026-07-31T14:42:31.311304804Z daemonset.apps/perf-node-gather-daemonset created
2026-07-31T14:42:31.409594338Z Gathering data for ns/openshift-console...
2026-07-31T14:42:31.442598716Z Waiting for performance profile collector pods to become ready: 1
2026-07-31T14:42:31.637779092Z Done executing Istio gather script
2026-07-31T14:42:31.914265842Z Gathering data for ns/openshift-cluster-storage-operator...
2026-07-31T14:42:32.402190473Z Gathering data for ns/openshift-dns-operator...
2026-07-31T14:42:32.548183753Z Waiting for performance profile collector pods to become ready: 2
2026-07-31T14:42:32.743461719Z Gathering data for ns/openshift-dns...
2026-07-31T14:42:32.798835387Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:42:33.362166552Z Gathering data for ns/openshift-image-registry...
2026-07-31T14:42:33.666301929Z Waiting for performance profile collector pods to become ready: 3
2026-07-31T14:42:33.914491259Z Gathering data for ns/openshift-ingress-operator...
2026-07-31T14:42:34.220910501Z Gathering data for ns/openshift-ingress...
2026-07-31T14:42:34.573606658Z Gathering data for ns/openshift-ingress-canary...
2026-07-31T14:42:34.788006149Z Waiting for performance profile collector pods to become ready: 4
2026-07-31T14:42:34.997197641Z Gathering data for ns/openshift-insights...
2026-07-31T14:42:35.889954611Z Waiting for performance profile collector pods to become ready: 5
2026-07-31T14:42:36.933181467Z Gathering data for ns/openshift-config...
2026-07-31T14:42:37.014330571Z Waiting for performance profile collector pods to become ready: 6
2026-07-31T14:42:37.205127591Z Gathering data for ns/openshift-config-managed...
2026-07-31T14:42:37.623919452Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-07-31T14:42:37.803811159Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:42:37.930688512Z Gathering data for ns/openshift-kube-apiserver...
2026-07-31T14:42:38.113919591Z Waiting for performance profile collector pods to become ready: 7
2026-07-31T14:42:38.249350360Z Gathering data for ns/openshift-kube-controller-manager...
2026-07-31T14:42:38.530818141Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-07-31T14:42:38.821285699Z Gathering data for ns/openshift-kube-scheduler...
2026-07-31T14:42:39.073327303Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-07-31T14:42:39.221773735Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-07-31T14:42:39.404693007Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-07-31T14:42:39.474473320Z Collecting performance related data for node ip-10-0-138-146.ec2.internal
2026-07-31T14:42:39.481139140Z Collecting performance related data for node ip-10-0-130-28.ec2.internal
2026-07-31T14:42:39.489890049Z Collecting performance related data for node ip-10-0-133-180.ec2.internal
2026-07-31T14:42:39.869478431Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-07-31T14:42:40.301615242Z Gathering data for ns/openshift-user-workload-monitoring...
2026-07-31T14:42:40.885693189Z Gathering data for ns/openshift-multus...
2026-07-31T14:42:42.659008085Z Gathering data for ns/openshift-ovn-kubernetes...
2026-07-31T14:42:42.808706004Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:42:44.171309815Z Gathering data for ns/openshift-host-network...
2026-07-31T14:42:44.483235289Z Gathering data for ns/openshift-network-diagnostics...
2026-07-31T14:42:45.014746133Z Gathering data for ns/openshift-network-node-identity...
2026-07-31T14:42:45.460391372Z Gathering data for ns/openshift-network-operator...
2026-07-31T14:42:45.838680319Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-07-31T14:42:46.102830036Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-07-31T14:42:46.640206246Z Gathering data for ns/openshift-apiserver-operator...
2026-07-31T14:42:46.974173506Z Gathering data for ns/openshift-apiserver...
2026-07-31T14:42:47.434916866Z Gathering data for ns/openshift-controller-manager-operator...
2026-07-31T14:42:47.510336658Z Collecting kubelet logs for node ip-10-0-138-146.ec2.internal
2026-07-31T14:42:47.512195236Z Collecting kubelet logs for node ip-10-0-130-28.ec2.internal
2026-07-31T14:42:47.513934279Z Collecting kubelet logs for node ip-10-0-133-180.ec2.internal
2026-07-31T14:42:47.733047483Z Gathering data for ns/openshift-controller-manager...
2026-07-31T14:42:47.813979936Z [disk usage checker] Volume usage percentage: current = 10 ; allowed = 70
2026-07-31T14:42:47.851416554Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-cchsp namespace
2026-07-31T14:42:47.859187319Z INFO: Node performance data collection complete.
2026-07-31T14:42:48.015865257Z Gathering data for ns/openshift-cluster-samples-operator...
2026-07-31T14:42:48.712939212Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-07-31T14:42:48.998918568Z Gathering data for ns/openshift-service-ca-operator...
2026-07-31T14:42:49.308531008Z Gathering data for ns/openshift-service-ca...
2026-07-31T14:42:49.643293753Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-07-31T14:42:50.519392442Z Wrote inspect data to must-gather.
2026-07-31T14:42:50.519429441Z error: inspection completed with the errors occurred while gathering data:
2026-07-31T14:42:50.519429441Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-07-31T14:42:50.638093390Z error: the server doesn't have a resource type "clusters"
2026-07-31T14:42:50.759467967Z Caches written to disk