2026-06-15T07:35:50.412006058Z [disk usage checker] Started
2026-06-15T07:35:50.415910504Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:35:50.635154948Z Gathering data for ns/openshift-cluster-version...
2026-06-15T07:35:50.810236324Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T07:35:50.923925741Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T07:35:51.032727405Z Gathering data for ns/default...
2026-06-15T07:35:51.396756743Z Gathering data for ns/openshift...
2026-06-15T07:35:51.916670340Z Gathering data for ns/kube-system...
2026-06-15T07:35:52.783309064Z Gathering data for ns/openshift-etcd...
2026-06-15T07:35:53.170138228Z Wrote inspect data to must-gather.
2026-06-15T07:35:53.170368947Z error: inspection completed with the errors occurred while gathering data:
2026-06-15T07:35:53.170368947Z     namespaces "assisted-installer" not found
2026-06-15T07:35:53.415512865Z Waiting on subprocesses to finish execution.
2026-06-15T07:35:53.423400988Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-06-15T07:35:53.428881137Z INFO: Gathering machine config daemon's old logs from all nodes
2026-06-15T07:35:53.431994934Z Executing Istio gather script
2026-06-15T07:35:53.442152320Z INFO: Gathering HAProxy config files
2026-06-15T07:35:53.444005143Z INFO: Collecting host service logs for crio
2026-06-15T07:35:53.444390520Z INFO: Collecting host service logs for kubelet
2026-06-15T07:35:53.444706888Z INFO: Collecting host service logs for rpm-ostreed
2026-06-15T07:35:53.445008352Z INFO: Collecting host service logs for ostree-finalize-staged
2026-06-15T07:35:53.445347917Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-06-15T07:35:53.445650757Z INFO: Collecting host service logs for machine-config-daemon-host
2026-06-15T07:35:53.445965616Z INFO: Collecting host service logs for NetworkManager
2026-06-15T07:35:53.446283396Z INFO: Collecting host service logs for openvswitch
2026-06-15T07:35:53.446592218Z INFO: Collecting host service logs for ovs-configuration
2026-06-15T07:35:53.446899749Z INFO: Collecting host service logs for ovsdb-server
2026-06-15T07:35:53.447217374Z INFO: Collecting host service logs for ovs-vswitchd
2026-06-15T07:35:53.447580766Z INFO: Waiting for worker host service log collection to complete ...
2026-06-15T07:35:53.450140903Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-06-15T07:35:53.512777297Z INFO: Waiting for node performance related collection to complete ...
2026-06-15T07:35:53.774037554Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-06-15T07:35:53.876046581Z No resources found in openshift-etcd namespace.
2026-06-15T07:35:53.913291807Z No resources found
2026-06-15T07:35:54.489471929Z INFO: Collecting Insights Archives from insights-operator-5bbd86d6bd-4bc2h
2026-06-15T07:35:54.489514805Z insights-runtime-extractor-bx7hl
2026-06-15T07:35:54.489534417Z insights-runtime-extractor-mrjn4
2026-06-15T07:35:54.489553920Z insights-runtime-extractor-sfxtc
2026-06-15T07:35:54.509045604Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-06-15T07:35:54.688203158Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-06-15T07:35:54.688300730Z INFO: on-disk MachineConfig config collection complete.
2026-06-15T07:35:54.694154165Z INFO: Found 1 replicas - prometheus-k8s-0
2026-06-15T07:35:54.727339635Z Inspecting resource ns/openshift-operators
2026-06-15T07:35:54.734353793Z INFO: "sriov-network-operator" not detected. Skipping.
2026-06-15T07:35:54.942425418Z Wrote inspect data to must-gather.
2026-06-15T07:35:55.112444828Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-06-15T07:35:55.112444828Z See 'oc rsync -h' for help and examples
2026-06-15T07:35:55.123951733Z error: the server doesn't have a resource type "performanceprofile"
2026-06-15T07:35:55.126343561Z ERROR: No running kube-apiserver pods found
2026-06-15T07:35:55.198102352Z INFO: Worker host service log collection to complete.
2026-06-15T07:35:55.352845979Z Gathering data for ns/openshift-operators...
2026-06-15T07:35:55.386934572Z INFO: "metallb-operator" not detected. Skipping.
2026-06-15T07:35:55.440948781Z INFO: Waiting for HAProxy config collection to complete ...
2026-06-15T07:35:55.628726619Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:35:55.882391541Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-06-15T07:35:56.146676102Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-06-15T07:35:56.157875171Z No resources found
2026-06-15T07:35:56.230821863Z INFO: 'previous-logs' folder not found on ip-10-0-128-226.ec2.internal, skipping...
2026-06-15T07:35:56.301278825Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T07:35:56.373801201Z Wrote inspect data to must-gather.
2026-06-15T07:35:56.467877582Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T07:35:56.536760111Z Gathering data for ns/kuadrant-system...
2026-06-15T07:35:56.646203753Z Wrote inspect data to must-gather.
2026-06-15T07:35:56.811458524Z Wrote inspect data to must-gather.
2026-06-15T07:35:56.889894171Z Wrote inspect data to must-gather.
2026-06-15T07:35:56.914129530Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T07:35:56.950641673Z tar: Removing leading `/' from member names
2026-06-15T07:35:56.954966314Z INFO: HAProxy config collection complete.
2026-06-15T07:35:57.041096037Z Wrote inspect data to must-gather.
2026-06-15T07:35:57.138001478Z error: the server doesn't have a resource type "machineconfigs"
2026-06-15T07:35:57.325847143Z INFO: 'previous-logs' folder not found on ip-10-0-128-243.ec2.internal, skipping...
2026-06-15T07:35:57.355761522Z INFO: Getting rules from prometheus-k8s-0
2026-06-15T07:35:57.376891448Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:35:57.393596490Z Inspecting resource clusterserviceversion in namespace openshift-operators
2026-06-15T07:35:57.439948031Z Wrote inspect data to must-gather.
2026-06-15T07:35:57.504348933Z error: the server doesn't have a resource type "machineconfigpools"
2026-06-15T07:35:57.575234053Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T07:35:57.979178379Z W0615 07:35:57.979128    1132 util.go:195] skipping , failed to read event err: Object 'Kind' is missing in ''
2026-06-15T07:35:58.009127754Z INFO: 'previous-logs' folder not found on ip-10-0-141-25.ec2.internal, skipping...
2026-06-15T07:35:58.009233014Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-06-15T07:35:58.009283102Z INFO: Machine Config Daemon termination log collection complete.
2026-06-15T07:35:58.010706554Z Wrote inspect data to must-gather.
2026-06-15T07:35:58.019465292Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:35:58.020542621Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T07:35:58.176921631Z Wrote inspect data to must-gather.
2026-06-15T07:35:58.260801816Z INFO: Getting status/config from prometheus-k8s-0
2026-06-15T07:35:58.418635958Z Gathering data for ns/openshift-monitoring...
2026-06-15T07:35:58.510789462Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-06-15T07:35:58.537562996Z error: the server doesn't have a resource type "kubeletconfigs"
2026-06-15T07:35:58.594719666Z Wrote inspect data to must-gather.
2026-06-15T07:35:58.647628305Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istio-reader-clusterrole-openshift-gateway-openshift-ingress
2026-06-15T07:35:58.901350061Z Wrote inspect data to must-gather.
2026-06-15T07:35:58.908922799Z INFO: Getting status/flags from prometheus-k8s-0
2026-06-15T07:35:58.996650725Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:35:58.999789300Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istiod-clusterrole-openshift-gateway-openshift-ingress
2026-06-15T07:35:59.023141607Z INFO: INTERCONNECT MODE
2026-06-15T07:35:59.023223623Z INFO: Gathering ovn-kubernetes DBs
2026-06-15T07:35:59.275220757Z Wrote inspect data to must-gather.
2026-06-15T07:35:59.275636192Z INFO: Gathering OVN_Northbound from ovnkube-node-f4bzh...
2026-06-15T07:35:59.276964733Z INFO: Gathering OVN_Northbound from ovnkube-node-r4jhk...
2026-06-15T07:35:59.276964733Z INFO: Gathering OVN_Northbound from ovnkube-node-rkdkp...
2026-06-15T07:35:59.277816669Z INFO: Gathering OVN_Southbound from ovnkube-node-f4bzh...
2026-06-15T07:35:59.277816669Z INFO: Gathering OVN_Southbound from ovnkube-node-r4jhk...
2026-06-15T07:35:59.277816669Z INFO: Gathering OVN_Southbound from ovnkube-node-rkdkp...
2026-06-15T07:35:59.277816669Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-06-15T07:35:59.387841705Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:35:59.393553427Z Inspecting resource clusterrole.rbac.authorization.k8s.io/istiod-gateway-controller-openshift-gateway-openshift-ingress
2026-06-15T07:35:59.611499056Z tar: Removing leading `/' from member names
2026-06-15T07:35:59.793957773Z tar: Removing leading `/' from member names
2026-06-15T07:35:59.795019936Z tar: Removing leading `/' from member names
2026-06-15T07:35:59.810266865Z tar: Removing leading `/' from member names
2026-06-15T07:35:59.857763288Z tar: Removing leading `/' from member names
2026-06-15T07:35:59.875178760Z tar: Removing leading `/' from member names
2026-06-15T07:35:59.886782436Z Wrote inspect data to must-gather.
2026-06-15T07:35:59.896672442Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:35:59.899251176Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istio-reader-clusterrole-openshift-gateway-openshift-ingress
2026-06-15T07:35:59.929151381Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-06-15T07:36:00.191068406Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:00.195447758Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istiod-clusterrole-openshift-gateway-openshift-ingress
2026-06-15T07:36:00.258115516Z Wrote inspect data to must-gather.
2026-06-15T07:36:00.295816867Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-06-15T07:36:00.426621268Z INFO: Waiting for network log collection to complete ...
2026-06-15T07:36:00.427739381Z INFO: Waiting for ovnk database copies to complete ...
2026-06-15T07:36:00.428955945Z INFO: Copying ovnk databases complete.
2026-06-15T07:36:00.431369505Z 6.2M	must-gather/network_logs/ovnk_database_store
2026-06-15T07:36:00.434295123Z ovnk_database_store/
2026-06-15T07:36:00.434362205Z ovnk_database_store/ovnkube-node-f4bzh_sbdb
2026-06-15T07:36:00.480937359Z ovnk_database_store/ovnkube-node-r4jhk_sbdb
2026-06-15T07:36:00.502072037Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:00.505641423Z Inspecting resource clusterrolebinding.rbac.authorization.k8s.io/istiod-gateway-controller-openshift-gateway-openshift-ingress
2026-06-15T07:36:00.517193968Z ovnk_database_store/ovnkube-node-rkdkp_sbdb
2026-06-15T07:36:00.561792953Z ovnk_database_store/ovnkube-node-f4bzh_nbdb
2026-06-15T07:36:00.578358005Z ovnk_database_store/ovnkube-node-rkdkp_nbdb
2026-06-15T07:36:00.590487995Z ovnk_database_store/ovnkube-node-r4jhk_nbdb
2026-06-15T07:36:00.590529092Z Wrote inspect data to must-gather.
2026-06-15T07:36:00.605243610Z INFO: Network log collection complete.
2026-06-15T07:36:00.721402977Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:36:00.839452840Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:00.932015220Z Wrote inspect data to must-gather.
2026-06-15T07:36:01.057899942Z INFO: Getting status from alertmanager-main-0
2026-06-15T07:36:01.265119337Z Wrote inspect data to must-gather.
2026-06-15T07:36:01.586319813Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-06-15T07:36:01.589250105Z INFO: Fallback to identify the container image from release info
2026-06-15T07:36:02.097676155Z Gathering data for ns/openshift-network-console...
2026-06-15T07:36:02.124803348Z Wrote inspect data to must-gather.
2026-06-15T07:36:02.271840286Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d66a6b2ec52dede5d83ce04f6abfc519df1fd7dc36248741e03ecb9bf8d1762
2026-06-15T07:36:02.399774631Z daemonset.apps/perf-node-gather-daemonset created
2026-06-15T07:36:02.563475586Z Waiting for performance profile collector pods to become ready: 1
2026-06-15T07:36:02.714797812Z Gathering data for ns/openshift-console-operator...
2026-06-15T07:36:03.173390441Z Inspecting resource crd/authorizationpolicies.security.istio.io
2026-06-15T07:36:03.241054951Z Gathering data for ns/openshift-console...
2026-06-15T07:36:03.367995641Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:03.604495635Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:03.608108223Z Inspecting resource crd/destinationrules.networking.istio.io
2026-06-15T07:36:03.720284111Z Waiting for performance profile collector pods to become ready: 2
2026-06-15T07:36:03.883729580Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:03.993553579Z Gathering data for ns/openshift-cluster-storage-operator...
2026-06-15T07:36:04.144841740Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:04.147070214Z Inspecting resource crd/envoyfilters.networking.istio.io
2026-06-15T07:36:04.337652405Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:04.588595392Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:04.591309943Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-06-15T07:36:04.714352331Z Gathering data for ns/openshift-dns-operator...
2026-06-15T07:36:04.821811034Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:04.882248096Z Waiting for performance profile collector pods to become ready: 3
2026-06-15T07:36:05.070291600Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:05.073291194Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-06-15T07:36:05.166254697Z Gathering data for ns/openshift-dns...
2026-06-15T07:36:05.290116599Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:05.501988912Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:05.504386603Z Inspecting resource crd/gateways.networking.istio.io
2026-06-15T07:36:05.709471056Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:05.726278525Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:36:05.928216213Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:05.930985235Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-06-15T07:36:06.044884060Z Waiting for performance profile collector pods to become ready: 4
2026-06-15T07:36:06.114707855Z Gathering data for ns/openshift-image-registry...
2026-06-15T07:36:06.171347768Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:06.380333475Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:06.383961629Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-06-15T07:36:06.613065502Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:06.811160213Z Gathering data for ns/openshift-ingress-operator...
2026-06-15T07:36:06.879815106Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:06.883434523Z Inspecting resource crd/inferencemodelrewrites.inference.networking.x-k8s.io
2026-06-15T07:36:07.069864317Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:07.195852883Z Waiting for performance profile collector pods to become ready: 5
2026-06-15T07:36:07.304600603Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:07.307130581Z Inspecting resource crd/inferenceobjectives.inference.networking.x-k8s.io
2026-06-15T07:36:07.392928698Z Gathering data for ns/openshift-ingress...
2026-06-15T07:36:07.490011724Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:07.732652161Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:07.735358694Z Inspecting resource crd/inferencepoolimports.inference.networking.x-k8s.io
2026-06-15T07:36:07.913525879Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:08.120819075Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:08.123499111Z Inspecting resource crd/inferencepools.inference.networking.k8s.io
2026-06-15T07:36:08.331650069Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:08.334976995Z Waiting for performance profile collector pods to become ready: 6
2026-06-15T07:36:08.541967634Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:08.544459270Z Inspecting resource crd/inferencepools.inference.networking.x-k8s.io
2026-06-15T07:36:08.745466091Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:08.984338284Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:08.987931254Z Inspecting resource crd/istiocnis.sailoperator.io
2026-06-15T07:36:09.100709994Z Gathering data for ns/openshift-ingress-canary...
2026-06-15T07:36:09.189977296Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:09.430232880Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:09.433575643Z Inspecting resource crd/istiorevisions.sailoperator.io
2026-06-15T07:36:09.497220166Z Waiting for performance profile collector pods to become ready: 7
2026-06-15T07:36:09.660125603Z Gathering data for ns/openshift-insights...
2026-06-15T07:36:09.752368316Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:09.964558607Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:09.967199592Z Inspecting resource crd/istiorevisiontags.sailoperator.io
2026-06-15T07:36:10.164354739Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:10.390186248Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:10.392799887Z Inspecting resource crd/istios.sailoperator.io
2026-06-15T07:36:10.645680203Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-06-15T07:36:10.712529760Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:10.731561812Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:36:10.936744359Z Collecting performance related data for node ip-10-0-141-25.ec2.internal
2026-06-15T07:36:10.946720700Z Collecting performance related data for node ip-10-0-128-226.ec2.internal
2026-06-15T07:36:10.958111926Z Collecting performance related data for node ip-10-0-128-243.ec2.internal
2026-06-15T07:36:10.962617492Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:10.966203733Z Inspecting resource crd/peerauthentications.security.istio.io
2026-06-15T07:36:11.182187102Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:11.442175558Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:11.451499500Z Inspecting resource crd/proxyconfigs.networking.istio.io
2026-06-15T07:36:11.678419691Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:11.960998108Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:11.965350857Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-06-15T07:36:12.193179243Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:12.506566094Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:12.510370509Z Inspecting resource crd/requestauthentications.security.istio.io
2026-06-15T07:36:12.763814310Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:13.030376108Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:13.032967160Z Inspecting resource crd/serviceentries.networking.istio.io
2026-06-15T07:36:13.237976297Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:13.308217203Z Gathering data for ns/openshift-lws-operator...
2026-06-15T07:36:13.470166756Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:13.473812619Z Inspecting resource crd/sidecars.networking.istio.io
2026-06-15T07:36:13.689973856Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:13.941964793Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:13.945268559Z Inspecting resource crd/telemetries.telemetry.istio.io
2026-06-15T07:36:14.049369852Z Gathering data for ns/kserve...
2026-06-15T07:36:14.174460719Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:14.413817919Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:14.416744911Z Inspecting resource crd/virtualservices.networking.istio.io
2026-06-15T07:36:14.669137416Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:14.912288696Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:14.915110920Z Inspecting resource crd/wasmplugins.extensions.istio.io
2026-06-15T07:36:15.118075497Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:15.356110389Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:15.358438957Z Inspecting resource crd/workloadentries.networking.istio.io
2026-06-15T07:36:15.574320863Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:15.736504905Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:36:15.799714490Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:15.802019228Z Inspecting resource crd/workloadgroups.networking.istio.io
2026-06-15T07:36:16.013390167Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:16.243321265Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:16.245789196Z Inspecting resource crd/ztunnels.sailoperator.io
2026-06-15T07:36:16.501469240Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:16.503009366Z Gathering data for ns/openshift-config...
2026-06-15T07:36:16.755629858Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:16.903048080Z Gathering data for ns/openshift-config-managed...
2026-06-15T07:36:16.916518213Z Inspecting resource mutatingwebhookconfiguration.admissionregistration.k8s.io/istio-sidecar-injector-openshift-gateway-openshift-ingress
2026-06-15T07:36:17.140851168Z Gathering data for ns/openshift-ingress...
2026-06-15T07:36:17.496495159Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-06-15T07:36:17.890515209Z Gathering data for ns/openshift-kube-apiserver...
2026-06-15T07:36:18.220586030Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T07:36:18.281494762Z Gathering data for ns/openshift-kube-controller-manager...
2026-06-15T07:36:18.401471865Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T07:36:18.537723924Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:18.680025318Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-06-15T07:36:18.683985462Z Inspecting resource validatingwebhookconfiguration.admissionregistration.k8s.io/istio-validator-openshift-gateway-openshift-ingress
2026-06-15T07:36:18.937325703Z Gathering data for ns/openshift-ingress...
2026-06-15T07:36:19.085482356Z Gathering data for ns/openshift-kube-scheduler...
2026-06-15T07:36:19.533515920Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-06-15T07:36:19.924620829Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-06-15T07:36:20.274377544Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T07:36:20.314616468Z Collecting kubelet logs for node ip-10-0-141-25.ec2.internal
2026-06-15T07:36:20.316506366Z Collecting kubelet logs for node ip-10-0-128-226.ec2.internal
2026-06-15T07:36:20.318396190Z Collecting kubelet logs for node ip-10-0-128-243.ec2.internal
2026-06-15T07:36:20.576195962Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T07:36:20.589315936Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-06-15T07:36:20.743909459Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:36:20.778144800Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:20.838676098Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-d7tsl namespace
2026-06-15T07:36:20.844215064Z INFO: Node performance data collection complete.
2026-06-15T07:36:21.072881685Z Gathering data for ns/openshift-user-workload-monitoring...
2026-06-15T07:36:21.475292480Z Inspecting openshift-gateway IstioRevision
2026-06-15T07:36:21.593020477Z Inspecting resource ns/openshift-ingress
2026-06-15T07:36:21.781844467Z Gathering data for ns/openshift-ingress...
2026-06-15T07:36:21.830653676Z Gathering data for ns/openshift-multus...
2026-06-15T07:36:22.980297316Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T07:36:23.133042921Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T07:36:23.270101098Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:23.276072433Z Inspecting resource net-attach-def,roles,rolebindings in namespace openshift-ingress
2026-06-15T07:36:23.505767227Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:23.651009553Z Collecting /debug/syncz from istiod-openshift-gateway-75c67f8887-qbmcr in namespace openshift-ingress
2026-06-15T07:36:24.085359561Z Gathering data for ns/openshift-ovn-kubernetes...
2026-06-15T07:36:24.447944171Z Inspecting kserve-ci-e2e-test data plane namespace
2026-06-15T07:36:24.448002642Z Inspecting resource ns/kserve-ci-e2e-test
2026-06-15T07:36:24.600577171Z Gathering data for ns/kserve-ci-e2e-test...
2026-06-15T07:36:25.737362554Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T07:36:25.751853198Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:36:25.882597588Z Gathering data for ns/openshift-host-network...
2026-06-15T07:36:26.364131642Z Gathering data for ns/openshift-network-diagnostics...
2026-06-15T07:36:26.571342866Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T07:36:26.982853400Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:26.982896375Z error: inspection completed with the errors occurred while gathering data:
2026-06-15T07:36:26.982896375Z     one or more errors occurred while gathering pod-specific data for namespace: kserve-ci-e2e-test
2026-06-15T07:36:26.982896375Z 
2026-06-15T07:36:26.982896375Z     [one or more errors occurred while gathering container data for pod auth-enabled-test-kserve-85d86d876c-vrqhw:
2026-06-15T07:36:26.982896375Z 
2026-06-15T07:36:26.982896375Z     [previous terminated container "main" in pod "auth-enabled-test-kserve-85d86d876c-vrqhw" not found, container "main" in pod "auth-enabled-test-kserve-85d86d876c-vrqhw" is waiting to start: PodInitializing], one or more errors occurred while gathering container data for pod llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w:
2026-06-15T07:36:26.982896375Z 
2026-06-15T07:36:26.982896375Z     [container "main" in pod "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w" is waiting to start: PodInitializing, previous terminated container "main" in pod "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w" not found]]
2026-06-15T07:36:26.987515913Z Inspecting resource net-attach-def,roles,rolebindings in namespace kserve-ci-e2e-test
2026-06-15T07:36:27.240917426Z Gathering data for ns/openshift-network-node-identity...
2026-06-15T07:36:27.486385830Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:27.640410199Z Collecting Envoy config for pods in kserve-ci-e2e-test pointing to openshift-gateway revision
2026-06-15T07:36:27.810320314Z Gathering data for ns/openshift-network-operator...
2026-06-15T07:36:28.448233563Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-06-15T07:36:28.818702226Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-06-15T07:36:29.343758014Z Collecting config_dump and stats for pod router-gateway-1-openshift-default-75dcfd69c9-dh6qf.kserve-ci-e2e-test
2026-06-15T07:36:29.452723867Z Gathering data for ns/openshift-apiserver-operator...
2026-06-15T07:36:29.846856126Z Gathering data for ns/openshift-apiserver...
2026-06-15T07:36:30.336912110Z Gathering data for ns/openshift-controller-manager-operator...
2026-06-15T07:36:30.423216157Z Collecting config_dump and stats for pod router-gateway-2-openshift-default-78c98f6f4c-ddrqp.kserve-ci-e2e-test
2026-06-15T07:36:30.690306634Z Gathering data for ns/openshift-controller-manager...
2026-06-15T07:36:30.761268326Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:36:31.095961320Z Gathering data for ns/openshift-cluster-samples-operator...
2026-06-15T07:36:32.137781355Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-06-15T07:36:32.263378365Z Inspecting openshift-ingress data plane namespace
2026-06-15T07:36:32.263423633Z Inspecting resource ns/openshift-ingress
2026-06-15T07:36:32.456001629Z Gathering data for ns/openshift-ingress...
2026-06-15T07:36:32.523705184Z Gathering data for ns/openshift-service-ca-operator...
2026-06-15T07:36:32.953927388Z Gathering data for ns/openshift-service-ca...
2026-06-15T07:36:33.531149296Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-06-15T07:36:33.799863799Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-06-15T07:36:33.983225276Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-06-15T07:36:34.375449542Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:34.380290532Z Inspecting resource net-attach-def,roles,rolebindings in namespace openshift-ingress
2026-06-15T07:36:34.789891302Z Wrote inspect data to /must-gather/istio.
2026-06-15T07:36:34.925232671Z Collecting Envoy config for pods in openshift-ingress pointing to openshift-gateway revision
2026-06-15T07:36:34.934470668Z Wrote inspect data to must-gather.
2026-06-15T07:36:34.934533236Z error: inspection completed with the errors occurred while gathering data:
2026-06-15T07:36:34.934533236Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-06-15T07:36:35.285875618Z Collecting config_dump and stats for pod openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd.openshift-ingress
2026-06-15T07:36:35.767861882Z [disk usage checker] Volume usage percentage: current = 17 ; allowed = 70
2026-06-15T07:36:36.456374218Z Done executing Istio gather script
2026-06-15T07:36:36.585925640Z error: the server doesn't have a resource type "clusters"
2026-06-15T07:36:36.776420051Z Caches written to disk