2026-07-21T07:10:52.396494421Z [disk usage checker] Started
2026-07-21T07:10:52.400570097Z [disk usage checker] Volume usage percentage: current = 22 ; allowed = 70
2026-07-21T07:10:52.589210088Z Gathering data for ns/openshift-cluster-version...
2026-07-21T07:10:52.729312654Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-21T07:10:52.814645713Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-21T07:10:52.896465704Z Gathering data for ns/default...
2026-07-21T07:10:53.169724789Z Gathering data for ns/openshift...
2026-07-21T07:10:53.599718693Z Gathering data for ns/kube-system...
2026-07-21T07:10:54.284574778Z Gathering data for ns/openshift-etcd...
2026-07-21T07:10:54.576228224Z Wrote inspect data to must-gather.
2026-07-21T07:10:54.576262278Z error: inspection completed with the errors occurred while gathering data:
2026-07-21T07:10:54.576262278Z     namespaces "assisted-installer" not found
2026-07-21T07:10:54.894978662Z Waiting on subprocesses to finish execution.
2026-07-21T07:10:54.898488132Z INFO: Gathering on-disk MachineConfig from degraded nodes
2026-07-21T07:10:54.903998279Z Executing Istio gather script
2026-07-21T07:10:54.904903329Z INFO: Collecting host service logs for crio
2026-07-21T07:10:54.905210254Z INFO: Collecting host service logs for kubelet
2026-07-21T07:10:54.905504951Z INFO: Collecting host service logs for rpm-ostreed
2026-07-21T07:10:54.905845818Z INFO: Collecting host service logs for ostree-finalize-staged
2026-07-21T07:10:54.906160629Z INFO: Collecting host service logs for machine-config-daemon-firstboot
2026-07-21T07:10:54.906517099Z INFO: Collecting host service logs for machine-config-daemon-host
2026-07-21T07:10:54.906934770Z INFO: Collecting host service logs for NetworkManager
2026-07-21T07:10:54.907268997Z INFO: Collecting host service logs for openvswitch
2026-07-21T07:10:54.907585510Z INFO: Collecting host service logs for ovs-configuration
2026-07-21T07:10:54.907925985Z INFO: Collecting host service logs for ovsdb-server
2026-07-21T07:10:54.908282505Z INFO: Collecting host service logs for ovs-vswitchd
2026-07-21T07:10:54.908667173Z INFO: Waiting for worker host service log collection to complete ...
2026-07-21T07:10:54.916328825Z WARNING: Collecting one or more kube-apiserver related logs on ALL masters in your cluster. This could take a large amount of time.
2026-07-21T07:10:54.923736031Z INFO: Gathering machine config daemon's old logs from all nodes
2026-07-21T07:10:54.984874822Z INFO: Gathering HAProxy config files
2026-07-21T07:10:55.133147137Z INFO: Waiting for node performance related collection to complete ...
2026-07-21T07:10:55.483293425Z INFO: Found 1 replicas - prometheus-k8s-0
2026-07-21T07:10:55.567034686Z INFO: "sriov-network-operator" not detected. Skipping.
2026-07-21T07:10:55.815215412Z INFO: Waiting for on-disk MachineConfig collection to complete ...
2026-07-21T07:10:55.815215412Z INFO: on-disk MachineConfig config collection complete.
2026-07-21T07:10:55.956263271Z ERROR: No running kube-apiserver pods found
2026-07-21T07:10:56.129305890Z No resources found in openshift-etcd namespace.
2026-07-21T07:10:56.140488405Z No resources found
2026-07-21T07:10:56.233984109Z Wrote inspect data to must-gather.
2026-07-21T07:10:56.517114793Z No resources found
2026-07-21T07:10:56.528940167Z INFO: Getting alertmanagers from prometheus-k8s-0
2026-07-21T07:10:56.536850457Z INFO: Collecting Insights Archives from insights-operator-555d9d7885-ptmk6
2026-07-21T07:10:56.536903103Z insights-runtime-extractor-cktg8
2026-07-21T07:10:56.536924629Z insights-runtime-extractor-gcp7j
2026-07-21T07:10:56.536943823Z insights-runtime-extractor-trc6l
2026-07-21T07:10:56.676034444Z INFO: namespace openshift-frr-k8s not detected. Skipping.
2026-07-21T07:10:56.768099248Z error: the server doesn't have a resource type "performanceprofile"
2026-07-21T07:10:56.914343487Z INFO: "kubernetes-nmstate-operator" not detected. Skipping.
2026-07-21T07:10:56.932494009Z Wrote inspect data to must-gather.
2026-07-21T07:10:56.950800978Z Wrote inspect data to must-gather.
2026-07-21T07:10:56.961099174Z INFO: Worker host service log collection to complete.
2026-07-21T07:10:57.025174786Z Wrote inspect data to must-gather.
2026-07-21T07:10:57.180551906Z INFO: "metallb-operator" not detected. Skipping.
2026-07-21T07:10:57.189216227Z error: only SOURCE_DIR and POD:DESTINATION_DIR should be specified as arguments
2026-07-21T07:10:57.189216227Z See 'oc rsync -h' for help and examples
2026-07-21T07:10:57.201212471Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-21T07:10:57.233038162Z INFO: Waiting for HAProxy config collection to complete ...
2026-07-21T07:10:57.246195140Z Wrote inspect data to must-gather.
2026-07-21T07:10:57.268949363Z error: the server doesn't have a resource type "multi-networkpolicy"
2026-07-21T07:10:57.283651401Z INFO: 'previous-logs' folder not found on ip-10-0-134-50.ec2.internal, skipping...
2026-07-21T07:10:57.339629510Z Wrote inspect data to must-gather.
2026-07-21T07:10:57.428510886Z [disk usage checker] Volume usage percentage: current = 22 ; allowed = 70
2026-07-21T07:10:57.478747772Z Wrote inspect data to must-gather.
2026-07-21T07:10:57.550383193Z INFO: OLM v1 CRDs not detected. Skipping OLM v1 resource collection.
2026-07-21T07:10:57.575003317Z tar: Removing leading `/' from member names
2026-07-21T07:10:57.577242534Z INFO: Getting rules from prometheus-k8s-0
2026-07-21T07:10:57.586608284Z INFO: HAProxy config collection complete.
2026-07-21T07:10:57.587592301Z Gathering data for ns/openshift-monitoring...
2026-07-21T07:10:57.651314447Z Wrote inspect data to must-gather.
2026-07-21T07:10:57.679276829Z INFO: 'previous-logs' folder not found on ip-10-0-135-253.ec2.internal, skipping...
2026-07-21T07:10:57.693963870Z error: the server doesn't have a resource type "machineconfigs"
2026-07-21T07:10:57.853024311Z error: the server doesn't have a resource type "machineconfigpools"
2026-07-21T07:10:57.925308808Z Wrote inspect data to must-gather.
2026-07-21T07:10:57.955640240Z INFO: 'previous-logs' folder not found on ip-10-0-136-24.ec2.internal, skipping...
2026-07-21T07:10:57.955683312Z INFO: Waiting for Machine Config Daemon termination log collection to complete ...
2026-07-21T07:10:57.955706967Z INFO: Machine Config Daemon termination log collection complete.
2026-07-21T07:10:57.992984006Z INFO: Getting status/config from prometheus-k8s-0
2026-07-21T07:10:58.082439559Z Wrote inspect data to must-gather.
2026-07-21T07:10:58.182632419Z Wrote inspect data to must-gather.
2026-07-21T07:10:58.231656417Z error: the server doesn't have a resource type "kubeletconfigs"
2026-07-21T07:10:58.406279667Z INFO: Getting status/flags from prometheus-k8s-0
2026-07-21T07:10:58.450295946Z Wrote inspect data to must-gather.
2026-07-21T07:10:58.456615470Z INFO: INTERCONNECT MODE
2026-07-21T07:10:58.456646562Z INFO: Gathering ovn-kubernetes DBs
2026-07-21T07:10:58.604822931Z INFO: Gathering OVN_Northbound from ovnkube-node-6xp4s...
2026-07-21T07:10:58.605074812Z INFO: Gathering OVN_Northbound from ovnkube-node-fxfrw...
2026-07-21T07:10:58.605324828Z INFO: Gathering OVN_Northbound from ovnkube-node-glcll...
2026-07-21T07:10:58.605749175Z INFO: Gathering OVN_Southbound from ovnkube-node-6xp4s...
2026-07-21T07:10:58.605785723Z INFO: Gathering OVN_Southbound from ovnkube-node-fxfrw...
2026-07-21T07:10:58.606065403Z INFO: Gathering OVN_Southbound from ovnkube-node-glcll...
2026-07-21T07:10:58.643519183Z INFO: Getting status/runtimeinfo from prometheus-k8s-0
2026-07-21T07:10:58.669502344Z Wrote inspect data to must-gather.
2026-07-21T07:10:58.865054690Z tar: Removing leading `/' from member names
2026-07-21T07:10:58.879044672Z Inspecting resource crd/gatewayclasses.gateway.networking.k8s.io
2026-07-21T07:10:58.909169144Z tar: Removing leading `/' from member names
2026-07-21T07:10:58.921123847Z tar: Removing leading `/' from member names
2026-07-21T07:10:58.948164484Z tar: Removing leading `/' from member names
2026-07-21T07:10:58.958546747Z tar: Removing leading `/' from member names
2026-07-21T07:10:58.968401853Z tar: Removing leading `/' from member names
2026-07-21T07:10:59.056757805Z Wrote inspect data to must-gather.
2026-07-21T07:10:59.062788490Z INFO: Getting targets?state=active from prometheus-k8s-0
2026-07-21T07:10:59.099868764Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
2026-07-21T07:10:59.124232036Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:10:59.313680047Z INFO: Getting status/tsdb from prometheus-k8s-0
2026-07-21T07:10:59.314151933Z Wrote inspect data to must-gather.
2026-07-21T07:10:59.376736417Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:10:59.379568270Z Inspecting resource crd/gateways.gateway.networking.k8s.io
2026-07-21T07:10:59.451957418Z INFO: Waiting for network log collection to complete ...
2026-07-21T07:10:59.452082337Z INFO: Waiting for ovnk database copies to complete ...
2026-07-21T07:10:59.452588189Z INFO: Copying ovnk databases complete.
2026-07-21T07:10:59.454258871Z 2.7M	must-gather/network_logs/ovnk_database_store
2026-07-21T07:10:59.456308605Z ovnk_database_store/
2026-07-21T07:10:59.456308605Z ovnk_database_store/ovnkube-node-glcll_nbdb
2026-07-21T07:10:59.464569932Z ovnk_database_store/ovnkube-node-6xp4s_nbdb
2026-07-21T07:10:59.470550420Z ovnk_database_store/ovnkube-node-fxfrw_sbdb
2026-07-21T07:10:59.489823091Z ovnk_database_store/ovnkube-node-6xp4s_sbdb
2026-07-21T07:10:59.509117361Z ovnk_database_store/ovnkube-node-glcll_sbdb
2026-07-21T07:10:59.526356105Z ovnk_database_store/ovnkube-node-fxfrw_nbdb
2026-07-21T07:10:59.535557232Z INFO: Network log collection complete.
2026-07-21T07:10:59.568684186Z Wrote inspect data to must-gather.
2026-07-21T07:10:59.595686094Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:10:59.713310707Z INFO: Getting status from alertmanager-main-0
2026-07-21T07:10:59.779109168Z Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
2026-07-21T07:10:59.823147987Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:10:59.826594085Z Inspecting resource crd/grpcroutes.gateway.networking.k8s.io
2026-07-21T07:10:59.886915651Z Wrote inspect data to must-gather.
2026-07-21T07:10:59.972547964Z Gathering data for ns/openshift-network-console...
2026-07-21T07:11:00.017486081Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:11:00.165511599Z Wrote inspect data to must-gather.
2026-07-21T07:11:00.221362901Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:11:00.223462962Z Inspecting resource crd/httproutes.gateway.networking.k8s.io
2026-07-21T07:11:00.404575743Z Gathering data for ns/openshift-console-operator...
2026-07-21T07:11:00.431388367Z Error from server (NotFound): deployments.apps "cluster-node-tuning-operator" not found
2026-07-21T07:11:00.433960383Z INFO: Fallback to identify the container image from release info
2026-07-21T07:11:00.458787633Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:11:00.645760919Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:11:00.648075678Z Inspecting resource crd/referencegrants.gateway.networking.k8s.io
2026-07-21T07:11:00.794683321Z Gathering data for ns/openshift-console...
2026-07-21T07:11:00.802564198Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:11:00.981349405Z Wrote inspect data to /must-gather/istio.
2026-07-21T07:11:01.116554973Z INFO: Image with low level tools to use: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bde4d3e6601b1a43249dcefbf210ae783590d4ff5957380d16c78b4d391ee9eb
2026-07-21T07:11:01.258735709Z daemonset.apps/perf-node-gather-daemonset created
2026-07-21T07:11:01.364949306Z Gathering data for ns/openshift-cluster-storage-operator...
2026-07-21T07:11:01.392928441Z Waiting for performance profile collector pods to become ready: 1
2026-07-21T07:11:01.709785695Z Done executing Istio gather script
2026-07-21T07:11:01.917195070Z Gathering data for ns/openshift-dns-operator...
2026-07-21T07:11:02.184452198Z Gathering data for ns/openshift-dns...
2026-07-21T07:11:02.436489385Z [disk usage checker] Volume usage percentage: current = 22 ; allowed = 70
2026-07-21T07:11:02.512644492Z Waiting for performance profile collector pods to become ready: 2
2026-07-21T07:11:02.762903618Z Gathering data for ns/openshift-image-registry...
2026-07-21T07:11:03.192792017Z Gathering data for ns/openshift-ingress-operator...
2026-07-21T07:11:03.492886724Z Gathering data for ns/openshift-ingress...
2026-07-21T07:11:03.629027750Z Waiting for performance profile collector pods to become ready: 3
2026-07-21T07:11:03.811456913Z Gathering data for ns/openshift-ingress-canary...
2026-07-21T07:11:04.174662616Z Gathering data for ns/openshift-insights...
2026-07-21T07:11:04.746388946Z Waiting for performance profile collector pods to become ready: 4
2026-07-21T07:11:05.856932022Z Waiting for performance profile collector pods to become ready: 5
2026-07-21T07:11:06.083523495Z Gathering data for ns/openshift-jobset-operator...
2026-07-21T07:11:06.845159855Z Gathering data for ns/openshift-config...
2026-07-21T07:11:06.963352069Z Waiting for performance profile collector pods to become ready: 6
2026-07-21T07:11:07.103736622Z Gathering data for ns/openshift-config-managed...
2026-07-21T07:11:07.443705555Z [disk usage checker] Volume usage percentage: current = 22 ; allowed = 70
2026-07-21T07:11:07.508352722Z Gathering data for ns/openshift-kube-apiserver-operator...
2026-07-21T07:11:07.768634047Z Gathering data for ns/openshift-kube-apiserver...
2026-07-21T07:11:08.027690799Z Gathering data for ns/openshift-kube-controller-manager...
2026-07-21T07:11:08.091225362Z Waiting for performance profile collector pods to become ready: 7
2026-07-21T07:11:08.306512719Z Gathering data for ns/openshift-kube-controller-manager-operator...
2026-07-21T07:11:08.683920480Z Gathering data for ns/openshift-kube-scheduler...
2026-07-21T07:11:08.933636079Z Gathering data for ns/openshift-kube-scheduler-operator...
2026-07-21T07:11:09.218612614Z Daemonset perf-node-gather-daemonset ready 3 out of 3
2026-07-21T07:11:09.254211182Z Gathering data for ns/openshift-kube-storage-version-migrator...
2026-07-21T07:11:09.457012976Z Collecting performance related data for node ip-10-0-135-253.ec2.internal
2026-07-21T07:11:09.464488104Z Collecting performance related data for node ip-10-0-134-50.ec2.internal
2026-07-21T07:11:09.477418042Z Collecting performance related data for node ip-10-0-136-24.ec2.internal
2026-07-21T07:11:09.633801154Z Gathering data for ns/openshift-kube-storage-version-migrator-operator...
2026-07-21T07:11:09.987920828Z Gathering data for ns/openshift-user-workload-monitoring...
2026-07-21T07:11:10.576641823Z Gathering data for ns/openshift-multus...
2026-07-21T07:11:12.232893376Z Gathering data for ns/openshift-ovn-kubernetes...
2026-07-21T07:11:12.449176387Z [disk usage checker] Volume usage percentage: current = 22 ; allowed = 70
2026-07-21T07:11:13.462868352Z Gathering data for ns/openshift-host-network...
2026-07-21T07:11:13.763316834Z Gathering data for ns/openshift-network-diagnostics...
2026-07-21T07:11:14.279287172Z Gathering data for ns/openshift-network-node-identity...
2026-07-21T07:11:14.684595623Z Gathering data for ns/openshift-network-operator...
2026-07-21T07:11:15.046758006Z Gathering data for ns/openshift-cloud-network-config-controller...
2026-07-21T07:11:15.306435122Z Gathering data for ns/openshift-cluster-node-tuning-operator...
2026-07-21T07:11:15.769908384Z Gathering data for ns/openshift-apiserver-operator...
2026-07-21T07:11:16.057322626Z Gathering data for ns/openshift-apiserver...
2026-07-21T07:11:16.433529693Z Gathering data for ns/openshift-controller-manager-operator...
2026-07-21T07:11:16.703069974Z Gathering data for ns/openshift-controller-manager...
2026-07-21T07:11:16.977831702Z Gathering data for ns/openshift-cluster-samples-operator...
2026-07-21T07:11:17.453641304Z [disk usage checker] Volume usage percentage: current = 22 ; allowed = 70
2026-07-21T07:11:17.511758040Z Collecting kubelet logs for node ip-10-0-135-253.ec2.internal
2026-07-21T07:11:17.513461265Z Collecting kubelet logs for node ip-10-0-134-50.ec2.internal
2026-07-21T07:11:17.515102593Z Collecting kubelet logs for node ip-10-0-136-24.ec2.internal
2026-07-21T07:11:17.664163072Z Gathering data for ns/openshift-operator-lifecycle-manager...
2026-07-21T07:11:17.847146003Z daemonset.apps "perf-node-gather-daemonset" deleted from openshift-must-gather-rtw8x namespace
2026-07-21T07:11:17.851513012Z INFO: Node performance data collection complete.
2026-07-21T07:11:18.002289624Z Gathering data for ns/openshift-service-ca-operator...
2026-07-21T07:11:18.307545485Z Gathering data for ns/openshift-service-ca...
2026-07-21T07:11:18.655794992Z Gathering data for ns/openshift-cluster-csi-drivers...
2026-07-21T07:11:19.512823118Z Wrote inspect data to must-gather.
2026-07-21T07:11:19.512862058Z error: inspection completed with the errors occurred while gathering data:
2026-07-21T07:11:19.512862058Z     skipping gathering secrets/support due to error: secrets "support" not found
2026-07-21T07:11:19.633898778Z error: the server doesn't have a resource type "clusters"
2026-07-21T07:11:19.769497672Z Caches written to disk