[must-gather ] OUT 2026-04-16T17:49:26.543628702Z Using must-gather plug-in image: quay.io/modh/must-gather:rhoai-2.24 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 15c7366c-0afa-47ef-ae9f-61b837a8e675 ClientVersion: 4.21.5 ClusterVersion: Stable at "4.20.18" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing [must-gather ] OUT 2026-04-16T17:49:26.603795975Z namespace/openshift-must-gather-4sxmd created [must-gather ] OUT 2026-04-16T17:49:26.611327697Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-52c58 created [must-gather ] OUT 2026-04-16T17:49:26.635109766Z pod for plug-in image quay.io/modh/must-gather:rhoai-2.24 created [must-gather-wx8bl] OUT 2026-04-16T17:51:30.442250176Z waiting for gather to complete [must-gather-wx8bl] OUT 2026-04-16T17:51:30.446205071Z downloading gather output [must-gather-wx8bl] OUT 2026-04-16T17:51:30.728948856Z receiving incremental file list [must-gather-wx8bl] OUT 2026-04-16T17:51:30.751295795Z ./ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.751382411Z aggregated-discovery-api.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.751719583Z aggregated-discovery-apis.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.752354134Z event-filter.html [must-gather-wx8bl] OUT 2026-04-16T17:51:30.753801917Z timestamp [must-gather-wx8bl] OUT 2026-04-16T17:51:30.753961207Z version [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768088817Z cluster-scoped-resources/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768112128Z cluster-scoped-resources/datasciencecluster.opendatahub.io/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768117939Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768150871Z cluster-scoped-resources/datasciencecluster.opendatahub.io/datascienceclusters/test-dsc.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768243647Z cluster-scoped-resources/dscinitialization.opendatahub.io/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768255047Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.76830159Z cluster-scoped-resources/dscinitialization.opendatahub.io/dscinitializations/test-dsci.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768393736Z namespaces/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768408217Z namespaces/kserve-ci-e2e-test/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768462631Z namespaces/kserve-ci-e2e-test/kserve-ci-e2e-test.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768544236Z namespaces/kserve-ci-e2e-test/apps.openshift.io/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768590269Z namespaces/kserve-ci-e2e-test/apps.openshift.io/deploymentconfigs.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768668754Z namespaces/kserve-ci-e2e-test/apps/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768726668Z namespaces/kserve-ci-e2e-test/apps/daemonsets.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.768827404Z namespaces/kserve-ci-e2e-test/apps/deployments.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.769868451Z namespaces/kserve-ci-e2e-test/apps/replicasets.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.771103571Z namespaces/kserve-ci-e2e-test/apps/statefulsets.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.771130003Z namespaces/kserve-ci-e2e-test/autoscaling/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.771182206Z namespaces/kserve-ci-e2e-test/autoscaling/horizontalpodautoscalers.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.77172029Z namespaces/kserve-ci-e2e-test/batch/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.771746202Z namespaces/kserve-ci-e2e-test/batch/cronjobs.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.771848109Z namespaces/kserve-ci-e2e-test/batch/jobs.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.771888031Z namespaces/kserve-ci-e2e-test/build.openshift.io/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.771943735Z namespaces/kserve-ci-e2e-test/build.openshift.io/buildconfigs.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.77202893Z namespaces/kserve-ci-e2e-test/build.openshift.io/builds.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.772067763Z namespaces/kserve-ci-e2e-test/core/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.772116776Z namespaces/kserve-ci-e2e-test/core/configmaps.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.772455378Z namespaces/kserve-ci-e2e-test/core/endpoints.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.772720655Z namespaces/kserve-ci-e2e-test/core/events.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.775829075Z namespaces/kserve-ci-e2e-test/core/persistentvolumeclaims.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.775911651Z namespaces/kserve-ci-e2e-test/core/pods.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.777046344Z namespaces/kserve-ci-e2e-test/core/replicationcontrollers.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.777170301Z namespaces/kserve-ci-e2e-test/core/secrets.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.777895918Z namespaces/kserve-ci-e2e-test/core/services.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778204318Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.77823096Z namespaces/kserve-ci-e2e-test/discovery.k8s.io/endpointslices.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778495597Z namespaces/kserve-ci-e2e-test/image.openshift.io/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778519388Z namespaces/kserve-ci-e2e-test/image.openshift.io/imagestreams.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778579372Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778598553Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressfirewalls.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778747763Z namespaces/kserve-ci-e2e-test/k8s.ovn.org/egressqoses.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778795016Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778802237Z namespaces/kserve-ci-e2e-test/monitoring.coreos.com/servicemonitors.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778971137Z namespaces/kserve-ci-e2e-test/networking.k8s.io/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.778993999Z namespaces/kserve-ci-e2e-test/networking.k8s.io/networkpolicies.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779043992Z namespaces/kserve-ci-e2e-test/pods/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779057603Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779083885Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/isvc-lightgbm-predictor-78c8d484d6-hrnjg.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779365743Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779381864Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779388414Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779422817Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779433807Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779438238Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779453279Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.77947931Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779484441Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779529113Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779544794Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779619809Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-predictor-78c8d484d6-hrnjg/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779675943Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779723306Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779812902Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779826052Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779831583Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779872126Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.779970012Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780034546Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780059398Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780069638Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780074619Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780115001Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780215308Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780284492Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-runtime-predictor-64984c7cb-jwfk4/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780306474Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780358507Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780437092Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780445672Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780459003Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780467064Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78056572Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780659836Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78071777Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780727881Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780731781Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780763353Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780855129Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780926313Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-kserve-predictor-68fc4f5b49-q4wtp/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.780957355Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781014809Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781078123Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781088674Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781092774Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781133497Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781286337Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781353511Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781402164Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781415765Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781421845Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781436806Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781522052Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781587046Z namespaces/kserve-ci-e2e-test/pods/isvc-lightgbm-v2-runtime-predictor-8d44c64dc-d5l4v/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781626538Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781699153Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/isvc-logger-predictor-7fc456f8b8-qzxjk.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78179887Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/agent/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781815211Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/agent/agent/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781820351Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/agent/agent/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781829612Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/agent/agent/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781934438Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/agent/agent/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.781997022Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/agent/agent/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782026044Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782039525Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782044955Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782103889Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782207136Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782282371Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782339974Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782347535Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782351485Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782402028Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782521706Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782613352Z namespaces/kserve-ci-e2e-test/pods/isvc-logger-predictor-7fc456f8b8-qzxjk/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782682936Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78273907Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782835506Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782842937Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.782846977Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78289194Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783083702Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783151657Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78320001Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783214241Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783218561Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783225171Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783316827Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783382312Z namespaces/kserve-ci-e2e-test/pods/isvc-mlflow-v2-runtime-predictor-5497fc5f68-m4c55/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783423144Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783462217Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/isvc-paddle-predictor-7dddcb4bd4-z562j.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783549892Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783558523Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783562963Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783615487Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783772597Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783841231Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783879564Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783886434Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783890654Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.783929767Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784055805Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78413331Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-predictor-7dddcb4bd4-z562j/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784153261Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784198454Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/isvc-paddle-runtime-predictor-86b49c4466-65rhw.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784275799Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784283799Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78428773Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784342533Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78445146Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784532015Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78460176Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784611541Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784615481Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784712397Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784815374Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784887698Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-runtime-predictor-86b49c4466-65rhw/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784924621Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.784983024Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785086951Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785098142Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785102202Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785134354Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785241181Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785316426Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785330387Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785339287Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785347888Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785407942Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785486977Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785556112Z namespaces/kserve-ci-e2e-test/pods/isvc-paddle-v2-kserve-predictor-7c6bd76f7b-fp452/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785591964Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785657468Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/isvc-pmml-predictor-5584ffd8c9-zvfhk.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785736873Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785749194Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785755274Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785802537Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785904764Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.785971238Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786010531Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786021942Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786026732Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786055584Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786142869Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786206983Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-predictor-5584ffd8c9-zvfhk/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786251176Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786271267Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786374654Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786383605Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786387515Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786430088Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786534235Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786605669Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786654072Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786671023Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786676293Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786722667Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786825333Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786888887Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-runtime-predictor-7576f6b69f-7dqpk/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78692909Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.786968272Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787044067Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787053998Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787059018Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78708294Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787177716Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78723959Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787277512Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787284293Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787288093Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787320305Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787407161Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787472295Z namespaces/kserve-ci-e2e-test/pods/isvc-pmml-v2-kserve-predictor-75b87ff64c-p9vtl/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787510487Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78755321Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/isvc-predictive-lightgbm-predictor-669896799c-54xhl.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78770233Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.7877158Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787721341Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787731092Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787841709Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787924604Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787969047Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787976167Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.787979708Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788043032Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788151959Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788241234Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-predictor-669896799c-54xhl/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788283867Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788359222Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78848915Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788496741Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788500611Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788560865Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788888936Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.788982082Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789034725Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789043996Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789048576Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78910098Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789220387Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789316594Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-lightgbm-v2-predictor-65df45cf79-g4bjp/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789366107Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789430221Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789524947Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789532128Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789536108Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789583071Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78972735Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789810525Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789862289Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789869949Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.78987349Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.789926303Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.7900344Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790106164Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-predictor-85bccb8945-5ppfc/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790144447Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79018489Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790304127Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790311568Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790315378Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790365121Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790721294Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79080645Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790862973Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790875844Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790880184Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.790922067Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791025873Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791108909Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-sklearn-v2-predictor-6fd9c49f4f-fm9rb/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791163722Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791213866Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791304131Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791311562Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791315262Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791355395Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791467262Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791551698Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791602761Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791609211Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791612722Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791695397Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791817505Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79190078Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-predictor-794b54b9b4-xw6q7/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791955153Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.791990076Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792122334Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792131715Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792135695Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792181228Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792559392Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792740074Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792782287Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792791637Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792795808Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79283528Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.792947988Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793030093Z namespaces/kserve-ci-e2e-test/pods/isvc-predictive-xgboost-v2-predictor-67fd65d6cb-k984b/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793085446Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793128129Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793265248Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/agent/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793274148Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/agent/agent/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793277689Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/agent/agent/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793312331Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/agent/agent/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793428358Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/agent/agent/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793509504Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/agent/agent/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793569167Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793581948Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793587549Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.7936171Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79376512Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793837635Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793867307Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793873897Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.793877417Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79392447Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794037907Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794122483Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-custom-predictor-848df975bd-s4p84/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794172076Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794210209Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794356668Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/agent/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794370169Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/agent/agent/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794376179Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/agent/agent/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794410142Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/agent/agent/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794518898Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/agent/agent/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794600554Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/agent/agent/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794674119Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79468932Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79469531Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794737693Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794840559Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794927105Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794975918Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794983808Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.794989349Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795037812Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795143169Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795223984Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-batcher-predictor-6d5844b6c5-2pp6r/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795260416Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79531376Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/isvc-sklearn-predictor-66fb7c44cc-gzszm.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795402586Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795412896Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795418987Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795464539Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795577017Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795709885Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795761638Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795771929Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795776819Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795836923Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.795950461Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796053527Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-predictor-66fb7c44cc-gzszm/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796104601Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796156224Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/isvc-sklearn-runtime-predictor-cf744c55f-54m8x.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796240669Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79624968Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79625445Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796292373Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796435212Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796517667Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796579861Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796589292Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796594132Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796666787Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796793265Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796885731Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-runtime-predictor-cf744c55f-54m8x/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796943705Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.796999218Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/isvc-sklearn-s3-predictor-669df85bbb-v2gs7.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797099995Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797114196Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797120226Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797164819Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797276726Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797357781Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797385613Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797400844Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797405815Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797455368Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797569605Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79765248Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-s3-predictor-669df85bbb-v2gs7/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797718565Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797768758Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797850693Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797860784Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797866064Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.797904917Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798030725Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79810874Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798156863Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798167784Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798172994Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798228688Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798340425Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79842768Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-mixed-predictor-7969454ff4-s8d8j/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798469873Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798529507Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798601081Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798611252Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798617022Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798699548Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798815075Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79889916Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798939083Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798945764Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798949264Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.798995077Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799104304Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799190529Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-predictor-58bbfc4c57-mfbvj/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799262444Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799298296Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799372921Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799382072Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799385642Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799425585Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799595185Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799704112Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799742335Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799746975Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799750426Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799810829Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.799912216Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.79997125Z namespaces/kserve-ci-e2e-test/pods/isvc-sklearn-v2-runtime-predictor-7dd9b85c64-4qjt2/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800008152Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800041064Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/isvc-tensorflow-predictor-88f6f6cb7-9v5tr.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800101308Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800111809Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800120519Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800165942Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80028862Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800385586Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800427849Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80043679Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80044213Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800484063Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80059828Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800700187Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-predictor-88f6f6cb7-9v5tr/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800731258Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800787312Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/isvc-tensorflow-runtime-predictor-854bdff69c-25n58.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800881878Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800891039Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800896099Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.800934722Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80105577Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801147505Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801197219Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801208019Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.8012139Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801267573Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80137527Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801461156Z namespaces/kserve-ci-e2e-test/pods/isvc-tensorflow-runtime-predictor-854bdff69c-25n58/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801504508Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801566772Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/isvc-triton-predictor-85f9f46646-qbbq6.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801668909Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801732543Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801742714Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801783596Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.801923085Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80199055Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802020992Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802029982Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802039253Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802073535Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80215654Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802218274Z namespaces/kserve-ci-e2e-test/pods/isvc-triton-predictor-85f9f46646-qbbq6/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802259837Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802294499Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/isvc-xgboost-predictor-6dbc9d6d47-wzbfb.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802430128Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802439879Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802445679Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802449129Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802499683Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802564557Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802607479Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80261924Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80262422Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802669734Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80277378Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802842414Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-predictor-6dbc9d6d47-wzbfb/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802876527Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.802916299Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803030077Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803040257Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803044867Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803048368Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803120523Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803188537Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803224619Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80323382Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80323873Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803270982Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803361018Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803431772Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-runtime-predictor-687c7765c9-mw2j2/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803466765Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803500997Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803622755Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803652657Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803664667Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80371289Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803839199Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803925074Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803967877Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803977027Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.803982198Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804001939Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804098345Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80416357Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-mlserver-predictor-58b7db6668-h8q77/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804200332Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804239215Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/isvc-xgboost-v2-predictor-5db5686f9f-55j7w.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804313579Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804333281Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804337541Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804372983Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804467169Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804539434Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804561535Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804566216Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804569696Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804605948Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804741797Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804807401Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-predictor-5db5686f9f-55j7w/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804845954Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804880086Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804955911Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804963131Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.804967751Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805000553Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805138322Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805219118Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80525219Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805265861Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805270971Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805305063Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805443112Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805454353Z namespaces/kserve-ci-e2e-test/pods/isvc-xgboost-v2-runtime-predictor-b5d6966c7-87qdg/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805521687Z namespaces/kserve-ci-e2e-test/pods/message-dumper-predictor-7f66cccfb6-wc8z9/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805554759Z namespaces/kserve-ci-e2e-test/pods/message-dumper-predictor-7f66cccfb6-wc8z9/message-dumper-predictor-7f66cccfb6-wc8z9.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805656546Z namespaces/kserve-ci-e2e-test/pods/message-dumper-predictor-7f66cccfb6-wc8z9/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805680397Z namespaces/kserve-ci-e2e-test/pods/message-dumper-predictor-7f66cccfb6-wc8z9/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805686237Z namespaces/kserve-ci-e2e-test/pods/message-dumper-predictor-7f66cccfb6-wc8z9/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80572469Z namespaces/kserve-ci-e2e-test/pods/message-dumper-predictor-7f66cccfb6-wc8z9/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805793055Z namespaces/kserve-ci-e2e-test/pods/message-dumper-predictor-7f66cccfb6-wc8z9/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80587712Z namespaces/kserve-ci-e2e-test/pods/message-dumper-predictor-7f66cccfb6-wc8z9/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805900721Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.805959455Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806063242Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806074653Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806081073Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806096004Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806275695Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80634851Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806388293Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806398183Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806408824Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806459827Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806580675Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806680682Z namespaces/kserve-ci-e2e-test/pods/sklearn-v2-mlserver-predictor-695d5f5568-fvc2w/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806732775Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806792029Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/xgboost-v2-mlserver-predictor-c58d48f-f64lm.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806887725Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806900386Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/kserve-container/kserve-container/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806908196Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/kserve-container/kserve-container/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.806955469Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/kserve-container/kserve-container/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.807101469Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/kserve-container/kserve-container/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.807193355Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/kserve-container/kserve-container/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.807253029Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.807264959Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/storage-initializer/storage-initializer/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80727126Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/storage-initializer/storage-initializer/logs/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.807315873Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/storage-initializer/storage-initializer/logs/current.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80743221Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/storage-initializer/storage-initializer/logs/previous.insecure.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.807515505Z namespaces/kserve-ci-e2e-test/pods/xgboost-v2-mlserver-predictor-c58d48f-f64lm/storage-initializer/storage-initializer/logs/previous.log [must-gather-wx8bl] OUT 2026-04-16T17:51:30.807564029Z namespaces/kserve-ci-e2e-test/policy/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.807623632Z namespaces/kserve-ci-e2e-test/policy/poddisruptionbudgets.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.80774618Z namespaces/kserve-ci-e2e-test/route.openshift.io/ [must-gather-wx8bl] OUT 2026-04-16T17:51:30.807755971Z namespaces/kserve-ci-e2e-test/route.openshift.io/routes.yaml [must-gather-wx8bl] OUT 2026-04-16T17:51:30.81722143Z [must-gather-wx8bl] OUT 2026-04-16T17:51:30.817246972Z sent 6,880 bytes received 328,988 bytes 671,736.00 bytes/sec [must-gather-wx8bl] OUT 2026-04-16T17:51:30.817253673Z total size is 4,748,113 speedup is 14.14 [must-gather ] OUT 2026-04-16T17:51:30.969193306Z namespace/openshift-must-gather-4sxmd deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: 15c7366c-0afa-47ef-ae9f-61b837a8e675 ClientVersion: 4.21.5 ClusterVersion: Stable at "4.20.18" ClusterOperators: clusteroperator/authentication is missing clusteroperator/cloud-credential is missing clusteroperator/cluster-autoscaler is missing clusteroperator/config-operator is missing clusteroperator/etcd is missing clusteroperator/machine-api is missing clusteroperator/machine-approver is missing clusteroperator/machine-config is missing clusteroperator/marketplace is missing