KUBEFLOW_SKIP_INSTALL is set. Skipping SDK installation to use the version baked into the notebook image. Input Notebook: /opt/app-root/notebooks/mnist.ipynb Output Notebook: /opt/app-root/src/out.ipynb [IPKernelApp] WARNING | Kernel is running over TCP without encryption. All communication (including code and outputs) is sent in plain text and is susceptible to eavesdropping. Use IPC transport or launch with kernel manager-provisioned CurveZMQ keys to enable transport encryption. Executing notebook with kernel: python3 Executing Cell 1--------------------------------------- Ending Cell 1------------------------------------------ Executing Cell 2--------------------------------------- [notebook] S3 not configured: missing endpoint or bucket env vars [notebook] Dataset not complete, attempting internet download... [notebook] Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/train-images-idx3-ubyte.gz ... [notebook] Decompressing /opt/app-root/src/FashionMNIST/raw/train-images-idx3-ubyte.gz ... [notebook] Done: /opt/app-root/src/FashionMNIST/raw/train-images-idx3-ubyte [notebook] Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/train-labels-idx1-ubyte.gz ... [notebook] Decompressing /opt/app-root/src/FashionMNIST/raw/train-labels-idx1-ubyte.gz ... [notebook] Done: /opt/app-root/src/FashionMNIST/raw/train-labels-idx1-ubyte [notebook] Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/t10k-images-idx3-ubyte.gz ... [notebook] Decompressing /opt/app-root/src/FashionMNIST/raw/t10k-images-idx3-ubyte.gz ... [notebook] Done: /opt/app-root/src/FashionMNIST/raw/t10k-images-idx3-ubyte [notebook] Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/t10k-labels-idx1-ubyte.gz ... [notebook] Decompressing /opt/app-root/src/FashionMNIST/raw/t10k-labels-idx1-ubyte.gz ... [notebook] Done: /opt/app-root/src/FashionMNIST/raw/t10k-labels-idx1-ubyte [notebook] Internet download completed successfully Ending Cell 2------------------------------------------ Executing Cell 3--------------------------------------- Ending Cell 3------------------------------------------ Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in _run_code File "/opt/app-root/lib64/python3.12/site-packages/papermill/__main__.py", line 4, in papermill() File "/opt/app-root/lib64/python3.12/site-packages/click/core.py", line 1569, in __call__ return self.main(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/app-root/lib64/python3.12/site-packages/click/core.py", line 1490, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "/opt/app-root/lib64/python3.12/site-packages/click/core.py", line 1353, in invoke return ctx.invoke(self.callback, **ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/app-root/lib64/python3.12/site-packages/click/core.py", line 907, in invoke return callback(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/app-root/lib64/python3.12/site-packages/click/decorators.py", line 34, in new_func return f(get_current_context(), *args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/app-root/lib64/python3.12/site-packages/papermill/cli.py", line 235, in papermill execute_notebook( File "/opt/app-root/lib64/python3.12/site-packages/papermill/execute.py", line 131, in execute_notebook raise_for_execution_errors(nb, output_path) File "/opt/app-root/lib64/python3.12/site-packages/papermill/execute.py", line 251, in raise_for_execution_errors raise error papermill.exceptions.PapermillExecutionError: --------------------------------------------------------------------------- Exception encountered at "In [3]": --------------------------------------------------------------------------- ImportError Traceback (most recent call last) Cell In[3], line 3 1 # Init SDK client with user token/API URL (no Backend types import) 2 import os ----> 3 from kubernetes import client as k8s_client 4 from kubeflow.trainer import TrainerClient 5 from kubeflow.common.types import KubernetesBackendConfig 6 File /opt/app-root/lib64/python3.12/site-packages/kubernetes/__init__.py:20 17 __version__ = "30.1.0" 19 from . import client ---> 20 from . import config 21 from . import dynamic 22 from . import watch File /opt/app-root/lib64/python3.12/site-packages/kubernetes/config/__init__.py:19 17 from .config_exception import ConfigException 18 from .incluster_config import load_incluster_config ---> 19 from .kube_config import (KUBE_CONFIG_DEFAULT_LOCATION, 20 list_kube_config_contexts, load_kube_config, 21 load_kube_config_from_dict, new_client_from_config, new_client_from_config_dict) 24 def load_config(**kwargs): 25 """ 26 Wrapper function to load the kube_config. 27 It will initially try to load_kube_config from provided path, (...) 34 load_incluster_config functions. 35 """ File /opt/app-root/lib64/python3.12/site-packages/kubernetes/config/kube_config.py:29 26 from collections import namedtuple 28 import google.auth ---> 29 import google.auth.transport.requests 30 import oauthlib.oauth2 31 import urllib3 File /opt/app-root/lib64/python3.12/site-packages/google/auth/transport/requests.py:43 41 from google.auth.transport import _mtls_helper 42 import google.auth.transport._mtls_helper ---> 43 from google.oauth2 import service_account 45 _LOGGER = logging.getLogger(__name__) 47 _DEFAULT_TIMEOUT = 120 # in seconds File /opt/app-root/lib64/python3.12/site-packages/google/oauth2/service_account.py:81 79 from google.auth import _helpers 80 from google.auth import _regional_access_boundary_utils ---> 81 from google.auth import _service_account_info 82 from google.auth import credentials 83 from google.auth import exceptions File /opt/app-root/lib64/python3.12/site-packages/google/auth/_service_account_info.py:20 17 import io 18 import json ---> 20 from google.auth import crypt 21 from google.auth import exceptions 24 def from_dict(data, require=None, use_rsa_signer=True): File /opt/app-root/lib64/python3.12/site-packages/google/auth/crypt/__init__.py:41 15 """Cryptography helpers for verifying and signing messages. 16 17 The simplest way to verify signatures is using :func:`verify_signature`:: (...) 37 version is at least 1.4.0. 38 """ 40 from google.auth.crypt import base ---> 41 from google.auth.crypt import es 42 from google.auth.crypt import es256 43 from google.auth.crypt import rsa File /opt/app-root/lib64/python3.12/site-packages/google/auth/crypt/es.py:21 18 from dataclasses import dataclass 19 from typing import Any, Dict, Optional, Union ---> 21 import cryptography.exceptions 22 from cryptography.hazmat import backends 23 from cryptography.hazmat.primitives import hashes File /opt/app-root/lib64/python3.12/site-packages/cryptography/exceptions.py:9 5 from __future__ import annotations 7 import typing ----> 9 from cryptography.hazmat.bindings._rust import exceptions as rust_exceptions 11 if typing.TYPE_CHECKING: 12 from cryptography.hazmat.bindings._rust import openssl as rust_openssl ImportError: /lib64/libcrypto.so.3: version `OPENSSL_3.3.0' not found (required by /opt/app-root/lib64/python3.12/site-packages/cryptography/hazmat/bindings/_rust.abi3.so) NOTEBOOK_STATUS: FAILURE