Container Runtime for ML¶
Overview¶
Container Runtime for ML is a set of preconfigured but customizable environments built for machine learning on Snowpark Container Services, covering interactive experimentation and batch ML workloads such as model training, hyperparameter tuning, batch inference and fine tuning. They include the most popular machine learning and deep learning frameworks. Used with Snowflake notebooks, they provide an end to end ML experience.
Container Runtime image specification¶
You can choose between CPU or GPU image types when creating a notebook to run on Container Runtime. Both images come pre-installed with popular ML frameworks like scikit-learn and PyTorch. You can also use Snowpark ML and everything that comes with that.
The following tables list the notable pre-installed packages for each image.
Top ML libraries¶
The following packages are specific to the GPU v1 image:
Package |
Version |
|---|---|
transformers |
4.32.1 |
peft |
0.5.0 |
Both CPU v1 and GPU v1 have the same versions for these packages:
Package |
Version |
|---|---|
SKLearn |
1.3.0 |
XGBoost |
1.7.6 |
PyTorch |
2.0.1 |
Python packages¶
The following Python packages are only on the CPU v1 image or have a different version than on the GPU image:
Package |
Version |
Package |
Version |
|---|---|---|---|
Pympler |
1.0.1 |
aiohttp |
3.9.3 |
google-auth |
2.22.0 |
grpcio |
1.59.3 |
lightgbm |
3.3.5 |
mkl-fft |
1.3.8 |
mkl-random |
1.2.4 |
mkl-service |
2.4.0 |
multidict |
6.0.5 |
pyarrow |
14.0.1 |
pydantic |
1.10.12 |
ray |
2.10.0 |
scipy |
1.11.4 |
torch |
2.0.1 |
typing_extensions |
4.7.1 |
urllib3 |
1.26.18 |
The following Python packages are only on the GPU v1 image or have a different version than on the CPU image:
Package |
Version |
Package |
Version |
|---|---|---|---|
Pympler |
0.9 |
accelerate |
0.28.0 |
aiohttp |
3.9.1 |
aioprometheus |
23.12.0 |
annotated-types |
0.6.0 |
blessed |
1.20.0 |
cupy-cuda12x |
12.1.0 |
datasets |
2.12.0 |
dill |
0.3.6 |
fastapi |
0.110.0 |
fastrlock |
0.8.2 |
google-auth |
2.6.0 |
gpustat |
1.1.1 |
grpcio |
1.62.1 |
grpcio-tools |
1.62.1 |
h11 |
0.14.0 |
httptools |
0.6.1 |
huggingface-hub |
0.20.3 |
lightgbm |
4.3.0 |
multidict |
6.0.4 |
multiprocess |
0.70.14 |
ninja |
1.11.1.1 |
nvidia-cublas-cu12 |
12.1.3.1 |
nvidia-cuda-cupti-cu12 |
12.1.105 |
nvidia-cuda-nvrtc-cu12 |
12.1.105 |
nvidia-cuda-runtime-cu12 |
12.1.105 |
nvidia-cudnn-cu12 |
8.9.2.26 |
nvidia-cufft-cu12 |
11.0.2.54 |
nvidia-curand-cu12 |
10.3.2.106 |
nvidia-cusolver-cu12 |
11.4.5.107 |
nvidia-cusparse-cu12 |
12.1.0.106 |
nvidia-ml-py |
12.535.133 |
nvidia-nccl-cu12 |
2.18.1 |
nvidia-nvjitlink-cu12 |
12.4.99 |
nvidia-nvtx-cu12 |
12.1.105 |
orjson |
3.9.15 |
peft |
0.5.0 |
pyarrow |
14.0.2 |
pydantic |
2.6.4 |
pydantic_core |
2.16.3 |
pynvml |
11.5.0 |
python-dotenv |
1.0.1 |
quantile-python |
1.1 |
ray |
2.9.0 |
regex |
2023.10.3 |
responses |
0.13.3 |
safetensors |
0.4.2 |
scipy |
1.9.3 |
sentencepiece |
0.1.99 |
starlette |
0.36.3 |
tokenizers |
0.15.2 |
torch |
2.1.2 |
tqdm |
4.65.0 |
transformers |
4.39.1 |
triton |
2.1.0 |
typing_extensions |
4.10.0 |
urllib3 |
2.0.7 |
uvicorn |
0.29.0 |
uvloop |
0.19.0 |
vllm |
0.3.2 |
watchfiles |
0.21.0 |
websockets |
12.0 |
xformers |
0.0.23.post1 |
xxhash |
2.0.2 |
Full list for CPU v1 image¶
This table is a full list of Python packages pre-installed on the CPU v1 image:
Package |
Version |
Package |
Version |
|---|---|---|---|
Babel |
2.11.0 |
Bottleneck |
1.3.7 |
Brotli |
1.0.9 |
Brotli |
1.0.9 |
GitPython |
3.1.41 |
Jinja2 |
3.1.3 |
MarkupSafe |
2.1.3 |
PyJWT |
2.4.0 |
PySocks |
1.7.1 |
PySocks |
1.7.1 |
PyYAML |
6.0.1 |
Pygments |
2.15.1 |
Pympler |
1.0.1 |
Send2Trash |
1.8.2 |
absl-py |
1.4.0 |
aiobotocore |
2.7.0 |
aiohttp |
3.9.3 |
aiohttp |
3.9.3 |
aiohttp-cors |
0.7.0 |
aioitertools |
0.7.1 |
aiosignal |
1.2.0 |
aiosignal |
1.3.1 |
altair |
4.2.2 |
anyio |
3.5.0 |
appdirs |
1.4.4 |
archspec |
0.2.3 |
argon2-cffi |
21.3.0 |
argon2-cffi-bindings |
21.2.0 |
asn1crypto |
1.5.1 |
asttokens |
2.0.5 |
async-lru |
2.0.4 |
async-timeout |
4.0.3 |
async-timeout |
4.0.3 |
attrs |
23.1.0 |
attrs |
23.2.0 |
beautifulsoup4 |
4.12.2 |
bleach |
4.1.0 |
blinker |
1.6.2 |
boltons |
23.0.0 |
botocore |
1.31.64 |
bytecode |
0.13.0.dev0 |
cachetools |
4.2.2 |
certifi |
2024.2.2 |
certifi |
2024.2.2 |
cffi |
1.16.0 |
cffi |
1.16.0 |
charset-normalizer |
2.0.4 |
charset-normalizer |
2.0.4 |
click |
8.1.7 |
cloudpickle |
2.0.0 |
colorama |
0.4.6 |
colorful |
0.5.4 |
comm |
0.1.2 |
conda |
24.1.2 |
conda |
24.3.0 |
conda-content-trust |
0.2.0 |
conda-libmamba-solver |
24.1.0 |
conda-package-handling |
2.2.0 |
conda_package_streaming |
0.9.0 |
cryptography |
42.0.4 |
cryptography |
42.0.4 |
debugpy |
1.6.7 |
decorator |
5.1.1 |
defusedxml |
0.7.1 |
distlib |
0.3.6 |
distro |
1.8.0 |
entrypoints |
0.4 |
exceptiongroup |
1.2.0 |
executing |
0.8.3 |
fastjsonschema |
2.16.2 |
filelock |
3.13.1 |
frozenlist |
1.4.0 |
frozenlist |
1.4.1 |
fsspec |
2023.10.0 |
gitdb |
4.0.7 |
gmpy2 |
2.1.2 |
google-api-core |
2.10.1 |
google-auth |
2.22.0 |
googleapis-common-protos |
1.56.4 |
grpcio |
1.59.3 |
html5lib |
1.1 |
idna |
3.4 |
idna |
3.4 |
idna |
3.6 |
importlib-metadata |
7.0.1 |
importlib_resources |
6.4.0 |
ipykernel |
6.28.0 |
ipython |
8.20.0 |
ipython-genutils |
0.2.0 |
ipywidgets |
7.6.5 |
jedi |
0.18.1 |
jmespath |
1.0.1 |
joblib |
1.2.0 |
json5 |
0.9.6 |
jsonpatch |
1.32 |
jsonpointer |
2.1 |
jsonschema |
4.19.2 |
jsonschema-specifications |
2023.7.1 |
jupyter-events |
0.8.0 |
jupyter-lsp |
2.2.2 |
jupyter_client |
8.6.0 |
jupyter_core |
5.5.0 |
jupyter_server |
2.10.0 |
jupyter_server_terminals |
0.4.4 |
jupyterlab |
4.0.11 |
jupyterlab-pygments |
0.1.2 |
jupyterlab-widgets |
3.0.9 |
jupyterlab_server |
2.25.1 |
libmambapy |
1.5.7 |
lightgbm |
3.3.5 |
lightgbm-ray |
0.1.9 |
markdown-it-py |
2.2.0 |
matplotlib-inline |
0.1.6 |
mdurl |
0.1.0 |
menuinst |
2.0.2 |
mistune |
2.0.4 |
mkl-fft |
1.3.8 |
mkl-random |
1.2.4 |
mkl-service |
2.4.0 |
mlruntimes_client |
0.0.1 |
mlruntimes_service |
0.0.1 |
mpmath |
1.3.0 |
msgpack |
1.0.3 |
multidict |
6.0.4 |
multidict |
6.0.5 |
nbclient |
0.8.0 |
nbconvert |
7.10.0 |
nbformat |
5.9.2 |
nest-asyncio |
1.6.0 |
networkx |
3.1 |
notebook |
7.0.7 |
notebook_shim |
0.2.3 |
numexpr |
2.8.7 |
numpy |
1.24.3 |
opencensus |
0.11.3 |
opencensus-context |
0.1.3 |
opencv-python |
4.9.0.80 |
overrides |
7.4.0 |
packaging |
23.1 |
packaging |
23.1 |
pandas |
1.5.3 |
pandocfilters |
1.5.0 |
parso |
0.8.3 |
pexpect |
4.8.0 |
pillow |
10.2.0 |
pip |
23.3.1 |
pip |
23.3.1 |
platformdirs |
3.10.0 |
platformdirs |
3.10.0 |
pluggy |
1.0.0 |
prometheus-client |
0.14.1 |
prompt-toolkit |
3.0.43 |
protobuf |
3.20.3 |
psutil |
5.9.0 |
ptyprocess |
0.7.0 |
pure-eval |
0.2.2 |
pyOpenSSL |
24.0.0 |
pyarrow |
14.0.1 |
pyasn1 |
0.4.8 |
pyasn1-modules |
0.2.8 |
pycosat |
0.6.6 |
pycparser |
2.21 |
pycparser |
2.21 |
pydantic |
1.10.12 |
pydeck |
0.8.0 |
python |
3.10.12 |
python |
3.12.1 |
python |
3.12.2 |
python-dateutil |
2.8.3+snowflake1 |
python-json-logger |
2.0.7 |
pytimeparse |
1.1.8 |
pytz |
2023.3.post1 |
pyzmq |
25.1.2 |
ray |
2.10.0 |
referencing |
0.30.2 |
requests |
2.31.0 |
requests |
2.31.0 |
retrying |
1.3.3 |
rfc3339-validator |
0.1.4 |
rfc3986-validator |
0.1.1 |
rich |
13.3.5 |
rpds-py |
0.10.6 |
rsa |
4.7.2 |
ruamel.yaml |
0.17.21 |
s3fs |
2023.10.0 |
scikit-learn |
1.3.0 |
scipy |
1.11.4 |
setproctitle |
1.2.2 |
setuptools |
68.2.2 |
setuptools |
68.2.2 |
six |
1.16.0 |
smart-open |
5.2.1 |
smmap |
4.0.0 |
sniffio |
1.3.0 |
snowbooks |
1.25.0 |
snowflake-connector-python |
3.7.1 |
snowflake-ml-python |
1.3.1 |
snowflake-snowpark-python |
1.11.1 |
sortedcontainers |
2.4.0 |
soupsieve |
2.5 |
sqlparse |
0.4.4 |
stack-data |
0.2.0 |
streamlit |
1.22.0 |
sympy |
1.12 |
tenacity |
8.2.2 |
tensorboardX |
2.2 |
terminado |
0.17.1 |
threadpoolctl |
2.2.0 |
tinycss2 |
1.2.1 |
toml |
0.10.2 |
tomli |
2.0.1 |
tomlkit |
0.11.1 |
toolz |
0.12.0 |
torch |
2.0.1 |
tornado |
6.3.3 |
tqdm |
4.65.0 |
traitlets |
5.7.1 |
truststore |
0.8.0 |
typing_extensions |
4.7.1 |
tzlocal |
2.1 |
urllib3 |
1.26.18 |
urllib3 |
2.1.0 |
validators |
0.18.2 |
virtualenv |
20.4.6 |
watchdog |
2.1.6 |
wcwidth |
0.2.5 |
webencodings |
0.5.1 |
websocket-client |
0.58.0 |
wheel |
0.41.2 |
wheel |
0.41.2 |
widgetsnbextension |
3.5.2 |
wrapt |
1.14.1 |
xgboost |
1.7.6 |
xgboost_ray |
0.1.19 |
yarl |
1.9.3 |
yarl |
1.9.4 |
zipp |
3.17.0 |
zstandard |
0.19.0 |
Full list for GPU v1 image¶
This table is a full list of Python packages pre-installed on the GPU v1 image:
Package |
Version |
Package |
Version |
|---|---|---|---|
Babel |
2.11.0 |
Bottleneck |
1.3.7 |
Brotli |
1.0.9 |
Brotli |
1.0.9 |
GitPython |
3.1.41 |
Jinja2 |
3.1.3 |
MarkupSafe |
2.1.3 |
PyJWT |
2.4.0 |
PySocks |
1.7.1 |
PySocks |
1.7.1 |
PyYAML |
6.0.1 |
Pygments |
2.15.1 |
Pympler |
0.9 |
Send2Trash |
1.8.2 |
absl-py |
1.4.0 |
accelerate |
0.28.0 |
aiobotocore |
2.7.0 |
aiohttp |
3.9.1 |
aiohttp |
3.9.3 |
aiohttp-cors |
0.7.0 |
aioitertools |
0.7.1 |
aioprometheus |
23.12.0 |
aiosignal |
1.2.0 |
aiosignal |
1.3.1 |
altair |
4.2.2 |
annotated-types |
0.6.0 |
anyio |
3.5.0 |
appdirs |
1.4.4 |
archspec |
0.2.3 |
argon2-cffi |
21.3.0 |
argon2-cffi-bindings |
21.2.0 |
asn1crypto |
1.5.1 |
asttokens |
2.0.5 |
async-lru |
2.0.4 |
async-timeout |
4.0.3 |
async-timeout |
4.0.3 |
attrs |
23.1.0 |
attrs |
23.2.0 |
beautifulsoup4 |
4.12.2 |
bleach |
4.1.0 |
blessed |
1.20.0 |
blinker |
1.6.2 |
boltons |
23.0.0 |
botocore |
1.31.64 |
bytecode |
0.13.0.dev0 |
cachetools |
4.2.2 |
certifi |
2024.2.2 |
certifi |
2024.2.2 |
cffi |
1.16.0 |
cffi |
1.16.0 |
charset-normalizer |
2.0.4 |
charset-normalizer |
2.0.4 |
click |
8.1.7 |
cloudpickle |
2.0.0 |
colorama |
0.4.6 |
colorful |
0.5.4 |
comm |
0.1.2 |
conda |
24.1.2 |
conda |
24.3.0 |
conda-content-trust |
0.2.0 |
conda-libmamba-solver |
24.1.0 |
conda-package-handling |
2.2.0 |
conda_package_streaming |
0.9.0 |
cryptography |
42.0.4 |
cryptography |
42.0.4 |
cupy-cuda12x |
12.1.0 |
datasets |
2.12.0 |
debugpy |
1.6.7 |
decorator |
5.1.1 |
defusedxml |
0.7.1 |
dill |
0.3.6 |
distlib |
0.3.6 |
distro |
1.8.0 |
entrypoints |
0.4 |
exceptiongroup |
1.2.0 |
executing |
0.8.3 |
fastapi |
0.110.0 |
fastjsonschema |
2.16.2 |
fastrlock |
0.8.2 |
filelock |
3.13.1 |
frozenlist |
1.4.0 |
frozenlist |
1.4.1 |
fsspec |
2023.10.0 |
gitdb |
4.0.7 |
gmpy2 |
2.1.2 |
google-api-core |
2.10.1 |
google-auth |
2.6.0 |
googleapis-common-protos |
1.56.4 |
gpustat |
1.1.1 |
grpcio |
1.62.1 |
grpcio-tools |
1.62.1 |
h11 |
0.14.0 |
html5lib |
1.1 |
httptools |
0.6.1 |
huggingface-hub |
0.20.3 |
idna |
3.4 |
idna |
3.4 |
idna |
3.6 |
importlib-metadata |
7.0.1 |
importlib_resources |
6.4.0 |
ipykernel |
6.28.0 |
ipython |
8.20.0 |
ipython-genutils |
0.2.0 |
ipywidgets |
7.6.5 |
jedi |
0.18.1 |
jmespath |
1.0.1 |
joblib |
1.2.0 |
json5 |
0.9.6 |
jsonpatch |
1.32 |
jsonpointer |
2.1 |
jsonschema |
4.19.2 |
jsonschema-specifications |
2023.7.1 |
jupyter-events |
0.8.0 |
jupyter-lsp |
2.2.2 |
jupyter_client |
8.6.0 |
jupyter_core |
5.5.0 |
jupyter_server |
2.10.0 |
jupyter_server_terminals |
0.4.4 |
jupyterlab |
4.0.11 |
jupyterlab-pygments |
0.1.2 |
jupyterlab-widgets |
3.0.9 |
jupyterlab_server |
2.25.1 |
libmambapy |
1.5.7 |
lightgbm |
4.3.0 |
lightgbm-ray |
0.1.9 |
markdown-it-py |
2.2.0 |
matplotlib-inline |
0.1.6 |
mdurl |
0.1.0 |
menuinst |
2.0.2 |
mistune |
2.0.4 |
mlruntimes_client |
0.0.1 |
mlruntimes_service |
0.0.1 |
mpmath |
1.3.0 |
msgpack |
1.0.3 |
multidict |
6.0.4 |
multidict |
6.0.4 |
multiprocess |
0.70.14 |
nbclient |
0.8.0 |
nbconvert |
7.10.0 |
nbformat |
5.9.2 |
nest-asyncio |
1.6.0 |
networkx |
3.1 |
ninja |
1.11.1.1 |
notebook |
7.0.7 |
notebook_shim |
0.2.3 |
numexpr |
2.8.7 |
numpy |
1.24.3 |
nvidia-cublas-cu12 |
12.1.3.1 |
nvidia-cuda-cupti-cu12 |
12.1.105 |
nvidia-cuda-nvrtc-cu12 |
12.1.105 |
nvidia-cuda-runtime-cu12 |
12.1.105 |
nvidia-cudnn-cu12 |
8.9.2.26 |
nvidia-cufft-cu12 |
11.0.2.54 |
nvidia-curand-cu12 |
10.3.2.106 |
nvidia-cusolver-cu12 |
11.4.5.107 |
nvidia-cusparse-cu12 |
12.1.0.106 |
nvidia-ml-py |
12.535.133 |
nvidia-nccl-cu12 |
2.18.1 |
nvidia-nvjitlink-cu12 |
12.4.99 |
nvidia-nvtx-cu12 |
12.1.105 |
opencensus |
0.11.3 |
opencensus-context |
0.1.3 |
opencv-python |
4.9.0.80 |
orjson |
3.9.15 |
overrides |
7.4.0 |
packaging |
23.1 |
packaging |
23.1 |
pandas |
1.5.3 |
pandocfilters |
1.5.0 |
parso |
0.8.3 |
peft |
0.5.0 |
pexpect |
4.8.0 |
pillow |
10.2.0 |
pip |
23.3.1 |
pip |
23.3.1 |
platformdirs |
3.10.0 |
platformdirs |
3.10.0 |
pluggy |
1.0.0 |
prometheus-client |
0.14.1 |
prompt-toolkit |
3.0.43 |
protobuf |
3.20.3 |
psutil |
5.9.0 |
ptyprocess |
0.7.0 |
pure-eval |
0.2.2 |
pyOpenSSL |
24.0.0 |
pyarrow |
14.0.2 |
pyasn1 |
0.4.8 |
pyasn1-modules |
0.2.8 |
pycosat |
0.6.6 |
pycparser |
2.21 |
pycparser |
2.21 |
pydantic |
2.6.4 |
pydantic_core |
2.16.3 |
pydeck |
0.8.0 |
pynvml |
11.5.0 |
python |
3.10.12 |
python |
3.12.1 |
python |
3.12.2 |
python-dateutil |
2.8.3+snowflake1 |
python-dotenv |
1.0.1 |
python-json-logger |
2.0.7 |
pytimeparse |
1.1.8 |
pytz |
2023.3.post1 |
pyzmq |
25.1.2 |
quantile-python |
1.1 |
ray |
2.9.0 |
referencing |
0.30.2 |
regex |
2023.10.3 |
requests |
2.31.0 |
requests |
2.31.0 |
responses |
0.13.3 |
retrying |
1.3.3 |
rfc3339-validator |
0.1.4 |
rfc3986-validator |
0.1.1 |
rich |
13.3.5 |
rpds-py |
0.10.6 |
rsa |
4.7.2 |
ruamel.yaml |
0.17.21 |
s3fs |
2023.10.0 |
safetensors |
0.4.2 |
scikit-learn |
1.3.0 |
scipy |
1.9.3 |
sentencepiece |
0.1.99 |
setproctitle |
1.2.2 |
setuptools |
68.2.2 |
setuptools |
68.2.2 |
six |
1.16.0 |
smart-open |
5.2.1 |
smmap |
4.0.0 |
sniffio |
1.3.0 |
snowbooks |
1.25.0 |
snowflake-connector-python |
3.7.1 |
snowflake-ml-python |
1.3.1 |
snowflake-snowpark-python |
1.11.1 |
sortedcontainers |
2.4.0 |
soupsieve |
2.5 |
sqlparse |
0.4.4 |
stack-data |
0.2.0 |
starlette |
0.36.3 |
streamlit |
1.22.0 |
sympy |
1.12 |
tenacity |
8.2.2 |
tensorboardX |
2.2 |
terminado |
0.17.1 |
threadpoolctl |
2.2.0 |
tinycss2 |
1.2.1 |
tokenizers |
0.15.2 |
toml |
0.10.2 |
tomli |
2.0.1 |
tomlkit |
0.11.1 |
toolz |
0.12.0 |
torch |
2.1.2 |
tornado |
6.3.3 |
tqdm |
4.65.0 |
tqdm |
4.65.0 |
traitlets |
5.7.1 |
transformers |
4.39.1 |
triton |
2.1.0 |
truststore |
0.8.0 |
typing_extensions |
4.10.0 |
tzlocal |
2.1 |
urllib3 |
2.0.7 |
urllib3 |
2.1.0 |
uvicorn |
0.29.0 |
uvloop |
0.19.0 |
validators |
0.18.2 |
virtualenv |
20.4.6 |
vllm |
0.3.2 |
watchdog |
2.1.6 |
watchfiles |
0.21.0 |
wcwidth |
0.2.5 |
webencodings |
0.5.1 |
websocket-client |
0.58.0 |
websockets |
12.0 |
wheel |
0.41.2 |
wheel |
0.41.2 |
widgetsnbextension |
3.5.2 |
wrapt |
1.14.1 |
xformers |
0.0.23.post1 |
xgboost |
1.7.6 |
xgboost_ray |
0.1.19 |
xxhash |
2.0.2 |
yarl |
1.9.3 |
yarl |
1.9.4 |
zipp |
3.17.0 |
zstandard |
0.19.0 |
Next steps¶
To try the notebook using Container Runtime for ML, see Create a notebook on Snowpark Container Services.