AI-Dock + PyTorch

Run python in a cloud-first AI-Dock container with PyTorch pre-installed.

This image provides a great starting point for python development when used standalone but its also a solid foundation for extending upon.

Documentation

All AI-Dock containers share a common base which is designed to make running on cloud services such as vast.ai and runpod.io as straightforward and user friendly as possible.

Common features and options are documented in the base wiki but any additional features unique to this image will be detailed below.

Version Tags

The :latest tag points to :latest-cuda

Tags follow these patterns:

CUDA

• :[pytorch-version]-py[python-version]-v2-cuda-[x.x.x]-base-[ubuntu-version]

• :latest-cuda → :2.3.1-py3.10-v2-cuda-11.8.0-base-22.04

ROCm

• :[pytorch-version]-py[python-version]-v2-rocm-[x.x.x]-runtime-[ubuntu-version]

• :latest-rocm → :2.3.1-py3.10-v2-rocm-6.0-runtime-22.04

CPU

• :[pytorch-version]-py[python-version]-v2-cpu-[ubuntu-version]

• :latest-cpu → :2.3.1-py3.10-v2-cpu-22.04

Browse here for an image suitable for your target environment.

Supported Python versions: 3.12, 3.11, 3.10

Supported Pytorch versions: 2.3.1 2.2.1

Supported Platforms: NVIDIA CUDA, AMD ROCm, CPU

Pre-Configured Templates

Vast.​ai

pytorch:latest-cuda (CUDA)

pytorch:latest-rocm (ROCm)

Runpod.​io

pytorch:latest

Note

These templates are configured to use the :latest tag but you are free to change to any of the available Pytorch CUDA tags listed here

---

The author (@robballantyne) may be compensated if you sign up to services linked in this document. Testing multiple variants of GPU images in many different environments is both costly and time-consuming; This along with sponsorships helps to offset costs and further the development of the project