Skip to content

Files

Latest commit

5ccae4f · Mar 10, 2025

History

History

pytorch

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Mar 3, 2025
Mar 3, 2025
Mar 3, 2025
Mar 3, 2025
Mar 3, 2025
Oct 20, 2024
Mar 3, 2025
Feb 10, 2025
Mar 3, 2025
Feb 26, 2025
Mar 3, 2025
Nov 6, 2024
Oct 20, 2024
Mar 10, 2025

pytorch

CONTAINERS IMAGES RUN BUILD

Containers for PyTorch with CUDA support. Note that the l4t-pytorch containers also include PyTorch, torchvision, and torchaudio.

CONTAINERS
pytorch:2.5
   Aliases torch:2.5 pytorch torch
   Requires L4T ['==36.*']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx
   Dependants 3d_diffusion_policy ai-toolkit audiocraft auto_awq:0.2.4 auto_awq:0.2.4-builder auto_awq:0.2.6 auto_awq:0.2.6-builder auto_awq:0.2.7.post2 auto_awq:0.2.7.post2-builder auto_awq:0.2.8 auto_awq:0.2.8-builder auto_gptq:0.7.1 auto_gptq:0.7.1-builder auto_gptq:0.8.0 auto_gptq:0.8.0-builder awq:0.1.0 awq:0.1.0-builder bitsandbytes:0.39.1 bitsandbytes:0.39.1-builder bitsandbytes:0.44.1 bitsandbytes:0.44.1-builder bitsandbytes:0.45.1 bitsandbytes:0.45.1-builder causalconv1d:1.4.0 causalconv1d:1.4.0-builder causalconv1d:1.6.0 causalconv1d:1.6.0-builder clip_trt cobra:0.0.1 comfyui comfyui cosmos crossformer deepspeed:0.15.2 deepspeed:0.15.2-builder deepspeed:0.16.3 deepspeed:0.16.3-builder deepspeed:0.9.5 deepspeed:0.9.5-builder diffusers:0.30.2 diffusers:0.30.2-builder diffusers:0.31.0 diffusers:0.31.0-builder diffusers:0.32.3 diffusers:0.32.3-builder diffusion_policy dimba:1.0 efficientvit exllama:0.0.15 exllama:0.2.7 faiss_lite flash-attention:2.5.7 flash-attention:2.5.7-builder flash-attention:2.6.3 flash-attention:2.6.3-builder flash-attention:2.7.2.post1 flash-attention:2.7.2.post1-builder flash-attention:2.7.4.post1 flash-attention:2.7.4.post1-builder fruitnerf:1.0 gptq-for-llama gsplat:1.3.0 gsplat:1.3.0-builder gsplat:1.5.0 gsplat:1.5.0-builder habitat-sim:0.3.1 habitat-sim:0.3.1-builder habitat-sim:0.3.3 habitat-sim:0.3.3-builder hloc:1.4 hloc:1.4 hloc:1.4-builder hloc:1.4-builder hloc:1.5 hloc:1.5 hloc:1.5-builder hloc:1.5-builder holoscan hymba jetson-copilot jetson-inference:foxy jetson-inference:galactic jetson-inference:humble jetson-inference:iron jetson-inference:jazzy jetson-inference:main kat:1 l4t-diffusion l4t-ml l4t-pytorch l4t-text-generation langchain langchain:samples lerobot libcom:0.1.1 lita llama-factory llama-index llama-index:samples llama-vision llava local_llm mamba:2.2.2 mamba:2.2.2-builder mamba:2.2.5 mamba:2.2.5-builder mambavision:1.0 mimicgen minigpt4 mlc:0.1.0 mlc:0.1.0-builder mlc:0.1.1 mlc:0.1.1-builder mlc:0.1.2 mlc:0.1.2-builder mlc:0.1.3 mlc:0.1.3-builder mlc:0.1.4 mlc:0.1.4-builder mlc:0.19.0 mlc:0.19.0-builder nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanodb nanoowl nanosam nemo:1.23.0 nemo:2.0.0 nemo:2.0.0-builder nerfacc:0.5.3 nerfacc:0.5.3-builder nerfacc:0.5.4 nerfacc:0.5.4-builder nerfstudio:1.1.4 nerfstudio:1.1.4-builder nerfstudio:1.1.5 nerfstudio:1.1.5-builder nerfstudio:1.1.6 nerfstudio:1.1.6-builder octo onnxruntime_genai:0.6.0 onnxruntime_genai:0.6.0 onnxruntime_genai:0.6.0-builder onnxruntime_genai:0.6.0-builder openvla openvla:mimicgen optimum pixsfm:1.0 pixsfm:1.0 pixsfm:1.0-builder pixsfm:1.0-builder prismatic pycolmap:3.10 pycolmap:3.10 pycolmap:3.10-builder pycolmap:3.10-builder pycolmap:3.11.1 pycolmap:3.11.1 pycolmap:3.11.1-builder pycolmap:3.11.1-builder pycolmap:3.12 pycolmap:3.12 pycolmap:3.12-builder pycolmap:3.12-builder pycolmap:3.8 pycolmap:3.8 pycolmap:3.8-builder pycolmap:3.8-builder raft robomimic sam sapiens sglang sglang shape-llm stable-diffusion stable-diffusion-webui tam tensorrt_llm:0.12 tensorrt_llm:0.12-builder text-generation-inference text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main tinycudann:1.7 tinycudann:1.7-builder torch2trt torch_tensorrt torchao:0.7.0 torchao:0.7.0-builder torchao:0.8.0 torchao:0.8.0-builder torchao:0.9.0 torchao:0.9.0-builder torchaudio:2.5.0 torchaudio:2.5.0-builder torchvision:0.20.0 torchvision:0.20.0-builder transformer-engine:1.13 transformer-engine:1.13-builder transformer-engine:2.0 transformer-engine:2.0-builder transformers:4.48.2 transformers:git transformers:nvgpt triton:3.0.0 triton:3.0.0-builder triton:3.1.0 triton:3.1.0-builder triton:3.2.0 triton:3.2.0-builder tvm vhacdx:0.0.8.post1 vhacdx:0.0.8.post1 vhacdx:0.0.8.post1-builder vhacdx:0.0.8.post1-builder vhacdx:0.0.9.post1 vhacdx:0.0.9.post1 vhacdx:0.0.9.post1-builder vhacdx:0.0.9.post1-builder videomambasuite:1.0 vila vllm:0.7.2 vllm:0.7.2-builder voicecraft whisper whisper_trt whisperx xformers:0.0.29 xformers:0.0.29-builder xtts xtuner zigma:1.0 zigma:1.0-builder
   Dockerfile Dockerfile
CONTAINER IMAGES
Repository/Tag Date Arch Size
  dustynv/pytorch:1.10-r32.7.1 2023-12-14 arm64 1.1GB
  dustynv/pytorch:1.11-r35.2.1 2023-11-05 arm64 5.4GB
  dustynv/pytorch:1.11-r35.3.1 2023-12-14 arm64 5.4GB
  dustynv/pytorch:1.11-r35.4.1 2023-12-11 arm64 5.4GB
  dustynv/pytorch:1.12-r35.2.1 2023-12-14 arm64 5.5GB
  dustynv/pytorch:1.12-r35.3.1 2023-08-29 arm64 5.5GB
  dustynv/pytorch:1.12-r35.4.1 2023-11-03 arm64 5.5GB
  dustynv/pytorch:1.13-r35.2.1 2023-08-29 arm64 5.5GB
  dustynv/pytorch:1.13-r35.3.1 2023-12-12 arm64 5.5GB
  dustynv/pytorch:1.13-r35.4.1 2023-12-14 arm64 5.5GB
  dustynv/pytorch:1.9-r32.7.1 2023-12-14 arm64 1.0GB
  dustynv/pytorch:2.0-r35.2.1 2023-12-06 arm64 5.4GB
  dustynv/pytorch:2.0-r35.3.1 2023-12-14 arm64 5.4GB
  dustynv/pytorch:2.0-r35.4.1 2023-10-07 arm64 5.4GB
  dustynv/pytorch:2.1-r35.2.1 2023-12-11 arm64 5.4GB
  dustynv/pytorch:2.1-r35.3.1 2023-12-14 arm64 5.4GB
  dustynv/pytorch:2.1-r35.4.1 2023-11-05 arm64 5.4GB
  dustynv/pytorch:2.1-r36.2.0 2023-12-14 arm64 7.2GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

# automatically pull or build a compatible container image
jetson-containers run $(autotag pytorch)

# or explicitly specify one of the container images above
jetson-containers run dustynv/pytorch:2.1-r36.2.0

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/pytorch:2.1-r36.2.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

jetson-containers run -v /path/on/host:/path/in/container $(autotag pytorch)

To launch the container running a command, as opposed to an interactive shell:

jetson-containers run $(autotag pytorch) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

jetson-containers build pytorch

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.