Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Triton container documentation implies py38 #134

Open
david-waterworth opened this issue Nov 17, 2023 · 0 comments
Open

Triton container documentation implies py38 #134

david-waterworth opened this issue Nov 17, 2023 · 0 comments

Comments

@david-waterworth
Copy link

The documentation for the Triton image (https://github.com/aws/deep-learning-containers/blob/master/available_images.md#nvidia-triton-inference-containers-sm-support-only) mentions py38 as the python version option. However the Example URL contains py3.

What did you find confusing? Please describe.
Different versions of Triton support different Python versions depending on which version of Ubuntu the container is based on (i.e. up to 23.02 ships with py38 as the default, later versions ship with py310)

Describe how documentation can be improved
Explicitly/correctly document which system python is shipped with the image.

Additional context
Unlike most sagemaker containers where additional packages are installed via requirements.txt Triton requires custom packages to be installed into a conda venv and then compressed using conda pack. This requires explicit knowledge of which system python the Triton image contains and this isn't py38 since 23.02.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant