Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build docker image #2542

Merged
merged 6 commits into from
Mar 27, 2024
Merged

Build docker image #2542

merged 6 commits into from
Mar 27, 2024

Conversation

clee2000
Copy link
Contributor

@clee2000 clee2000 commented Sep 1, 2023

Downloading pip dependencies takes 2-4 min, but downloading the new docker image takes +1min from the pytorch one
Not sure how downloading all dependencies to a new image takes in comparison to pulling docker image

Docker image scripts are copied from pytorch, I tried to remove stuff but there's definitely a lot left over

@pytorch-bot
Copy link

pytorch-bot bot commented Sep 1, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/tutorials/2542

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

✅ No Failures

As of commit 5ae8ead with merge base 9ceac50 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@clee2000 clee2000 force-pushed the csl/dexperiment branch 2 times, most recently from 5a72eee to a75016d Compare March 11, 2024 17:50
@clee2000 clee2000 changed the title [experiment] docker Build docker image Mar 11, 2024
@clee2000 clee2000 requested a review from malfet March 11, 2024 21:46
.ci/docker/common/install_conda.sh Outdated Show resolved Hide resolved
.ci/docker/common/install_conda.sh Outdated Show resolved Hide resolved
.ci/docker/common/install_cudnn.sh Outdated Show resolved Hide resolved
.ci/docker/common/install_user.sh Outdated Show resolved Hide resolved
.ci/docker/build.sh Outdated Show resolved Hide resolved
Copy link
Contributor

@malfet malfet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thank you for all the updates

MAJOR_PYTHON_VERSION=$(echo "$ANACONDA_PYTHON_VERSION" | cut -d . -f 1)
MINOR_PYTHON_VERSION=$(echo "$ANACONDA_PYTHON_VERSION" | cut -d . -f 2)

CONDA_FILE="Miniconda3-latest-Linux-x86_64.sh"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if latest is such a good idea, perhaps one can specify the version here.
Also, why not depend on the system python? (Should be 3.8 or something like that)

vim \
unzip \
gdb \
rsync \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It does not hurt, but why?

Suggested change
rsync \

apt-get install -y --no-install-recommends \
build-essential \
ca-certificates \
cmake=3.16* \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need cmake to build tutorials?

Suggested change
cmake=3.16* \

sudo \
vim \
jq \
vim \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I really like vim, but installing it once is sufficient

Suggested change
vim \

@malfet malfet merged commit 2ad3512 into main Mar 27, 2024
20 checks passed
mikaylagawarecki pushed a commit to mikaylagawarecki/tutorials that referenced this pull request Apr 4, 2024
Downloading pip dependencies takes 2-4 min, but downloading the new docker image takes +1min from the pytorch one
Not sure how downloading all dependencies to a new image takes in comparison to pulling docker image

Docker image scripts are copied from pytorch, I tried to remove stuff but there's definitely a lot left over
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants