WIP: try generic worker with podman instead of docker for container engine #999
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The new image we're upgrading GPU workers to uses Ubuntu 24.04, which makes it incompatible with various parts of the pipeline (mostly due to Python package pinning). As it turns out, the easiest way to fix this is to dockerize the GPU tasks. We need slight updates to GPU task payloads to accommodate this. This will fix mozilla#391.
Now that we're running inside a docker image we don't have these available on the filesystem already. I explored the idea of installing them into the Docker image, but it's quite impractical. The host image is Ubuntu 24.04, and the containers Ubuntu 22.04. We need to have a matching toolkit version, and we require version 12 at this point, which isn't available on 22.04.
Without this we end up with these files being inaccessible in subsequent tasks.
This has always been needed, but it was found on the host system on the previous image.
VCS_PATH is guaranteed to be absolute when running on a `docker-worker` implementation: * https://github.com/taskcluster/taskgraph/blob/403aa244822eb40b46051eb3987a3ed48849e27c/src/taskgraph/transforms/run/common.py#L103-L111 * https://github.com/taskcluster/taskgraph/blob/403aa244822eb40b46051eb3987a3ed48849e27c/src/taskgraph/transforms/run/common.py#L141
bhearsum
force-pushed
the
gpu-multi-podman
branch
from
bae1fc9 to
316bc0d
Compare
bhearsum
force-pushed
the
gpu-multi-podman
branch
from
316bc0d to
ad07919
Compare
|
Podman has had many issues (both here and in other places we use it); we're definitely not going this route for the time being. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is a variant of #700 to see if podman works without issues with caches after some recent fixes.