Skip to content

v0.0.30

Compare
Choose a tag to compare
@carolineechen carolineechen released this 18 Jun 21:52
· 559 commits to main since this release
916c60a

Highlights

[Alpha] On-demand Docker Clusters

This release adds support for using a base Docker image in conjunction with an on-demand cluster. By specifying the image_id field in the format docker:<registry>/<image>:<tag> in the cluster factory, the corresponding Docker container will be downloaded when the cluster is launched. The Runhouse server is then started inside the Docker container, ensuring that anything that goes through Runhouse will be run inside the container environment.

For more information on usage, such as setting up environment variables for using private Docker registries, please refer to the User Guide.

docker_cluster = rh.ondemand_cluster(
    name="pytorch_cluster",
    image_id="docker:nvcr.io/nvidia/pytorch:23.10-py3",
    instance_type="CPU:2+",
    provider="aws",
)
docker_cluster.up_if_not()

New Features

  • Docker cluster support (#803, #852, #830, #905)
  • Add support for running in a marimo notebook (#892)

Bug Fixes

  • Handle string system for package .to (#875)
  • Properly save config.yaml for default conda env cluster (#910)
  • Minor fixes (#874)