Skip to content

Commit

Permalink
Update examples/parallel-hf-embedding-ec2/parallel_hf_embedding_ec2.py
Browse files Browse the repository at this point in the history
Co-authored-by: Caroline Chen <[email protected]>
  • Loading branch information
py-rh and carolineechen authored Dec 11, 2024
1 parent f02e563 commit c3acc1d
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -172,7 +172,7 @@ def embed_docs(self, url: str, **embed_kwargs):
# Generally, when using Runhouse, you would initialize an image with `rh.Image`, and send your module to
# a process. Each process runs in a *separate process* on the cluster. In this case, we want to have 4 copies of the
# embedding model in separate processes, because we have 4 GPUs. We can do this by creating 4 separate processes
# and 4 separate modules, each sent to a separate processes. We do this in a loop here, with a list of dependencies
# and 4 separate modules, each sent to a separate process. We do this in a loop here, with a list of dependencies
# that we need remotely to run the module.
#
# In this case, each `process` is also on a separate machine, but we could also provision an A10G:4 instance,
Expand Down

0 comments on commit c3acc1d

Please sign in to comment.