Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new function launcher #10

Open
5 tasks
mcopik opened this issue Feb 16, 2023 · 0 comments
Open
5 tasks

Add new function launcher #10

mcopik opened this issue Feb 16, 2023 · 0 comments
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@mcopik
Copy link
Contributor

mcopik commented Feb 16, 2023

While FMI supports launching a swarm of function workers, we have used some Bash scripts to launch many functions in parallel. We need a proper tool similar to mpiexec that would take parameters such as the number of functions, name of the function, and cloud region, generate a configuration for each function, and quickly launch a desired number of workers.

  • Implement a basic parallel launcher supporting arbitrary functions.
  • Document the input format describing the function ID and the hierarchy of workers (see Implement shared-memory communication #7).
  • Add a local backend to start functions as Docker or native processes on the same system.
  • Add error handling to display failure outputs from functions.
  • Add a tree-based launcher to achieve a logarithmic startup time.
@mcopik mcopik added enhancement New feature or request good first issue Good for newcomers labels Feb 16, 2023
@mcopik mcopik moved this to Todo in Full MPI support Feb 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
Status: Todo
Development

No branches or pull requests

1 participant