Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cylc wf generator - for CPU emulator #64

Open
1 of 3 tasks
tsaie79 opened this issue Jan 28, 2025 · 3 comments
Open
1 of 3 tasks

Cylc wf generator - for CPU emulator #64

tsaie79 opened this issue Jan 28, 2025 · 3 comments
Assignees

Comments

@tsaie79
Copy link
Collaborator

tsaie79 commented Jan 28, 2025

  • Cylc generator - for CPU emulator
    • Take the configuration of RTDP of the 3-node experiment of the CPU-emulator and create Cylc wf.
    • Expand the Cylc wf to support indefinite number of emulators
    • Support it to an indefinite number of emulators in the config of RTDP.
@tsaie79 tsaie79 self-assigned this Jan 28, 2025
@tsaie79
Copy link
Collaborator Author

tsaie79 commented Feb 4, 2025

  • Take the configuration of RTDP of the 3-node experiment of the CPU-emulator and create Cylc wf.
  • Built a Cylc wf generator that takes RTDP configuration as input and outputs Cylc wf. wf-generator

  • Built a GUI toy model that lets users create a graph of CPU emulators, senders, receivers, and convert it into RTDP configuration for building Cylc workflow. gui

  • Notice that this is tested with 3-node test (1 cpu-emulator, 1 receiver, and 1 sender).

@tsaie79
Copy link
Collaborator Author

tsaie79 commented Feb 10, 2025

  • Expand the Cylc wf to support indefinite number of emulators
  • Support it to an indefinite number of emulators in the config of RTDP.

Set up a Cylc wf for 1 sender, 2 emulators, and 1 receiver. To debug, set up two sets of test before using Cylc.

  • Test this setup using docker-compose.

  • The sender and receiver are built in Python and containerized. The sender can send data to the emulator, while the receiver can't catch the data. There could be bugs from the containerization.

  • Test this setup using SLURM.

@tsaie79
Copy link
Collaborator Author

tsaie79 commented Feb 10, 2025

  • Containerized CPU emulator with the latest version.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

1 participant