Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Grand Unification #125

Open
erhant opened this issue Oct 1, 2024 · 3 comments
Open

Grand Unification #125

erhant opened this issue Oct 1, 2024 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@erhant
Copy link
Member

erhant commented Oct 1, 2024

This repository could be (and should be) turned into a workspace with the following crates:

  1. dkn-p2p-client that handles all P2P connections
  2. dkn-model-client that handles Workflow execution, and model configurations & service checks
  3. dkn-oracle-node that handles LLM oracle executions, uses (2)
  4. dkn-compute-node that handles DKN tasks, uses (1) and (2)
  5. dkn-node-launcher that basically takes care of configurations, envs, and updates; this shall be the only executable released & downloaded, the choice of node should come with a command line argument as it does in Oracle
  • (1) is required to share the P2P logic tht we keep copy-pasting around from a single source, will be useful for RPC
  • (2) is required to share the model logic between compute, oracle and even launcher maybe, again will help us avoid copy-pasting all the time
  • (5) is required because Oracle node needs a launcher logic as well, and using clap we can "connect" the underlying CLIs together, e.g dkn-oracle foobar becomes dkn oracle foobar
@erhant erhant added the enhancement New feature or request label Oct 1, 2024
@erhant erhant self-assigned this Oct 1, 2024
@erhant
Copy link
Member Author

erhant commented Oct 1, 2024

Note that Ollama Workflows will be re-exported from dkn-model-client, so if there is an update there we only need to update the version within dkn-model-client only!

@erhant erhant mentioned this issue Oct 7, 2024
9 tasks
@erhant
Copy link
Member Author

erhant commented Oct 30, 2024

Closing, oracle and launcher may come in a later date but the #127 works fine!

@erhant erhant closed this as completed Oct 30, 2024
@fco-fbatch
Copy link
Member

🆙

@fco-fbatch fco-fbatch reopened this Dec 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants