Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add voice capabilities to Mimir #1

Open
tjhasan opened this issue Feb 8, 2023 · 1 comment
Open

Add voice capabilities to Mimir #1

tjhasan opened this issue Feb 8, 2023 · 1 comment
Assignees

Comments

@tjhasan
Copy link
Owner

tjhasan commented Feb 8, 2023

Ideally, we want Mimir to be able to join the voice channel then speak with Mimir's voice. If we can make Mimir able to listen to a particular person and respond to them, then it would be perfect.

@tjhasan
Copy link
Owner Author

tjhasan commented Feb 11, 2023

Eleven Labs could be a great source for training the bot to sound like Mimir. They have APIs which we can use to feed it words to say.

Once the Eleven Labs voice is trained, the process would look like this:

  1. User asks Mimir something (either via text or via sound).
  2. The prompt is sent to chatGPT via openAI's API.
  • We should append "Respond like Mimir from God of War would."
  • We may be able to train our bot to always respond like Mimir. Need to look into the training API in the openAI documentation.
  1. We get the response from chatGPT and send the text to ElevenLabs.
  2. We then play the ElevenLabs response into the Discord Bot via VC.
  • Need to look into how to do this.

@tjhasan tjhasan self-assigned this Feb 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant