Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: send context around cursor as prompt #71

Open
heimoshuiyu opened this issue Dec 5, 2024 · 0 comments
Open

Feature request: send context around cursor as prompt #71

heimoshuiyu opened this issue Dec 5, 2024 · 0 comments

Comments

@heimoshuiyu
Copy link

heimoshuiyu commented Dec 5, 2024

An important feature of Whisper is its ability to use specific nouns from the context to improve speech recognition accuracy.

So I was thinking that when I write some proper nouns in my notes and start voice input, the text around my cursor can be sent to the API as prompts. This way, Whisper will know the context I am in and the keywords I am using during transcription, which can greatly improve the recognition rate. ❤️

To be specific , I believe there are several possible solutions that can be implemented:

  1. Send the entire document opened by the user as a prompt to the API.
  2. Send the text above the cursor as a prompt to the API.
  3. Send only the text highlighted by the user as a prompt to the API.

For the last solution, I'm not sure if this can be achieved through a plugin and whether the same effect can be accomplished on a mobile application.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant