Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

whisper real-time from Jetson Nano #44

Open
ghost opened this issue Dec 12, 2023 · 2 comments
Open

whisper real-time from Jetson Nano #44

ghost opened this issue Dec 12, 2023 · 2 comments

Comments

@ghost
Copy link

ghost commented Dec 12, 2023

Hello.
Thanks to your whisper real-time, I tried STT on my computer.
I want to use this package on my Jetson Nano, but when I run it on my Jetson Nano, the CPU and memory usage is very high and the screen freezes.
Then someone told me to use the API of OPENAI, and just like running GPT with python code, I can use the API of WHISPER.

So I'm wondering if I can use the STT function in this code by entering the api key without downloading the model or running heavy.

@davabase
Copy link
Owner

Take a look at this branch that implements this idea: #13
I haven't tested it, but my guess is that it will be too slow for real-time transcription.

You may want to try an alternative Whisper implementation that has significantly better performance than the original one, such as:

I have not tried any of these but they are reputable projects. WhisperX and Faster Whisper have similar functions to the OpenAI's original Whisper package so it should integrate easily.

@ghost
Copy link

ghost commented Dec 15, 2023

@davabase how can i use faster whisper on this project=

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant