Voice to Speech is an in-browser client-side service that converts a user's voice into synthesized speech live via speech recognition, with hundreds of voices, text to speech (TTS), language auto-translation, and socket support.
Known supported browsers: Chrome, Edge, Safari
Visit https://shadowforests.github.io/VoiceToSpeech/ to use Voice to Speech.
- Live speech recognition via Web Speech API (only on Chrome).
- Low latency Voice-to-Speech by using interim speech recognition results.
- Alternative Text-to-Speech input for fine control of output.
- Auto translation from input voice language to output speech language.
- Large selection of languages and dialects for speech recognition and voices.
- Includes support for voices on your computer and built in to your browser.
- Customize audio input and output devices.
- Customize output volume, as well as pitch and rate for select voices.
- Live speech output transcript with playback support for all transcript entries.
- Selecting all text on the page will only select transcript text, allowing easy copy-paste.
- Live diagnostics for speech recognition output, confidence, and errors.
- Use a web socket to send speech output text directly to your PC.
- Use two instances to allow bi-directional translation between you and someone else.
You can set up a web socket server on your PC to send speech output text directly to your PC. You can find an example in this repository that you can run using Node. Start the server by running socket/run_server.bat and speech will be sent into socket/vts_speech.txt whenever you use the Voice To Speech site.
This is a walkthrough to setup a custom system allows bi-directional translation between you and someone else.
- You will need two Chrome browsers installed separately. I recommend Chrome and Chrome Beta. This is because a single Chrome browser can only handle one voice input at a time.
- You will also need at least two audio routers from VB-Cable. You should get the default VB-Cable Driver as well as an additional VB-Cable A Driver (donationware). This is so that we can route audio through separate channels to avoid collision in speech recognition results. After setup, you can open your computer's sound options and enable listening to the cables from your main speakers. This helps to hear what is happening during conversation.
- Open the Voice To Speech site on both browsers. Open the options menu and enable Translation in both browsers.
- In Chrome, set the input to your personal microphone, and the output to CABLE OUTPUT. Then, set your language as the input, and the language the other person speaks in as the output.
- In your communication program, set your input microphone to CABLE OUTPUT. Now, when you speak, the speech synthesis will output to your communication program instead of your voice.
- In Chrome Beta, set the input to CABLE-A OUTPUT, and the output to your default speaker. Then, set the language the other person speaks in as the input, and your language as the output.
- If your communication program supports redirecting audio output, set the output to CABLE-A OUTPUT. Otherwise, if you are using Windows, you can go to Sound playback options in the Settings app, click App volume and device properties, and change the output device for your communication program. This may require you to restart your program. Now, when the other person speaks, their voice will be redirected through Voice To Speech and output as translated speech through your speaker.
- Now the other person's voice will be auto translated and spoken to your speaker, and your voice will be auto translated and spoken through your communication program!
This project is licensed under the MIT License - see the LICENSE.md file for details