This is a fork of SortAnon's Controllable TalkNet with the following modifications:
- New singing models have been added.
- NO LONGER ACTIVE:
controllable_talknet.pyhas been modified to output mel spectrograms from audio into the current directory during generation. These spectrograms can be used with my fork of ddsp-singing-vocoder - An offline training notebook for training singing models is included:
TalkNet_Training_Offline_Singer.ipynb - An alternate server has been added under
alt_server.py, designed to interface with this so-vits-svc fork
Controllable TalkNet is a web application that lets you synthesize speech, which mimics the pitch and pacing of an existing audio clip. It's based on NVIDIA's implementation of TalkNet 2, with some changes to support singing synthesis and higher audio quality.
- A Google account to run Colab, or...
- An NVIDIA GPU with 4+ GB of VRAM
- 10 GB of free space
- Go to the Colab notebook and follow the instructions.
- Download the setup script and extract it to a folder.
- Run setup.bat. The initial setup will take about 20 minutes.
- When it's done, run talknet.bat to start TalkNet on http://127.0.0.1:8050/. To download updates, run update.bat.
- Install Docker and NVIDIA Container Toolkit.
- Download the Dockerfile. Open a terminal, and navigate to the directory where you saved it.
- Run
docker build -t talknet-offline .to build the image. Addsudoif you're not using rootless Docker. - Run
docker run -it --gpus all -p 8050:8050 talknet-offlineto start TalkNet on http://127.0.0.1:8050/.