Skip to content

Ready Voice Controller , generate for End-to-End Text-to-Speech,with Multi-engine integration

License

Notifications You must be signed in to change notification settings

glide-the/RVC-Speakers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

88 Commits
Dec 8, 2023
Aug 26, 2023
Dec 8, 2023
Nov 14, 2023
Dec 8, 2023
Dec 8, 2023
Dec 8, 2023
Oct 19, 2023
Dec 8, 2023
Aug 26, 2023
Aug 26, 2023
Aug 19, 2023
Aug 19, 2023

Repository files navigation

RVC-Speakers

介绍

Ready Voice Controller系统采用了端到端的多引擎合成器,配备多种预处理器processors和音频处理流程audio pipeline, 可支持微调音素、语调、音色、情感等要素,控制语音生成效果。

演示地址

https://huggingface.co/spaces/dmeck/RVC-Speakers

运行

环境

项目基于python3.10开发,建议使用python3.10运行,构建环境使用poetry管理,需要安装poetry

  • python 3.10

poetry

pip install --no-cache-dir poetry       

依赖插件

  • poetry-multiproject-plugin
https://pypi.org/project/poetry-multiproject-plugin/
  • poetry-polylith-plugin
https://davidvujic.github.io/python-polylith-docs/commands/

模型与配置文件

配置文件

speakers/speakers.yaml

模型文件

模型存放在/media/checkpoint/RVC-Speakers-hub目录下, 如果没有该目录,需要创建该目录,然后下载模型文件到该目录下 文件结构如下

/media/checkpoint >>> tree -L 3 --dirsfirst RVC-Speakers-hub                                                           

RVC-Speakers-hub
├── bark
│   ├── assets
│   │   └── prompts
│   └── model
│       ├── bert-base-multilingual-cased
│       ├── codec
│       └── suno
├── rvc
│   ├── model
│   │   ├── arianagrande
│   │   ├── bob
│   │   ├── lulu
│   │   ├── maomao
│   │   ├── syz
│   │   ├── yiqing
│   │   ├── hubert_base.pt
│   │   └── rmvpe.pt
│   └── rvc.yaml
├── vits
│   └── model
│       ├── config.json
│       ├── D_0-p.pth
│       ├── D_0.pth
│       ├── G_0-p.pth
│       ├── G_0.pth
│       └── G_953000.pth
└── speakers.yaml

18 directories, 10 files

VITS

RVC


[hubert_base.pt](rvc/model/hubert_base.pt)
下载地址:https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/hubert_base.pt

[rmvpe.pt](rvc/model/rmvpe.pt)
如果你想使用最新的RMVPE人声音高提取算法,则你需要下载音高提取模型 
下载地址:https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/rmvpe.pt

bark

[prompts](bark/assets/prompts)
下载地址:https://github.com/suno-ai/bark/tree/main/bark/assets/prompts

如何运行

Create a virtual environment and install the dependencies:

poetry install

启动命令

任选一种

1、模块启动

  • Run the module:
python -m speakers.start.start --speakers-config-file /media/checkpoint/RVC-Speakers-hub/speakers.yaml  --verbose --mode web   

2、直接启动

python src/bases/speakers/start/start.py --speakers-config-file /media/checkpoint/RVC-Speakers-hub/speakers.yaml --verbose --mode web

常见问题

  • vits存在前置依赖,需要执行以下命令
pip install --upgrade cython numpy && \
    cd src/components/speakers/vits/monotonic_align && \
    mkdir -p src/components/speakers/vits/monotonic_align/vits/monotonic_align/ && \
    python setup.py build_ext --inplace && \
    mv src/components/speakers/vits/monotonic_align/vits/monotonic_align/* src/components/speakers/vits/monotonic_align/RUN pip install --upgrade cython numpy && \
    cd src/components/speakers/vits/monotonic_align && \
    mkdir -p src/components/speakers/vits/monotonic_align/vits/monotonic_align/ && \
    python setup.py build_ext --inplace && \
    mv src/components/speakers/vits/monotonic_align/vits/monotonic_align/* src/components/speakers/vits/monotonic_align/

About

Ready Voice Controller , generate for End-to-End Text-to-Speech,with Multi-engine integration

Resources

License

Stars

Watchers

Forks

Packages

No packages published