OpenVoice README

The project's README from github.com/myshell-ai/OpenVoice. As one markdown file: README.md.

 

Paper | Website

myshell-ai%2FOpenVoice | Trendshift

Introduction

OpenVoice V1

As we detailed in our paper and website, the advantages of OpenVoice are three-fold:

1. Accurate Tone Color Cloning. OpenVoice can accurately clone the reference tone color and generate speech in multiple languages and accents.

2. Flexible Voice Style Control. OpenVoice enables granular control over voice styles, such as emotion and accent, as well as other style parameters including rhythm, pauses, and intonation.

3. Zero-shot Cross-lingual Voice Cloning. Neither of the language of the generated speech nor the language of the reference speech needs to be presented in the massive-speaker multi-lingual training dataset.

OpenVoice V2

In April 2024, we released OpenVoice V2, which includes all features in V1 and has:

1. Better Audio Quality. OpenVoice V2 adopts a different training strategy that delivers better audio quality.

2. Native Multi-lingual Support. English, Spanish, French, Chinese, Japanese and Korean are natively supported in OpenVoice V2.

3. Free Commercial Use. Starting from April 2024, both V2 and V1 are released under MIT License. Free for commercial use.

Video

OpenVoice has been powering the instant voice cloning capability of myshell.ai since May 2023. Until Nov 2023, the voice cloning model has been used tens of millions of times by users worldwide, and witnessed the explosive user growth on the platform.

Main Contributors

How to Use

Please see usage for detailed instructions.

Common Issues

Please see QA for common questions and answers. We will regularly update the question and answer list.

Citation

@article{qin2023openvoice,
  title={OpenVoice: Versatile Instant Voice Cloning},
  author={Qin, Zengyi and Zhao, Wenliang and Yu, Xumin and Sun, Xin},
  journal={arXiv preprint arXiv:2312.01479},
  year={2023}
}

License

OpenVoice V1 and V2 are MIT Licensed. Free for both commercial and research use.

Acknowledgements

This implementation is based on several excellent projects, TTS, VITS, and VITS2. Thanks for their awesome work!

OpenVoice (myshell-ai/OpenVoice)

Searching Database…

这是什么?OpenVoice 是一个用于即时语音克隆的音频基础模型,由 MIT 和 MyShell 开发;它可以克隆参考说话人的音色,并以多种语言和口音生成语音。
这只是研究代码,还是真的在支撑一款产品?它是开源且可直接运行的代码,并且已经投入生产:自 2023 年 5 月起为 MyShell.ai 的即时语音克隆功能提供支持,全球用户累计使用了数千万次。
我该怎样让它运行起来?README 没有直接列出安装步骤,而是指向仓库中一份单独的使用指南,其中有详细的安装和运行说明。
它基于什么构建?我需要安装 Python 和其他语音库吗?需要。它是一个 Python 实现,基于现有的语音合成项目 TTS、VITS 和 VITS2 构建。
参考音色和生成的语音必须是同一种语言吗?不必。OpenVoice 支持零样本跨语言克隆,因此参考音频的语言和目标语言都不必在训练数据中出现过。
我能免费将 OpenVoice 用于商业用途吗?可以。自 2024 年 4 月起,OpenVoice V1 和 V2 均采用 MIT 许可证,因此可免费用于商业和研究用途。
OpenVoice V2 相比 V1 有什么新变化?V2 保留了 V1 的全部功能,并通过修订的训练策略提升了音频质量,原生支持英语、西班牙语、法语、中文、日语和韩语,同时提供完全免费的商业授权。
V2 开箱即支持哪些语言?OpenVoice V2 原生支持英语、西班牙语、法语、中文、日语和韩语。
除了克隆出的音色本身,我还能控制什么?OpenVoice 允许对情感、口音、节奏、停顿和语调等风格要素进行精细控制,而不仅仅是原始音色。
What are similar projects?FireRedTTS3, bark, MOSS-TTS-Nano, dia, VoxCPM, AudioGPT, AuK, csm
Creator
myshell-ai
Size
3.9 MB
Stars
38K
Updated
CommitApr 19
Age
2y
Commits · 90 Days