What is this?
OpenVoice is an audio foundation model for instant voice cloning, built by MIT and MyShell; it clones a reference speaker's tone color and generates speech in multiple languages and accents.
OpenVoice is an audio foundation model for instant voice cloning, built by MIT and MyShell; it clones a reference speaker's tone color and generates speech in multiple languages and accents.Is this just research code, or does it actually power a real product?It is open-source, runnable code that has already been in production: it has powered MyShell.ai's instant voice cloning feature since May 2023 and was used tens of millions of times by users worldwide.
It is open-source, runnable code that has already been in production: it has powered MyShell.ai's instant voice cloning feature since May 2023 and was used tens of millions of times by users worldwide.How do I get it running?The README does not inline setup steps; it points to a separate usage guide in the repo for detailed install and run instructions.
The README does not inline setup steps; it points to a separate usage guide in the repo for detailed install and run instructions.What's it built on - do I need Python and other speech libraries?Yes, it is a Python implementation that builds on top of existing speech synthesis projects TTS, VITS, and VITS2.
Yes, it is a Python implementation that builds on top of existing speech synthesis projects TTS, VITS, and VITS2.Do the reference voice and the generated speech need to be in the same language?No - OpenVoice supports zero-shot cross-lingual cloning, so neither the reference audio's language nor the target language needs to have appeared in the training data.
No - OpenVoice supports zero-shot cross-lingual cloning, so neither the reference audio's language nor the target language needs to have appeared in the training data.Can I use OpenVoice commercially for free?Yes, since April 2024 both OpenVoice V1 and V2 are MIT licensed, making them free for both commercial and research use.
Yes, since April 2024 both OpenVoice V1 and V2 are MIT licensed, making them free for both commercial and research use.What's new in OpenVoice V2 versus V1?V2 keeps every V1 feature but adds better audio quality from a revised training strategy, native support for English, Spanish, French, Chinese, Japanese and Korean, and fully free commercial licensing.
V2 keeps every V1 feature but adds better audio quality from a revised training strategy, native support for English, Spanish, French, Chinese, Japanese and Korean, and fully free commercial licensing.Which languages does V2 support out of the box?English, Spanish, French, Chinese, Japanese, and Korean are natively supported in OpenVoice V2.
English, Spanish, French, Chinese, Japanese, and Korean are natively supported in OpenVoice V2.What can I control beyond just the cloned voice itself?OpenVoice allows granular control over style elements like emotion, accent, rhythm, pauses, and intonation, not just the raw tone color.
OpenVoice allows granular control over style elements like emotion, accent, rhythm, pauses, and intonation, not just the raw tone color.What are similar projects?FireRedTTS3, bark, MOSS-TTS-Nano, dia, VoxCPM, AudioGPT, AuK, csm
FireRedTTS3, bark, MOSS-TTS-Nano, dia, VoxCPM, AudioGPT, AuK, csmWhich topics is it in?zero-shot-tts, voice-clone, speech, mit-license, audio-generation, voice-cloning, speech-synthesis, voice, tts, text-to-speech, multilingual, audio
zero-shot-tts, voice-clone, speech, mit-license, audio-generation, voice-cloning, speech-synthesis, voice, tts, text-to-speech, multilingual, audio