voice-pro README

The project's README from github.com/abus-aikorea/voice-pro. As one markdown file: README.md.

Voice-Pro

The best AI speech recognition, translation, and multilingual dubbing solution 🚀

Ask DeepWiki.com youtube Buy Me a Coffee release GitHub Repo stars

Dubbing Studio


🎙️ An AI-powered web application for speech recognition, translation, and dubbing

South Korea Flag 한국어 ∙ United Kingdom Flag English ∙ China Flag 中文简体 ∙ Taiwan Flag 中文繁體 ∙ Japan Flag 日本語 ∙ Germany Flag Deutsch ∙ Spain Flag Español ∙ Portugal Flag Português

Voice-Pro is a state-of-the-art web app that transforms multimedia content creation. It integrates YouTube video downloading, voice separation, speech recognition, translation, and text-to-speech into a single, powerful tool for creators, researchers, and multilingual professionals.

A robust alternative to ElevenLabs, Voice-Pro empowers podcasters, developers, and creators with advanced voice solutions.

⚠️ Please Note

📰 News & History

version 4.0
  • ⚡ Migrated the installer from Miniconda/pip to uv — dramatically faster, fully reproducible installs from a committed uv.lock. Everything stays inside installer_files/ (uv, Python, packages).
  • 🐍 Upgraded runtime: Python 3.12, Torch 2.8.0+cu128 (RTX 50-series supported), Gradio 6.20.
  • 🎙️ Latest ASR stack: faster-whisper 1.2.1 (large-v3-turbo, distil-large-v3.5), openai-whisper 20250625, whisper-timestamped 1.15.9. whisperX was removed (its dependency pins blocked the Gradio 6 upgrade; existing configs fall back to faster-whisper).
  • 🗣️ Latest TTS stack: F5-TTS 1.1.21, kokoro 0.9.4, edge-tts 7.x, and re-vendored CosyVoice (upstream main).
  • 🇰🇷 New optional TTS model: Fun-CosyVoice3-0.5B — 9 languages including Korean, selectable in the CosyVoice tab (downloads from the official HF repo on first use).
  • 🧹 CUDA Toolkit and Visual Studio Build Tools are no longer required — all dependencies ship prebuilt wheels, and PyTorch bundles the CUDA runtime.
  • 🛡️ Friendly to restricted / corporate PCs: no administrator rights needed — start.bat auto-downloads a portable ffmpeg if it is not installed, Whisper model downloads self-heal after interrupted/corrupted transfers, and translation automatically retries with backoff when the network rate-limits the free Google endpoint (failed lines are reported, originals kept).
  • 🚨 Errors are now visible in the WebUI: every failure shows a red error toast that stays on screen until you close it (previously a 10-second warning that was easy to miss), with actionable messages for common causes (missing ffmpeg, no media registered, etc.).
  • 🖥️ UI: migrated to Gradio 6 (full-width layout for all tabs, subtitle tracks shown directly in the video players).
  • 🧽 uninstall.bat no longer requires administrator rights and no longer force-reboots; uninstall.bat silent runs unattended.
version 3.2
  • We have been focusing on WeConnect development for the past few months and have not been able to manage Voice-Pro at all.
  • We have decided to open source all Voice-Pro code.
  • Voice-Pro is completely free and supports Windows, Mac, Linux.
  • WeConnect is an application for global cultural exchange.
  • Connect with people from all over the world for meaningful cultural exchanges, language learning, and international friendships.

ScreenShot 0 ScreenShot 1 ScreenShot 2 ScreenShot 3 ScreenShot 4

version 3.1
version 3.0
  • 🔥 Removed the AI Cover feature.
  • 🚀 Added support for m-bain/whisperX.
version 2.0
  • 🐍 Built with Python 3.10.15, Torch 2.5.1+cu124, and Gradio 5.14.0.
  • 🆓 Free trial supports media up to 60 seconds in length.
  • 🔥 Added the AI Cover feature.
  • 🎤 Introduced support for CosyVoice and kokoro.
  • ⏳ Initial run downloads CozyVoice2-0.5B (9GB), which may take over an hour depending on network speed.
  • 🎧 Voice samples for cloning will be continuously updated.
  • 📝 Added spaCy for natural sentence-by-sentence translation and TTS.
  • ☁️ Subscription version includes Microsoft Azure Translator and TTS.
  • 🏪 Subscription offers unlimited usage (no 60-second limit) during the subscription period, available via Shopify.

🎥 YouTube Showcase

Demo Video 1
Demo for Voice-Pro (v2.0)
Demo Video 2
F5-TTS: Voice Cloning
Demo Video 3
Live Transcription & Translation
Demo Video 4
Multi-Lingual Voice Cloning: Korean - German
Demo Video 5
Multi-Lingual Voice Cloning: English - Korean
Demo Video 6
Multi-Lingual Voice Cloning: Korean - Japanese
Demo Video 7
NVIDIA RTX Video Super-Resolution
Demo Video 8
AI Karaoke
Demo Video 5
Multi-Lingual Voice Cloning: English - Korean

⭐ Key Features

1. Dubbing Studio

2. Speech Technologies

3. Real-Time Translation

🤖 WebUI

Dubbing Studio Tab

Multilingual Voice Conversion and Subtitle Generation Web UI Interface

Whisper Caption Tab

Translate Tab

WebUI for Real-Time Speech Recognition and Translation

Speech Generation Tab

Podcast Production WebUI Using Voice-Cloning Technology

🎤✨ Reference Voice

English

Andrew Bustamante

Andrew Huberman

Avi Loeb

Ben Shapiro

Brett Johnson

Brian Keating

Coffeezilla

Dan Carlin

David Buss

David Fravor

David Kipping

Dennis Whyte

Donald Hoffman

Donald Trump

Douglas Murray

Duncan Trussell

Elon Musk

Garry Nolan

Jack Barsky

James Sexton

Jeff Bezos

voice-pro (abus-aikorea/voice-pro)

Searching Database…

13.3K ·GitHub
这是什么?Voice-Pro 是一款免费的开源 AI 网页应用(基于 Gradio 构建),把语音识别、零样本语音克隆、文本转语音、YouTube 下载、人声分离和多语言翻译整合到一个工具中,面向创作者和研究人员。
这是云服务,还是要自己运行?需要自己运行:下载仓库,启动 start.bat,它会在你自己的电脑上以本地 Gradio 网页的形式打开,没有托管的云端版本。
我该怎么把它跑起来?在 Windows 上,下载仓库并运行 start.bat——它会使用 uv 自动把 Python、PyTorch 和其他所有依赖安装到独立的 installerfiles/ 文件夹中,无需手动设置。
运行这个需要 NVIDIA 显卡吗?需要——它基于支持 CUDA 加速的 PyTorch(2.8.0+cu128)构建,并已确认在配有 NVIDIA 显卡的 Windows 上运行良好。由于所有依赖现在都以预编译 wheel 的形式提供,因此不再需要 CUDA Toolkit 和 Visual Studio Build Tools。
项目还在持续开发吗?不再开发——维护者已暂停 Voice-Pro 的开发,转而专注于另一个项目(WeConnect),不过他们已将整个代码库开源并免费提供。另外请注意,目前只验证过 Windows + NVIDIA 显卡的组合,Mac 和 Linux 上的表现尚未确认。
它能在 Mac 或 Linux 上用,还是只能在 Windows 上?已确认在配有 NVIDIA 显卡的 Windows 上运行良好;在 Mac 或 Linux 上运行尚未经过验证。
真的可以免费使用吗?可以,整个代码库都以 GPL-3.0 协议开源,任何人都可以自由使用、分发和修改。
它把哪些语音功能整合到了一个应用里?它支持基于 Whisper/Faster-Whisper 的语音识别,通过 F5-TTS、E2-TTS 和 CosyVoice 实现零样本语音克隆,通过 Edge-TTS 和 kokoro 实现文本转语音,支持 Demucs 人声分离、通过 yt-dlp 下载 YouTube 视频,并支持 100 多种语言的翻译。
什么是 kokoro?kokoro 是内置的文本转语音引擎之一,在 HuggingFace TTS Arena 中排名第 2,用于在应用中生成自然的语音。
它能自动为 YouTube 视频配音或加字幕吗?可以——“Dubbing Studio”标签页可以下载 YouTube 视频,用 Demucs 分离人声,转写并翻译语音,再通过文本转语音生成配音音频,整个流程一次完成。
开源之前有收费版本吗?早期版本有订阅版,包含 Azure TTS/Translator 且不限使用量,免费试用则限制为 60 秒;开源发布后,所有功能都免费,没有使用限制。
Size
84.3 MB
Stars
13.3K
Age
2y
Commits · 90 Days