voice-pro README

The project's README from github.com/abus-aikorea/voice-pro. As one markdown file: README.md.

Voice-Pro

The best AI speech recognition, translation, and multilingual dubbing solution 🚀

Ask DeepWiki.com youtube Buy Me a Coffee release GitHub Repo stars

Dubbing Studio


🎙️ An AI-powered web application for speech recognition, translation, and dubbing

South Korea Flag 한국어 ∙ United Kingdom Flag English ∙ China Flag 中文简体 ∙ Taiwan Flag 中文繁體 ∙ Japan Flag 日本語 ∙ Germany Flag Deutsch ∙ Spain Flag Español ∙ Portugal Flag Português

Voice-Pro is a state-of-the-art web app that transforms multimedia content creation. It integrates YouTube video downloading, voice separation, speech recognition, translation, and text-to-speech into a single, powerful tool for creators, researchers, and multilingual professionals.

A robust alternative to ElevenLabs, Voice-Pro empowers podcasters, developers, and creators with advanced voice solutions.

⚠️ Please Note

📰 News & History

version 4.0
  • ⚡ Migrated the installer from Miniconda/pip to uv — dramatically faster, fully reproducible installs from a committed uv.lock. Everything stays inside installer_files/ (uv, Python, packages).
  • 🐍 Upgraded runtime: Python 3.12, Torch 2.8.0+cu128 (RTX 50-series supported), Gradio 6.20.
  • 🎙️ Latest ASR stack: faster-whisper 1.2.1 (large-v3-turbo, distil-large-v3.5), openai-whisper 20250625, whisper-timestamped 1.15.9. whisperX was removed (its dependency pins blocked the Gradio 6 upgrade; existing configs fall back to faster-whisper).
  • 🗣️ Latest TTS stack: F5-TTS 1.1.21, kokoro 0.9.4, edge-tts 7.x, and re-vendored CosyVoice (upstream main).
  • 🇰🇷 New optional TTS model: Fun-CosyVoice3-0.5B — 9 languages including Korean, selectable in the CosyVoice tab (downloads from the official HF repo on first use).
  • 🧹 CUDA Toolkit and Visual Studio Build Tools are no longer required — all dependencies ship prebuilt wheels, and PyTorch bundles the CUDA runtime.
  • 🛡️ Friendly to restricted / corporate PCs: no administrator rights needed — start.bat auto-downloads a portable ffmpeg if it is not installed, Whisper model downloads self-heal after interrupted/corrupted transfers, and translation automatically retries with backoff when the network rate-limits the free Google endpoint (failed lines are reported, originals kept).
  • 🚨 Errors are now visible in the WebUI: every failure shows a red error toast that stays on screen until you close it (previously a 10-second warning that was easy to miss), with actionable messages for common causes (missing ffmpeg, no media registered, etc.).
  • 🖥️ UI: migrated to Gradio 6 (full-width layout for all tabs, subtitle tracks shown directly in the video players).
  • 🧽 uninstall.bat no longer requires administrator rights and no longer force-reboots; uninstall.bat silent runs unattended.
version 3.2
  • We have been focusing on WeConnect development for the past few months and have not been able to manage Voice-Pro at all.
  • We have decided to open source all Voice-Pro code.
  • Voice-Pro is completely free and supports Windows, Mac, Linux.
  • WeConnect is an application for global cultural exchange.
  • Connect with people from all over the world for meaningful cultural exchanges, language learning, and international friendships.

ScreenShot 0 ScreenShot 1 ScreenShot 2 ScreenShot 3 ScreenShot 4

version 3.1
version 3.0
  • 🔥 Removed the AI Cover feature.
  • 🚀 Added support for m-bain/whisperX.
version 2.0
  • 🐍 Built with Python 3.10.15, Torch 2.5.1+cu124, and Gradio 5.14.0.
  • 🆓 Free trial supports media up to 60 seconds in length.
  • 🔥 Added the AI Cover feature.
  • 🎤 Introduced support for CosyVoice and kokoro.
  • ⏳ Initial run downloads CozyVoice2-0.5B (9GB), which may take over an hour depending on network speed.
  • 🎧 Voice samples for cloning will be continuously updated.
  • 📝 Added spaCy for natural sentence-by-sentence translation and TTS.
  • ☁️ Subscription version includes Microsoft Azure Translator and TTS.
  • 🏪 Subscription offers unlimited usage (no 60-second limit) during the subscription period, available via Shopify.

🎥 YouTube Showcase

Demo Video 1
Demo for Voice-Pro (v2.0)
Demo Video 2
F5-TTS: Voice Cloning
Demo Video 3
Live Transcription & Translation
Demo Video 4
Multi-Lingual Voice Cloning: Korean - German
Demo Video 5
Multi-Lingual Voice Cloning: English - Korean
Demo Video 6
Multi-Lingual Voice Cloning: Korean - Japanese
Demo Video 7
NVIDIA RTX Video Super-Resolution
Demo Video 8
AI Karaoke
Demo Video 5
Multi-Lingual Voice Cloning: English - Korean

⭐ Key Features

1. Dubbing Studio

2. Speech Technologies

3. Real-Time Translation

🤖 WebUI

Dubbing Studio Tab

Multilingual Voice Conversion and Subtitle Generation Web UI Interface

Whisper Caption Tab

Translate Tab

WebUI for Real-Time Speech Recognition and Translation

Speech Generation Tab

Podcast Production WebUI Using Voice-Cloning Technology

🎤✨ Reference Voice

English

Andrew Bustamante

Andrew Huberman

Avi Loeb

Ben Shapiro

Brett Johnson

Brian Keating

Coffeezilla

Dan Carlin

David Buss

David Fravor

David Kipping

Dennis Whyte

Donald Hoffman

Donald Trump

Douglas Murray

Duncan Trussell

Elon Musk

Garry Nolan

Jack Barsky

James Sexton

Jeff Bezos

voice-pro (abus-aikorea/voice-pro)

podcasts
Searching Database…

What is this?Voice-Pro is a free, open-source AI web app (built with Gradio) that combines speech recognition, zero-shot voice cloning, text-to-speech, YouTube downloading, vocal isolation, and multilingual translation into one tool for creators and researchers.
Is this a cloud service or do I run it myself?You run it yourself: download the repo, launch start.bat, and it opens as a local Gradio web page on your own PC — there's no hosted cloud version.
How do I get it running?On Windows, download the repo and run start.bat — it uses uv to automatically install Python, PyTorch, and all other dependencies into an isolated installerfiles/ folder, with no manual setup needed.
Do I need an NVIDIA GPU to run this?Yes — it's built on CUDA-accelerated PyTorch (2.8.0+cu128) and is confirmed to run well on Windows with an NVIDIA GPU. CUDA Toolkit and Visual Studio Build Tools are no longer required since all dependencies now ship as prebuilt wheels.
Is active development still happening?No — the maintainers paused Voice-Pro development to focus on another project (WeConnect), though they open-sourced the whole codebase and made it free. Also note that only Windows + NVIDIA GPU is verified; Mac and Linux behavior is unconfirmed.
Does it work on Mac or Linux, or only Windows?It's confirmed to work well on Windows with an NVIDIA GPU; running it on Mac or Linux has not been verified.
Is it really free to use?Yes, the entire codebase is open source under GPL-3.0 and can be freely used, distributed, and modified by anyone.
What speech and voice features does it pack into one app?It covers ASR with Whisper/Faster-Whisper, zero-shot voice cloning via F5-TTS, E2-TTS and CosyVoice, TTS through Edge-TTS and kokoro, Demucs vocal isolation, YouTube downloading via yt-dlp, and translation for 100+ languages.
What is kokoro?kokoro is one of the built-in TTS engines, ranked #2 in the HuggingFace TTS Arena, used for generating natural-sounding speech in the app.
Can it dub or subtitle a YouTube video automatically?Yes — the Dubbing Studio tab downloads a YouTube video, isolates vocals with Demucs, transcribes and translates the speech, and generates dubbed audio with TTS, all in one workflow.
Were there paid tiers before it went open source?Earlier versions had a subscription tier with Azure TTS/Translator and unlimited usage versus a 60-second free trial cap, but since the open-source release everything is free with no usage limits.
Size
84.3 MB
Stars
13K
Age
2y
Commits · 90 Days