chatterbox README

The project's README from github.com/resemble-ai/chatterbox. As one markdown file: README.md.

Chatterbox Multilingual Image

Chatterbox TTS

Alt Text Alt Text Alt Text Discord

Made with ♥️ by resemble-logo-horizontal

Chatterbox is a family of state-of-the-art, open-source text-to-speech models by Resemble AI.

Latest Release: Chatterbox Multilingual V3

Chatterbox Multilingual V3 is the latest general-purpose multilingual TTS model in the Chatterbox family. It keeps the same 0.5B model size while improving speaker similarity, reducing hallucinations, and producing more natural, conversational speech across languages.

V3 is designed for broad language coverage like V2, but with stronger stability and more expressive generation. It is the recommended multilingual model for users who want one voice cloning model that works across many languages.

Alongside V3, we are releasing the Single Language Pack: dedicated finetunes for priority languages where tighter quality control, stronger language-specific behavior, and more specialized speech generation are valuable.

For low-latency English voice agents, Chatterbox-Turbo is our most efficient model. Built on a streamlined 350M parameter architecture, Turbo delivers high-quality speech with less compute and VRAM than our previous models. We have also distilled the speech-token-to-mel decoder, previously a bottleneck, reducing generation from 10 steps to just one, while retaining high-fidelity audio output.

Paralinguistic tags are now native to the Turbo model, allowing you to use [cough], [laugh], [chuckle], and more to add distinct realism. While Turbo was built primarily for low-latency voice agents, it excels at narration and creative workflows.

For the most resource-constrained deployments, Chatterbox-Nano shares Turbo's architecture in an even smaller 110M parameter package. It targets on-device and CPU inference — running 3x faster than realtime on 8 CPU cores — while keeping the same single-step decoder and native paralinguistic tag support. Nano is the recommended model when memory and latency budgets are tightest.

If you like the model but need to scale or tune it for higher accuracy, check out our competitively priced TTS service (link). It delivers reliable performance with ultra-low latency of sub 200ms—ideal for production use in agents, applications, or interactive media.

Podonos Turbo Eval

⚡ Model Zoo

Choose the right model for your application.

Model Size Languages Key Features Best For 🤗 Examples
Chatterbox-Turbo 350M English Paralinguistic Tags ([laugh]), Lower Compute and VRAM Zero-shot voice agents, Production Demo Listen
Chatterbox-Nano 110M English Same architecture as Turbo, Paralinguistic Tags, Runs on CPU (3x realtime on 8 cores) On-device / CPU inference, tight latency & memory budgets Model —
Chatterbox-Multilingual V3 (Language list) 500M 23+ Improved speaker similarity, reduced hallucinations, more natural multilingual speech Global applications, localization, cross-language voice cloning Demo Listen
Single Language Pack (Models) 500M each 6 dedicated finetunes Language- and region-specific quality control Priority languages and dialect-sensitive applications Models Demos
Chatterbox (Tips and Tricks) 500M English CFG & Exaggeration tuning General zero-shot TTS with creative controls Demo Listen

Installation

pip install chatterbox-tts

Alternatively, you can install from source:

# conda create -yn chatterbox python=3.11
# conda activate chatterbox

git clone https://github.com/resemble-ai/chatterbox.git
cd chatterbox
pip install -e .

We developed and tested Chatterbox on Python 3.11 on Debian 11 OS; the versions of the dependencies are pinned in pyproject.toml to ensure consistency. You can modify the code or dependencies in this installation mode.

Usage

Chatterbox-Turbo
import torchaudio as ta
import torch
from chatterbox.tts_turbo import ChatterboxTurboTTS

# Load the Turbo model
model = ChatterboxTurboTTS.from_pretrained(device="cuda")

# Generate with Paralinguistic Tags
text = "Hi there, Sarah here from MochaFone calling you back [chuckle], have you got one minute to chat about the billing issue?"

# Generate audio (requires a reference clip for voice cloning)
wav = model.generate(text, audio_prompt_path="your_10s_ref_clip.wav")

ta.save("test-turbo.wav", wav, model.sr)
Chatterbox-Nano

Nano shares Turbo's architecture and is loaded through the same ChatterboxTurboTTS class by passing nano=True:

import torchaudio as ta
import torch
from chatterbox.tts_turbo import ChatterboxTurboTTS

# Load the Nano model (also runs on CPU: device="cpu")
model = ChatterboxTurboTTS.from_pretrained(device="cuda", nano=True)

# Generate with Paralinguistic Tags
text = "Hi there, Sarah here from MochaFone calling you back [chuckle], have you got one minute to chat about the billing issue?"

# Generate audio (requires a reference clip for voice cloning)
wav = model.generate(text, audio_prompt_path="your_10s_ref_clip.wav")

ta.save("test-nano.wav", wav, model.sr)
Chatterbox and Chatterbox-Multilingual

import torchaudio as ta
from chatterbox.tts import ChatterboxTTS
from chatterbox.mtl_tts import ChatterboxMultilingualTTS

device = "cuda"  # or "cpu" / "mps"

# English example
model = ChatterboxTTS.from_pretrained(device=device)

text = "Ezreal and Jinx teamed up with Ahri, Yasuo, and Teemo to take down the enemy's Nexus in an epic late-game pentakill."
wav = model.generate(text)
ta.save("test-english.wav", wav, model.sr)

# Multilingual V3 examples
multilingual_model = ChatterboxMultilingualTTS.from_pretrained(device=device, t3_model="v3")
# To use the legacy V2 multilingual checkpoint, omit t3_model or pass t3_model="v2".

french_text = "Bonjour, comment ça va? Ceci est le modèle de synthèse vocale multilingue Chatterbox, il prend en charge 23 langues."
wav_french = multilingual_model.generate(french_text, language_id="fr")
ta.save("test-french.wav", wav_french, multilingual_model.sr)

chinese_text = "你好,今天天气真不错,希望你有一个愉快的周末。"
wav_chinese = multilingual_model.generate(chinese_text, language_id="zh")
ta.save("test-chinese.wav", wav_chinese, multilingual_model.sr)

# If you want to synthesize with a different voice, specify the audio prompt
AUDIO_PROMPT_PATH = "YOUR_FILE.wav"
wav = model.generate(text, audio_prompt_path=AUDIO_PROMPT_PATH)
ta.save("test-2.wav", wav, model.sr)

See example_tts.py, example_tts_turbo.py, example_tts_nano.py, and example_vc.py for more examples.

Supported Languages

The general-purpose Chatterbox Multilingual model supports the following languages:

Arabic (ar) • Danish (da) • German (de) • Greek (el) • English (en) • Spanish (es) • Finnish (fi) • French (fr) • Hebrew (he) • Hindi (hi) • Italian (it) • Japanese (ja) • Korean (ko) • Malay (ms) • Dutch (nl) • Norwegian (no) • Polish (pl) • Portuguese (pt) • Russian (ru) • Swedish (sv) • Swahili (sw) • Turkish (tr) • Chinese (zh)

Single Language Pack

The Single Language Pack provides dedicated finetunes for priority languages and regional variants. Use these when you want stronger language-specific behavior, tighter quality control, or dialect-aware generation beyond the general multilingual model.

Language Model Card Demo Space
Chinese ResembleAI/Chatterbox-Multilingual-zh-cmn Demo
Latam Spanish ResembleAI/Chatterbox-Multilingual-es-mx-latam Demo
Brazilian Portuguese ResembleAI/Chatterbox-Multilingual-pt-br Demo
Spain Spanish ResembleAI/Chatterbox-Multilingual-es-es Demo
Portugal Portuguese ResembleAI/Chatterbox-Multilingual-pt-pt Demo
Hindi ResembleAI/Chatterbox-Multilingual-hi Demo

Original Chatterbox Tips

Built-in PerTh Watermarking for Responsible AI

Every audio file generated by Chatterbox includes Resemble AI's Perth (Perceptual Threshold) Watermarker - imperceptible neural watermarks that survive MP3 compression, audio editing, and common manipulations while maintaining nearly 100% detection accuracy.

Watermark extraction

You can look for the watermark using the following script.

import perth
import librosa

AUDIO_PATH = "YOUR_FILE.wav"

# Load the watermarked audio
watermarked_audio, sr = librosa.load(AUDIO_PATH, sr=None)

# Initialize watermarker (same as used for embedding)
watermarker = perth.PerthImplicitWatermarker()

# Extract watermark
watermark = watermarker.get_watermark(watermarked_audio, sample_rate=sr)
print(f"Extracted watermark: {watermark}")
# Output: 0.0 (no watermark) or 1.0 (watermarked)

Official Discord

👋 Join us on Discord and let's build something awesome together!

Evaluation

Chatterbox Turbo was evaluated using Podonos, a platform for reproducible subjective speech evaluation.

We compared Chatterbox Turbo to competitive TTS systems using Podonos' standardized evaluation suite, focusing on overall preference, naturalness, and expressiveness.

Evaluation reports:

These evaluations were conducted under identical conditions and are publicly accessible via Podonos.

Acknowledgements

Citation

If you find this model useful, please consider citing.

@misc{chatterboxtts2025,
  author       = {{Resemble AI}},
  title        = {{Chatterbox-TTS}},
  year         = {2025},
  howpublished = {\url{https://github.com/resemble-ai/chatterbox}},
  note         = {GitHub repository}
}

Disclaimer

Don't use this model to do bad things. Prompts are sourced from freely available data on the internet.

chatterbox (resemble-ai/chatterbox)

Searching Database…

这是什么?Chatterbox 是 Resemble AI 推出的一系列先进的开源文本转语音(TTS)模型,包括多语言模型和低延迟语音智能体变体。
这是 Python 库还是托管服务?这是一个需要自行运行的 Python 库/模型包;如果需要扩展规模或进一步微调,还可以使用 Resemble AI 的付费 TTS 服务。
我该如何安装和运行它?以 Python 包的形式从源代码安装;exampletts.py、examplettsturbo.py、examplettsnano.py 和 examplevc.py 等示例展示了如何用每个模型版本生成语音。
它是为哪个 Python 版本和操作系统开发的?它在 Debian 11 上使用 Python 3.11 开发和测试,依赖版本已在 pyproject.toml 中固定,以保证一致性。
多语言模型支持哪些语言?通用的 Multilingual V3 模型支持 23 种以上语言,包括阿拉伯语、英语、西班牙语、法语、印地语、日语、韩语、俄语和中文;另外还提供针对中文、西班牙语变体、葡萄牙语变体和印地语的单语言专用包。
生成的音频会包含追踪或水印吗?会。Chatterbox 生成的每个音频文件都嵌入了 Resemble AI 不易察觉的 Perth 神经水印,该水印在经过 MP3 压缩和常见编辑后仍能保留,检测准确率接近 100%。
Turbo 和 Nano 有什么区别?Turbo 是一个 3.5 亿参数的模型,专为低延迟的英语语音智能体打造,显存和计算需求较低;Nano 与 Turbo 架构相同,但缩减到 1.1 亿参数,专门用于在严格的内存和延迟限制下进行 CPU 及端侧推理。
什么是副语言标签?它们是特殊标记,例如 [cough]、[laugh] 和 [chuckle],由 Turbo 和 Nano 模型原生支持,可以让你直接在生成的音频中加入逼真的非语音声音。
我怎样控制语音的语气或表现力?你可以调节 exaggeration 和 cfgweight 参数:降低 cfgweight(例如到 0.3 左右)并提高 exaggeration(例如到 0.7 左右),可以得到更具戏剧性、更有表现力的语音;而默认值(0.5/0.5)对大多数情况都效果不错。
Chatterbox Turbo 和其他 TTS 系统做过基准测试吗?做过。它与 ElevenLabs Turbo v2.5、Cartesia Sonic 3 和 VibeVoice 7B 进行了对比,评测采用 Podonos 标准化的主观评估套件,结果以公开报告的形式发布。
Size
1.5 MB
Stars
27.1K
Age
1y
Commits · 90 Days