项目的 README,来自 github.com/Edge0-AI/Audio8_TTS。合并为一个 markdown 文件:README.md。
Compact text-to-speech models for zero-shot voice cloning.
2026-11-16 · llama.cpp / GGUF — Native local inference, voice cloning and streaming for Realistic Air, with one shared F32 model bundle. Runbook · GGUF files.
Audio8-TTS-Realistic-Air builds on Preview with substantially improved speech realism, retaining the same compact 0.6B architecture and zero-shot voice cloning. It supports 23 languages, adding 12 languages compared with Preview.
| Release | Focus and languages | Model | Listen | Guide |
|---|---|---|---|---|
| Realistic Air | Realism and prosody · 23 languages | HF | Demo | Details |
ONNX: There is currently no Realistic Air ONNX export.
Native deployment: llama.cpp / GGUF runbook · Shared model folder.
| Coverage | Languages |
|---|---|
| 11 languages supported in Preview | Cantonese, Chinese, Dutch, English, French, German, Italian, Japanese, Korean, Polish, Spanish |
| 12 additions in Realistic Air | Arabic, Finnish, Hindi, Indonesian, Malay, Norwegian, Portuguese, Russian, Swedish, Thai, Turkish, Vietnamese |
Note: Quality varies by language; benchmark coverage differs from the supported-language list. Per-language results.
Use Python 3.10+ and a CUDA-capable GPU. Run from the repository root. The explicit model ID selects Realistic Air independently of the scripts' existing Preview default.
git clone https://github.com/Edge0-AI/Audio8_TTS.git
cd Audio8_TTS
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
python audio8_tts_infer.py \
--model Edge0/Audio8-TTS-Realistic-Air \
--text "Welcome to Audio8 TTS. It is wonderful to hear from you." \
--output outputs/realistic.wav
For voice cloning, add --reference-audio reference.wav --reference-text "The exact transcript of the recording.".
Installation, cloning and batch inference · Supervised fine-tuning
Error rates are percentages (lower is better). SIM uses a 0–1 scale (higher is better). Neither directly measures speech realism.
Audio8-TTS-Preview and Audio8-TTS-Realistic-Air, both 0.6B:
| Benchmark | Coverage | Preview error % ↓ | Realistic Air error % ↓ | Preview SIM ↑ | Realistic Air SIM ↑ |
|---|---|---|---|---|---|
| Seed-TTS | English / Chinese | 1.23 | 1.25 | 0.682 | 0.704 |
| CV3 | 8 shared languages | 4.80 | 4.56 | — | 0.663 |
| CV3 | 9 core languages | — | 4.86 | — | 0.661 |
| MiniMax | 24 evaluated languages | — | 5.89 | — | 0.754 |
Note: Values are unweighted language macro averages. Preview results are calculated from its published model card, with SIM converted from percentages to a 0–1 scale. The two releases were evaluated separately. A dash means the corresponding result was not reported on Preview's card.
Seed-TTS averages English WER and Chinese CER, excluding hard Chinese. The shared CV3 subset is Chinese, English, Japanese, Korean, German, French, Spanish, and Italian; the 9-language set also includes Russian. CV3 averages exclude hard subsets and the 13 additional languages. MiniMax averages all 24 evaluated languages, including languages outside the supported list.
Full Realistic Air evaluation and comparison notes · Original Preview evaluation
Meet Audio8-TTS-0.1B: a compact, portable text-to-speech model with zero-shot voice cloning.
Designed for a smaller deployment footprint, with Chinese and English as its primary languages. The dedicated ONNX INT8 runtime supports CPU inference, streaming, and local web/HTTP serving.
| Release | Focus and languages | Model | Listen | Guide |
|---|---|---|---|---|
| Preview 0.1B | Compact hybrid · primarily Chinese / English | HF | Demo | Details |
0.1B quick start · CPU / ONNX runtime · 0.1B deployment · Model license
Installation and inference · Supervised fine-tuning
The shared tools accept an explicit model ID. Use the quick-start and deployment instructions for your chosen release.
The native C++ route for Realistic Air targets local applications, desktop deployment and embedded integration, without Python, PyTorch or ONNX Runtime at inference time. It provides speech generation, reference-audio voice cloning, WAV output and HTTP/streaming through the Audio8 runtime linked below.
| Entry | Contents |
|---|---|
| Standalone runbook | Download, build, generate, serve, stream and troubleshoot |
| Implementation and converter | Pinned upstream patch, source verification and F32 export |
| HF model folder | One shared bundle across platforms; four payloads total 3.76 GB |
F32 is the default. For GPU services with dynamic batching, see SGLang Omni below.
Note: Use CPU on macOS; Metal is experimental. The Windows build instructions have not yet been tested on a Windows machine.
SGLang Omni provides paged attention, dynamic batching, and an OpenAI-compatible speech API. The 0.6B family and the 0.1B hybrid model have their own configurations. Existing performance results remain paired with their original model, hardware, and test conditions in the deployment guide.
Deployment matrix, installation and server configuration · API, streaming and troubleshooting
The repository code and both 0.6B releases use Apache License 2.0.
The 0.1B base checkpoint and its ONNX INT8 export both use Audio8 Community License v1.0. Commercial use is royalty-free for entities whose annual revenue, including parent companies, subsidiaries, and affiliates, is below US$2,000,000, subject to the license conditions; at or above that threshold, a separate written commercial license is required. See the 0.1B license guide and ONNX model license for details.
See NOTICE for attribution. We thank the Fish Audio team for the DualAR architecture used in Fish Audio S2 Pro.