Qwen3.8-Flash-Next README

The project's README from github.com/QwenLM/Qwen3.8-Flash-Next. As one markdown file: README.md.

Qwen3.8-Flash-Next

💜 Qwen Studio | 🤗 Hugging Face | 🤖 ModelScope | 💬 WeChat (微信) | 🫨 Discord

Welcome to the GitHub repository of the Qwen3.8-Flash-Next.

Introduction

Qwen3.8-Flash-Next

In this release we are opening the weights of Qwen3.8-Flash-Next, a multimodal MoE model that also serves as an early preview of the architecture used in Qwen4. It plays the same role that Qwen3-Next played for Qwen3.5: the hybrid Gated DeltaNet + Gated Attention design introduced at that time has since been used across the Qwen3.5, Qwen3.6, Qwen3.7 and Qwen3.8 series. We are again releasing the architectural changes early, so that the community can examine them before the full Qwen4 model family is built on top of them.

Qwen3.8-Flash-Next Architecture

Qwen3.8-Flash-Next upgrades the model systematically along four aspects — attention, residual, embedding and optimization — improving model capability while further optimizing computational efficiency, model capacity and training stability:

Qwen3.8-Flash-Next features a 125B-parameter main model, supplemented by an additional 51B N-gram embeddings, with 6B parameters activated per token. Compared with Qwen3.7-Plus, Qwen3.8-Flash-Next substantially reduces both training and inference cost — training takes only about 1/9 as much, yet it delivers superior capabilities in coding and office tasks.

News

Models

The official model weights are released on:

Benchmarks

Evaluation results are reported in the Qwen3.8-Flash-Next blog.

Quickstart

Official

You can try Qwen3.8-Flash-Next on our official sites and enjoy the native experience with extra features.

QwenWork

Qwen3.8-Flash-Next now powers the newly-launched "Standard" mode on QwenWork. QwenWork is a one-stop AI working platform launched by Alibaba. Follow its documentation to get started!

Qwen API

QwenCloud provides first-class support for Qwen3.8-Flash-Next, which is compatible with various API specifications, including OpenAI and Anthropic, making it simple for you to try Qwen3.8-Flash-Next in your own applications.

Qwen Code

Qwen Code is an open-source AI agent for the terminal, optimized for Qwen models. It helps you understand large codebases, automate tedious work, and ship faster. Follow its documentation to get started!

Local Use

Hugging Face Transformers

transformers acts as the model-definition framework in the current open-weight LLM landscape. It also includes functionalities for LLM inference and training. The addition of serving capabilities in transformers makes it much easier to integrate new models in your development.

To launch a server, simply use the transformers serve command:

transformers serve Qwen/Qwen3.8-Flash-Next --port 8000 --continuous-batching

An OpenAI-compatible API will be available at http://localhost:8000/v1. See the Serve CLI guide for more information.

llama.cpp

llama.cpp enables LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware. llama.cpp supports the Qwen3.8-Flash-Next (text & vision). Look for models ending with GGUF on Hugging Face Hub.

MLX (Apple Silicon)

If you are running on Apple Silicon, mlx-vlm supports Qwen3.8-Flash-Next (vision + text). Original checkpoints are compatible and can be converted. You can also search for models ending with MLX on the Hugging Face Hub for ready-to-use quantized versions.

Unsloth

Unsloth contains a local UI to run and train LLMs and diffusion models, including Qwen3.8-Flash-Next and more. See the Qwen3.8-Flash-Next guide for running Qwen3.8-Flash-Next quants with Unsloth.

Deployment

Qwen3.8-Flash-Next is supported by multiple inference frameworks. Here we demonstrate the usage of SGLang, vLLM, and TokenSpeed.

SGLang

SGLang is a fast serving framework for large language models and vision language models. SGLang can be used to launch a server with an OpenAI-compatible API service.

sglang serve --model-path Qwen/Qwen3.8-Flash-Next --port 8000 --tp-size 4 --context-length 262144 --reasoning-parser qwen3 --tool-call-parser qwen3_coder

An OpenAI-compatible API will be available at http://localhost:8000/v1.

Also see SGLang Cookbook on serving Qwen3.8-Flash-Next.

vLLM

vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs. vLLM can be used to launch a server with an OpenAI-compatible API service.

vllm serve Qwen/Qwen3.8-Flash-Next --port 8000 --tensor-parallel-size 4 --max-model-len 262144 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder

An OpenAI-compatible API will be available at http://localhost:8000/v1.

Also see vLLM Recipes on serving Qwen3.8-Flash-Next.

TokenSpeed

TokenSpeed is a speed-of-light LLM inference engine. TokenSpeed can be used to launch a server with an OpenAI-compatible API service.

tokenspeed serve Qwen/Qwen3.8-Flash-Next --port 8000 --tensor-parallel-size 4 --max-model-len 262144 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder

An OpenAI-compatible API will be available at http://localhost:8000/v1.

Also see TokenSpeed Recipes on serving Qwen3.8-Flash-Next.

Finetuning

We advise you to use training frameworks, including Unsloth, Swift, Llama-Factory, to finetune your models with SFT, DPO, GRPO, etc.

License Agreement

Please find the license file released with the model weights on Hugging Face Hub or ModelScope.

Citation

If you find our work helpful, feel free to give us a cite.

@techreport{qwen2026design,
    title       = {On the Design of {Qwen3.8-Next} Architecture: Evaluation, Efficiency, and Training Stability},
    author      = {{Qwen Team}},
    institution = {Alibaba Group},
    month       = {August},
    year        = {2026}
}

@misc{qwen3.8flashnext,
    title  = {{Qwen3.8-Flash-Next}: A New Architecture, Towards Ultimate Cost-Efficiency},
    author = {{Qwen Team}},
    month  = {August},
    year   = {2026},
    url    = {https://qwen.ai/blog?id=qwen3.8-flash-next}
}

Contact Us

If you are interested in leaving a message to either our research team or product team, join our Discord or WeChat groups!

Qwen3.8-Flash-Next (QwenLM/Qwen3.8-Flash-Next)

Searching Database…

Что это?Qwen3.8-Flash-Next — открытая мультимодальная фундаментальная модель Mixture-of-Experts от команды Qwen в Alibaba; она же служит ранним превью архитектуры, которую Alibaba планирует использовать в готовящейся семье моделей Qwen4.
Это приложение-чатбот или просто сырые веса модели, которые придётся разворачивать самому?Это просто выпущенные веса модели, а не упакованное приложение. Вы скачиваете их с Hugging Face Hub или ModelScope и запускаете через фреймворк инференса вроде transformers, vLLM, SGLang или llama.cpp.
Как запустить его локально?Скачайте веса через huggingface download или git clone (или modelscope download), затем поднимите сервер с помощью CLI transformers serve, vLLM или SGLang и получите эндпоинт API, совместимый с OpenAI.
Какое железо или фреймворк нужны для запуска?Нужен серверный фреймворк вроде transformers, vLLM, SGLang, llama.cpp, MLX (Apple Silicon) или Unsloth, плюс достаточно памяти GPU для MoE-модели на 125B параметров с 6B активных параметров на токен.
Можно ли запустить полную модель на одной потребительской GPU?Не в полной точности — это MoE-модель на 125B параметров, рассчитанная на развёртывание через фреймворки вроде vLLM или SGLang на серьёзном железе, хотя есть квантизованные GGUF-сборки для llama.cpp и MLX-сборки для Apple Silicon для более лёгких конфигураций.
Чем архитектура отличается от предыдущих моделей Qwen?Она обновляет attention гибридом Gated DeltaNet + Qwen Sparse Attention, расширяет residual-поток до 4 гейтованных ветвей (Gated Residual), добавляет таблицу N-gram Embedding для дешёвого наращивания ёмкости и обучается оптимизатором Muon для лучшей стабильности.
Можно попробовать, не хостя его самому?Да — он питает новый режим 'Standard' на QwenWork, доступен через совместимый с OpenAI/Anthropic Qwen API на QwenCloud и может использоваться через терминального агента Qwen Code.
Как он соотносится с Qwen3.7-Plus?Обучение стоит примерно в 9 раз дешевле, чем у Qwen3.7-Plus, при более сильных способностях в кодинге и офисных задачах.
Могу ли я сам дообучить эту модель?Да, README рекомендует фреймворки обучения вроде Unsloth, Swift или Llama-Factory для дообучения через SFT, DPO или GRPO.
Creator
QwenLM
Size
2.2 MB
Stars
433
Updated
CommitAug 27
Age
1mo
Commits · 90 Days