LLaDA-Image README

The project's README from github.com/inclusionAI/LLaDA-Image. As one markdown file: README.md.

LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes

Welcome to the official repository for LLaDA-Image, a unified model for high-quality image generation and editing.

GitHub arXiv
LLaDA-Image Base on Hugging Face LLaDA-Image Base FP8 Version on Hugging Face LLaDA-Image Turbo on Hugging Face LLaDA-Image Turbo FP8 Version on Hugging Face
LLaDA-Image Base on Modelscope LLaDA-Image Base FP8 Version on Modelscope LLaDA-Image Turbo on Modelscope LLaDA-Image Turbo FP8 Version on Modelscope

LLaDA-Image realistic image generation showcase
Photorealistic image generation with natural lighting, lifelike details, and coherent scenes.

LLaDA-Image text rendering and poster generation showcase
High-quality text rendering and creative poster generation across diverse visual styles.

LLaDA-Image editing showcase
Instruction-guided image editing with faithful content preservation and precise visual changes.

Introduction

LLaDA-Image is a competitive 6B-parameter open-source unified image generation and editing model family. It includes LLaDA-Image, a 50-step Base model for high-quality text-to-image generation and instruction-guided editing, and LLaDA-Image-Turbo, a 4-step distilled model for fast generation and editing. Both variants support practical text-to-image generation, VQ-conditioned generation, reference-image editing, and Chinese--English text rendering.

This repository provides the checkpoints and Diffusers-based inference code for the LLaDA-Image model family.

News

Highlights

Qwen-image bench evaluation

Model Zoo

Model Description Sampling steps Hugging Face (Checkpoints) ModelScope (Checkpoints)
LLaDA-Image Base model for high-fidelity text-to-image generation and instruction-guided editing. 50 BF16: inclusionAI/LLaDA-Image
FP8: inclusionAI/LLaDA-Image-FP8
BF16: inclusionAI/LLaDA-Image
FP8: inclusionAI/LLaDA-Image-FP8
LLaDA-Image-Turbo Distilled model for fast generation and editing. 4 BF16: inclusionAI/LLaDA-Image-Turbo
FP8: inclusionAI/LLaDA-Image-Turbo-FP8
BF16: inclusionAI/LLaDA-Image-Turbo
FP8: inclusionAI/LLaDA-Image-Turbo-FP8

Opensource Plan

Quick Start

1. Create an environment

The implementation has been used with Python 3.11, PyTorch 2.8, Transformers 4.57.6, and Diffusers 0.39.0.

git clone https://github.com/inclusionAI/LLaDA-Image.git
cd LLaDA-Image

conda create -n llada-image python=3.11 -y
conda activate llada-image

pip install -r requirements.txt

2. Run inference

The pipeline accepts a prompt and, for editing, an optional reference image.

LLaDA-Image (Base)

Use the Base checkpoint for high-fidelity generation and editing. Its recommended sampling configuration is 50 steps.

import torch

from src import LLaDAImagePipeline

# Load the pipeline. The model is downloaded from Hugging Face on first use.
pipe = LLaDAImagePipeline.from_pretrained(
    "inclusionAI/LLaDA-Image",
    torch_dtype=torch.bfloat16,
    device="cuda",
)

# Generate an image.
prompt = (
    "A cinematic photograph of a red fox standing in fresh snow, "
    "soft winter light, detailed fur, shallow depth of field"
)
negative_prompt = ""

image = pipe(
    prompt=prompt,
    negative_prompt=negative_prompt,
    generation_mode="text",
    height=1024,
    width=1024,
    num_inference_steps=50,
    guidance_scale=5.0,
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]

image.save("llada-image-base.png")

LLaDA-Image-Turbo

Use the Turbo checkpoint for fast generation and editing. Its recommended sampling configuration is 4 steps.

[!NOTE] For LLaDA-Image-Turbo inference, you can try setting stochastic_sampling to false in scheduler/scheduler_config.json, which may produce sharper details in some cases.

import torch

from src import LLaDAImagePipeline

# Load the distilled Turbo checkpoint.
pipe = LLaDAImagePipeline.from_pretrained(
    "inclusionAI/LLaDA-Image-Turbo",
    torch_dtype=torch.bfloat16,
    device="cuda",
)

prompt = "A quiet observatory above a sea of clouds at sunrise, golden light, wide-angle photograph"

image = pipe(
    prompt=prompt,
    generation_mode="text",
    height=1024,
    width=1024,
    num_inference_steps=4,
    guidance_scale=1.0,
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]

image.save("llada-image-turbo.png")

Generation modes

Both checkpoints support the following modes. Text and VQ-conditioned generation require height and width divisible by 16; image editing requires dimensions divisible by 32.

VQ-conditioned generation uses the LLaDA2 model to produce image VQ tokens from the prompt, which SigVQ embeds before diffusion. Do not provide an input image in VQ mode.

image = pipe(
    prompt="A quiet observatory above a sea of clouds at sunrise",
    generation_mode="vq",
    height=1024,
    width=1024,
    num_inference_steps=50,  # Use 4 for LLaDA-Image-Turbo.
    guidance_scale=5.0,  # Use 1.0 for few-step inference.
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]

Image editing requires a reference image:

from diffusers.utils import load_image

reference_image = load_image("/path/to/input.png")
image = pipe(
    prompt="Turn it into a watercolor painting",
    image=reference_image,
    generation_mode="editing",
    height=1024,
    width=1024,
    num_inference_steps=50,  # Use 4 for LLaDA-Image-Turbo.
    guidance_scale=5.0,  # Use 1.0 for few-step inference.
    generator=torch.Generator("cuda").manual_seed(43),
).images[0]

Acknowledgements

We thank the VeOmni project and its contributors for their valuable open-source work.

Citation

If you find LLaDA-Image useful for your research or applications, please consider citing our work.

@article{LLaDAImage,
title = {LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes},
author = {Chuyan Chen and Haoxing Chen and Kun Chen and Zhenglin Cheng and Long Cui and Ruishan Fang and Zhangxuan Gu and Zhicheng Huang and Zhenzhong Lan and Yuanting Lei and Haoquan Li and Jianguo Li and Rongchuan Li and Sidu Li and Tao Lin and Deyuan Liu and Jiacheng Liu and Lin Liu and Yuxuan Lou and Zhisheng Lu and Yuxin Ma and Shuheng Shen and Peng Sun and Chaoyang Wang and Hongjun Wang and Xiaomei Wang and Yongxin Wang and Chengzhang Wu and Hongru Wu and Jun Xie},
journal = {arXiv preprint arXiv:2609.03796},
year = {2026}
}

LLaDA-Image (inclusionAI/LLaDA-Image)

Searching Database…

这是什么?LLaDA-Image 是一个开源的 6B 参数统一模型家族,用于高质量文生图和指令引导的图像编辑,发布了 50 步的 Base 模型和 4 步蒸馏的 Turbo 模型。
这是现成的应用,还是需要我用代码运行的模型?它是 Hugging Face/ModelScope 上的一组模型检查点,配套基于 Diffusers 的 Python 推理代码——没有内置图形界面,不过社区有它的 ComfyUI 节点。
怎么让它跑起来?按照给定的 PyTorch/Transformers/Diffusers 版本搭建 Python 3.11 环境,下载 Base 或 Turbo 检查点,然后用文本提示运行 Diffusers 流水线(做图像编辑时可选加一张参考图)。
生成或编辑图像时有尺寸限制吗?有——文生图和 VQ 条件生成要求高和宽都能被 16 整除,图像编辑则要求尺寸能被 32 整除。
这是给普通用户还是机器学习从业者用的?它面向能直接运行 Python 和 Diffusers 流水线的研究人员和开发者,因为项目只提供检查点和推理代码,不是消费级应用。
Base 和 Turbo 模型有什么区别?Base 使用 50 个采样步骤,可获得最高保真度的生成和编辑;Turbo 是用 Twin-DMD 蒸馏训练的蒸馏模型,只需 2-4 步即可推理,速度快得多。
与其他模型相比 LLaDA-Image 表现如何?它在 Qwen-Image-Bench 基准上报告了最先进的总体得分——英文 53.53,中文 53.38。
我能在 ComfyUI 里使用 LLaDA-Image 吗?可以,根据项目的动态更新,社区贡献的 ComfyUI 支持已可用于 LLaDA-Image 和 LLaDA-Image-Turbo,还包括 FP8 版本。
训练代码可用吗?还没有——目前只发布了推理代码和模型权重;训练代码在开源路线图上标注为“即将推出”。
Size
14.6 MB
Stars
261
Updated
CommitSep 07
Age
1mo
Commits · 90 Days