蚂蚁 inclusionAI 开源 LLaDA-Image 图像生成与编辑模型家族

蚂蚁 inclusionAI:HuggingFace 新模型·2026-09-03 16:07·18小时前
AI 导读

蚂蚁 inclusionAI 发布开源统一图像生成与编辑模型 LLaDA-Image 家族,包括 6B 参数、50 步采样的 Base 版和 2-4 步的 Turbo 蒸馏版,同时提供 BF16 与 FP8 checkpoint 及 Diffusers 推理代码。

蚂蚁 inclusionAI:HuggingFace 新模型
58AI 编辑部评分,满分 100

蚂蚁 inclusionAI 开源 LLaDA-Image 图像生成与编辑模型家族

2026-09-03 16:07· 18小时前
AI 导读

蚂蚁 inclusionAI 发布开源统一图像生成与编辑模型 LLaDA-Image 家族,包括 6B 参数、50 步采样的 Base 版和 2-4 步的 Turbo 蒸馏版,同时提供 BF16 与 FP8 checkpoint 及 Diffusers 推理代码。

LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes

Welcome to the official repository for LLaDA-Image, a unified model for high-quality image generation and editing.

Image 1: GitHubImage 2: arXiv

Image 3: LLaDA-Image Base on Hugging FaceImage 4: LLaDA-Image Base FP8 Version on Hugging FaceImage 5: LLaDA-Image Turbo on Hugging FaceImage 6: LLaDA-Image Turbo FP8 Version on Hugging Face

Image 7: LLaDA-Image realistic image generation showcasePhotorealistic image generation with natural lighting, lifelike details, and coherent scenes.

Image 8: LLaDA-Image text rendering and poster generation showcaseHigh-quality text rendering and creative poster generation across diverse visual styles.

Image 9: LLaDA-Image editing showcaseInstruction-guided image editing with faithful content preservation and precise visual changes.

Introduction

LLaDA-Image is a competitive 6B-parameter open-source unified image generation and editing model family. It includes LLaDA-Image, a 50-step Base model for high-quality text-to-image generation and instruction-guided editing, and LLaDA-Image-Turbo, a 4-step distilled model for fast generation and editing. Both variants support practical text-to-image generation, VQ-conditioned generation, reference-image editing, and Chinese--English text rendering.

This repository provides the checkpoints and Diffusers-based inference code for the LLaDA-Image model family.

News

  • 2026-09-04: We released the LLaDA-Image Base and Turbo checkpoints together with the inference code.

Highlights

  • Unified generation and editing. A single checkpoint supports text-to-image generation and reference-preserving, instruction-guided editing without a separate editing backbone.
  • Unified diffusion model. Both backone and DiT are diffusion models, trained in a unified framework.
  • Realistic image generation. LLaDA-Image produces high-quality images with rich visual details, natural lighting, and coherent compositions.
  • Image-only pre-training for visual-prior learning. The report establishes the visual prior through image-only pre-training and mid-training before introducing paired language supervision and joint generation--editing training.
  • Efficient inference with distilled model. LLaDA-Image-Turbo uses Twin-DMD distillation to deliver fast image generation and editing in only 2--4 sampling steps.
  • SOTA on Qwen-Image-Bench. LLaDA-Image achieves state-of-the-art overall scores of 53.53 in English and 53.38 in Chinese.

Image 10: Qwen-image bench evaluation

Model Zoo

Model Description Sampling steps Hugging Face (Checkpoints)
LLaDA-Image Base model for high-fidelity text-to-image generation and instruction-guided editing. 50 BF16:inclusionAI/LLaDA-Image FP8:inclusionAI/LLaDA-Image-FP8
LLaDA-Image-Turbo Distilled model for fast generation and editing. 4 BF16:inclusionAI/LLaDA-Image-Turbo FP8:inclusionAI/LLaDA-Image-Turbo-FP8

Opensource Plan

    • Inference code and model weights
    • Training code (coming soon)

Quick Start

1. Create an environment

The implementation has been used with Python 3.11, PyTorch 2.8, Transformers 4.57.6, and Diffusers 0.39.0.

git clone https://github.com/inclusionAI/LLaDA-Image.git
cd LLaDA-Image

conda create -n llada-image python=3.11 -y
conda activate llada-image

pip install -r requirements.txt

2. Run inference

The pipeline accepts a prompt and, for editing, an optional reference image.

LLaDA-Image (Base)

Use the Base checkpoint for high-fidelity generation and editing. Its recommended sampling configuration is 50 steps.

import torch

from src import LLaDAImagePipeline

# Load the pipeline. The model is downloaded from Hugging Face on first use.
pipe = LLaDAImagePipeline.from_pretrained(
    "inclusionAI/LLaDA-Image",
    torch_dtype=torch.bfloat16,
    device="cuda",
)

# Generate an image.
prompt = (
    "A cinematic photograph of a red fox standing in fresh snow, "
    "soft winter light, detailed fur, shallow depth of field"
)
negative_prompt = ""

image = pipe(
    prompt=prompt,
    negative_prompt=negative_prompt,
    generation_mode="text",
    height=1024,
    width=1024,
    num_inference_steps=50,
    guidance_scale=5.0,
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]

image.save("llada-image-base.png")

LLaDA-Image-Turbo

Use the Turbo checkpoint for fast generation and editing. Its recommended sampling configuration is 4 steps.

import torch

from src import LLaDAImagePipeline

# Load the distilled Turbo checkpoint.
pipe = LLaDAImagePipeline.from_pretrained(
    "inclusionAI/LLaDA-Image-Turbo",
    torch_dtype=torch.bfloat16,
    device="cuda",
)

prompt = "A quiet observatory above a sea of clouds at sunrise, golden light, wide-angle photograph"

image = pipe(
    prompt=prompt,
    generation_mode="text",
    height=1024,
    width=1024,
    num_inference_steps=4,
    guidance_scale=1.0,
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]

image.save("llada-image-turbo.png")

Generation modes

Both checkpoints support the following modes. Text and VQ-conditioned generation require height and width divisible by 16; image editing requires dimensions divisible by 32.

VQ-conditioned generation uses the LLaDA2 model to produce image VQ tokens from the prompt, which SigVQ embeds before diffusion. Do not provide an input image in VQ mode.

image = pipe(
    prompt="A quiet observatory above a sea of clouds at sunrise",
    generation_mode="vq",
    height=1024,
    width=1024,
    num_inference_steps=50,  # Use 4 for LLaDA-Image-Turbo.
    guidance_scale=5.0,  # Use 1.0 for few-step inference.
    generator=torch.Generator("cuda").manual_seed(42),
).images[0]

Image editing requires a reference image:

from diffusers.utils import load_image

reference_image = load_image("/path/to/input.png")
image = pipe(
    prompt="Turn it into a watercolor painting",
    image=reference_image,
    generation_mode="editing",
    height=1024,
    width=1024,
    num_inference_steps=50,  # Use 4 for LLaDA-Image-Turbo.
    guidance_scale=5.0,  # Use 1.0 for few-step inference.
    generator=torch.Generator("cuda").manual_seed(43),
).images[0]

Citation

If you find LLaDA-Image useful for your research or applications, please consider citing our work.

@article{LLaDAImage,
title = {LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes},
author = {Chuyan Chen and Haoxing Chen and Kun Chen and Zhenglin Cheng and Long Cui and Ruishan Fang and Zhangxuan Gu and Zhicheng Huang and Zhenzhong Lan and Yuanting Lei and Haoquan Li and Jianguo Li and Rongchuan Li and Sidu Li and Tao Lin and Deyuan Liu and Jiacheng Liu and Lin Liu and Yuxuan Lou and Zhisheng Lu and Yuxin Ma and Shuheng Shen and Peng Sun and Chaoyang Wang and Hongjun Wang and Xiaomei Wang and Yongxin Wang and Chengzhang Wu and Hongru Wu and Jun Xie},
journal = {arXiv preprint arXiv:2609.03796},
year = {2026}
}

7B params

Paper for inclusionAI/LLaDA-Image-Turbo-FP8

来源:蚂蚁 inclusionAI:HuggingFace 新模型· huggingface.co