arXiv:2602.13344cs.CVeess.IV2026-02被引 22

基于16亿样本的扩散模型,实现指令式图像编辑的顶尖性能。

FireRed-Image-Edit-1.0 Technical Report

  • 构建1.6亿样本数据集,分阶段清洗筛选保留超1亿高质量样本。
  • 提出多阶段训练与动态提示重索引,提升编辑精度与数据效率。
  • 发布涵盖15类任务的新基准REDEdit-Bench,支持未来研究。

我们提出FireRed-Image-Edit,一种基于扩散变压器的指令式图像编辑模型,通过系统优化数据构建、训练方法与评估设计,达到当前最优性能。构建包含16亿样本的训练语料库,涵盖9亿文本到图像和7亿图像编辑对,来自多样化来源。经过严格清洗、分层、自动标注及两阶段过滤,保留超过1亿高质量样本,生成与编辑样本平衡,确保强语义覆盖与指令对齐。采用多阶段训练流程,依次通过预训练、监督微调与强化学习逐步构建编辑能力。为提升数据效率,引入多条件感知桶采样器实现可变分辨率批量处理,以及动态提示重索引的随机指令对齐机制。为稳定优化并增强可控性,提出非对称梯度优化用于直接偏好优化(DPO)、布局感知OCR奖励的DiffusionNFT用于文本编辑,以及可微分一致性损失以保持身份一致性。进一步建立涵盖15类编辑任务的综合性基准REDEdit-Bench,包括新提出的美化与低级增强任务。在REDEdit-Bench及公开基准(ImgEdit和GEdit)上的大量实验表明,其性能优于或媲美开源与专有系统。为支持未来研究,代码、模型与基准套件已公开于https://github.com/FireRedTeam/FireRed-Image-Edit/。

原文摘要 · Abstract (English)

We present FireRed-Image-Edit, a diffusion transformer for instruction-based image editing that achieves state-of-the-art performance through systematic optimization of data curation, training methodology, and evaluation design. We construct a 1.6B-sample training corpus, comprising 900M text-to-image and 700M image editing pairs from diverse sources. After rigorous cleaning, stratification, auto-labeling, and two-stage filtering, we retain over 100M high-quality samples balanced between generation and editing, ensuring strong semantic coverage and instruction alignment. Our multi-stage training pipeline progressively builds editing capability via pre-training, supervised fine-tuning, and reinforcement learning. To improve data efficiency, we introduce a Multi-Condition Aware Bucket Sampler for variable-resolution batching and Stochastic Instruction Alignment with dynamic prompt re-indexing. To stabilize optimization and enhance controllability, we propose Asymmetric Gradient Optimization for DPO, DiffusionNFT with layout-aware OCR rewards for text editing, and a differentiable Consistency Loss for identity preservation. We further establish REDEdit-Bench, a comprehensive benchmark spanning 15 editing categories, including newly introduced beautification and low-level enhancement tasks. Extensive experiments on REDEdit-Bench and public benchmarks (ImgEdit and GEdit) demonstrate competitive or superior performance against both open-source and proprietary systems. To support future research, our code, models, and benchmark suite are publicly available at https://github.com/FireRedTeam/FireRed-Image-Edit/ .

图像编辑扩散模型指令对齐数据构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。