arXiv:2510.16332cs.CV2025-10被引 1

通过词元级增强实现多主体图像生成,解决身份混淆问题。

TokenAR: Multiple Subject Generation via Autoregressive Token-level enhancement

  • 设计词元级增强机制,分离身份与内容特征。
  • 在28K数据集上实现高保真度与身份一致性。
  • 适合需要多主体可控生成的研究者使用。

自回归模型在条件图像生成中表现卓越,但多参考图像生成面临身份混淆难题。本文提出TokenAR框架,通过三项词元级增强机制:1)词元索引嵌入对同一参考图像的词元进行聚类;2)指令词元注入作为额外视觉特征容器,注入细节和互补先验;3)身份-词元解耦策略显式引导词元表示独立表征各主体特征。该框架显著提升现有自回归方法在多参考图像生成中的能力,保持高质量背景重建的同时实现强身份一致性。为推动高质量、高多样性多主体生成研究,我们构建了InstructAR数据集,首个公开的大规模、多参考输入、开放域图像生成数据集,包含28,000个训练样本,每个样本含两个参考主体、相对提示及带掩码标注的背景。全面实验表明,本方法超越当前最优模型。代码与数据集将公开,详见https://github.com/lyrig/TokenAR。

原文摘要 · Abstract (English)

Autoregressive Model (AR) has shown remarkable success in conditional image generation. However, these approaches for multiple reference generation struggle with decoupling different reference identities. In this work, we propose the TokenAR framework, specifically focused on a simple but effective token-level enhancement mechanism to address reference identity confusion problem. Such token-level enhancement consists of three parts, 1). Token Index Embedding clusters the tokens index for better representing the same reference images; 2). Instruct Token Injection plays as a role of extra visual feature container to inject detailed and complementary priors for reference tokens; 3). The identity-token disentanglement strategy (ITD) explicitly guides the token representations toward independently representing the features of each identity.This token-enhancement framework significantly augments the capabilities of existing AR based methods in conditional image generation, enabling good identity consistency while preserving high quality background reconstruction. Driven by the goal of high-quality and high-diversity in multi-subject generation, we introduce the InstructAR Dataset, the first open-source, large-scale, multi-reference input, open domain image generation dataset that includes 28K training pairs, each example has two reference subjects, a relative prompt and a background with mask annotation, curated for multiple reference image generation training and evaluating. Comprehensive experiments validate that our approach surpasses current state-of-the-art models in multiple reference image generation task. The implementation code and datasets will be made publicly. Codes are available, see https://github.com/lyrig/TokenAR

图像生成多主体自回归词元增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。