用快速生成模型实现精准主体驱动图像创作。
EchoGen: Generating Visual Echoes in Any Scene via Feed-Forward Subject-Driven Auto-Regressive Model
- 采用双路注入策略分离主体语义与细节,提升可控性。
- 生成质量接近扩散模型,采样速度显著更快。
- 适合需要高效定制图像的创意设计与内容生产者。
主体驱动生成是创意AI中的关键任务;然而现有最先进方法存在显著权衡。它们要么依赖计算成本高昂的个性化微调,牺牲效率与零样本能力,要么采用基于扩散模型的前馈架构,固有地存在推理速度慢的问题。视觉自回归(VAR)模型以快速采样和强大生成质量著称,是解决这一矛盾的理想但未被充分探索的基础。为此,我们提出EchoGen,首个基于VAR模型的前馈式主体驱动生成框架。其核心设计为一种有效的双路注入策略,将主体的高层语义身份与低层细粒度细节解耦,从而增强可控性与保真度。我们使用语义编码器提取主体抽象身份,通过解耦交叉注意力引导整体构图;同时,内容编码器捕捉精细视觉细节,通过多模态注意力机制融入,确保纹理与结构的高保真保留。据我们所知,EchoGen是首个基于VAR模型的前馈式主体驱动框架。定量与定性结果验证了设计的有效性,表明EchoGen在主体保真度与图像质量上可媲美最先进的扩散模型方法,且采样延迟显著更低。代码与模型已公开于https://github.com/drx-code/EchoGen。
原文摘要 · Abstract (English)
Subject-driven generation is a critical task in creative AI; yet current state-of-the-art methods present a stark trade-off. They either rely on computationally expensive, per-subject fine-tuning, sacrificing efficiency and zero-shot capability, or employ feed-forward architectures built on diffusion models, which are inherently plagued by slow inference speeds. Visual Auto-Regressive (VAR) models are renowned for their rapid sampling speeds and strong generative quality, making them an ideal yet underexplored foundation for resolving this tension. To bridge this gap, we introduce EchoGen, a pioneering framework that empowers VAR models with subject-driven generation capabilities. The core design of EchoGen is an effective dual-path injection strategy that disentangles a subject's high-level semantic identity from its low-level fine-grained details, enabling enhanced controllability and fidelity. We employ a semantic encoder to extract the subject's abstract identity, which is injected through decoupled cross-attention to guide the overall composition. Concurrently, a content encoder captures intricate visual details, which are integrated via a multi-modal attention mechanism to ensure high-fidelity texture and structural preservation. To the best of our knowledge, EchoGen is the first feed-forward subject-driven framework built upon VAR models. Both quantitative and qualitative results substantiate our design, demonstrating that EchoGen achieves subject fidelity and image quality comparable to state-of-the-art diffusion-based methods with significantly lower sampling latency. The code and models are publicly available at https://github.com/drx-code/EchoGen.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。