arXiv:2503.10112cs.CV2025-03CVPR被引 8

让多物体图像编辑保持数量一致,效果更真实。

MoEdit: On Learning Quantity Perception for Multi-object Image Editing

  • 用特征补偿模块分离物体属性,避免混淆
  • 通过数量注意力机制保持物体数量一致
  • 适合需要精确控制物体数量的图像编辑场景

多物体图像广泛存在于增强现实、广告设计和医学影像等真实场景中,高效精准的编辑至关重要。随着稳定扩散(Stable Diffusion, SD)模型的出现,图像生成与编辑进入新阶段。然而,现有方法常忽视物体个体性与整体一致性,导致数量感知不一致,影响视觉效果。为此,我们提出无需辅助工具的 MoEdit 框架,支持风格迁移、物体重构和背景重构,在大量物体下仍能保持输入输出间的一致数量感知。核心创新包括:特征补偿(FeCom)模块,通过最小化物体间干扰,确保属性可区分;数量注意力(QTTN)模块,无需依赖外部工具即可有效控制并维持数量一致性。基于 SD 模型,MoEdit 可高质量定制保留或修改特定概念。实验表明,其在多物体图像编辑任务上达到当前最优(SOTA)性能。代码与数据将开源于 https://github.com/Tear-kitty/MoEdit。

原文摘要 · Abstract (English)

Multi-object images are prevalent in various real-world scenarios, including augmented reality, advertisement design, and medical imaging. Efficient and precise editing of these images is critical for these applications. With the advent of Stable Diffusion (SD), high-quality image generation and editing have entered a new era. However, existing methods often struggle to consider each object both individually and part of the whole image editing, both of which are crucial for ensuring consistent quantity perception, resulting in suboptimal perceptual performance. To address these challenges, we propose MoEdit, an auxiliary-free multi-object image editing framework. MoEdit facilitates high-quality multi-object image editing in terms of style transfer, object reinvention, and background regeneration, while ensuring consistent quantity perception between inputs and outputs, even with a large number of objects. To achieve this, we introduce the Feature Compensation (FeCom) module, which ensures the distinction and separability of each object attribute by minimizing the in-between interlacing. Additionally, we present the Quantity Attention (QTTN) module, which perceives and preserves quantity consistency by effective control in editing, without relying on auxiliary tools. By leveraging the SD model, MoEdit enables customized preservation and modification of specific concepts in inputs with high quality. Experimental results demonstrate that our MoEdit achieves State-Of-The-Art (SOTA) performance in multi-object image editing. Data and codes will be available at https://github.com/Tear-kitty/MoEdit.

多物体编辑数量感知扩散模型图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。