arXiv:2601.10714cs.CVcs.GR2026-01

用扩散模型精准改图中物体的材质颜色,不改变其外观和场景。

Alterbute: Editing Intrinsic Attributes of Objects in Images

  • 基于身份参考图与文本提示,灵活编辑物体属性
  • 保留原背景和遮罩,仅改变内在属性,避免失真
  • 利用视觉命名实体实现可扩展的身份保持监督

我们提出 Alterbute,一种基于扩散模型的图像物体内在属性编辑方法。可调整物体的颜色、纹理、材质甚至形状,同时保持其感知身份和场景上下文。现有方法或依赖无法保持身份的无监督先验,或使用过于受限的监督导致内在变化不足。我们的方法:(i) 采用宽松训练目标,条件包括身份参考图、描述目标内在属性的文本提示,以及定义外在上下文的背景图和物体掩码;推理时复用原始背景和掩码,仅允许内在属性变化;(ii) 引入视觉命名实体(VNEs),如“保时捷911卡雷拉”,用于分组具有身份特征但内在属性可变的物体。通过视觉语言模型从大规模公开数据集自动提取VNE标签与属性描述,实现可扩展的身份保持监督。Alterbute 在保持身份的前提下显著优于现有方法。

原文摘要 · Abstract (English)

We introduce Alterbute, a diffusion-based method for editing an object's intrinsic attributes in an image. We allow changing color, texture, material, and even the shape of an object, while preserving its perceived identity and scene context. Existing approaches either rely on unsupervised priors that often fail to preserve identity or use overly restrictive supervision that prevents meaningful intrinsic variations. Our method relies on: (i) a relaxed training objective that allows the model to change both intrinsic and extrinsic attributes conditioned on an identity reference image, a textual prompt describing the target intrinsic attributes, and a background image and object mask defining the extrinsic context. At inference, we restrict extrinsic changes by reusing the original background and object mask, thereby ensuring that only the desired intrinsic attributes are altered; (ii) Visual Named Entities (VNEs) - fine-grained visual identity categories (e.g., ''Porsche 911 Carrera'') that group objects sharing identity-defining features while allowing variation in intrinsic attributes. We use a vision-language model to automatically extract VNE labels and intrinsic attribute descriptions from a large public image dataset, enabling scalable, identity-preserving supervision. Alterbute outperforms existing methods on identity-preserving object intrinsic attribute editing.

图像编辑扩散模型属性控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。