arXiv:2512.09617cs.CV2025-12

仅用几张图就能让3D图像随意换材质风格

FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptation

  • 通过自注意力特征融合,实现多视角一致的材质风格迁移
  • 仅需少量样本即可适配预训练模型,生成多视角外观一致图像
  • 适合需要快速定制3D内容外观的创作者和设计师

多视角扩散模型已成为实现跨视角空间一致性内容创作的强大工具,无需显式几何或外观表示即可呈现丰富视觉真实感。然而,与网格或辐射场相比,现有模型在材质、纹理或风格等外观操控方面能力有限。本文提出一种轻量级外观迁移适配技术,通过融合输入图像中的物体身份与参考图像中的外观线索,生成反映目标材质、纹理或风格的多视角一致结果。该方法在生成时可显式指定外观参数,同时保持原始物体几何结构与视角连贯性。我们利用三个扩散去噪过程分别生成原图、参考图和目标图,并通过反向采样聚合来自物体与参考图像的层间自注意力特征,影响目标生成。本方法仅需少量训练样本即可为预训练多视角模型引入外观感知能力。实验表明,该方法为多视角生成提供了简单有效的多样化外观解决方案,推动隐式生成式3D表示的实际应用。

原文摘要 · Abstract (English)

Multiview diffusion models have rapidly emerged as a powerful tool for content creation with spatial consistency across viewpoints, offering rich visual realism without requiring explicit geometry and appearance representation. However, compared to meshes or radiance fields, existing multiview diffusion models offer limited appearance manipulation, particularly in terms of material, texture, or style. In this paper, we present a lightweight adaptation technique for appearance transfer in multiview diffusion models. Our method learns to combine object identity from an input image with appearance cues rendered in a separate reference image, producing multi-view-consistent output that reflects the desired materials, textures, or styles. This allows explicit specification of appearance parameters at generation time while preserving the underlying object geometry and view coherence. We leverage three diffusion denoising processes responsible for generating the original object, the reference, and the target images, and perform reverse sampling to aggregate a small subset of layer-wise self-attention features from the object and the reference to influence the target generation. Our method requires only a few training examples to introduce appearance awareness to pretrained multiview models. The experiments show that our method provides a simple yet effective way toward multiview generation with diverse appearance, advocating the adoption of implicit generative 3D representations in practice.

多视角生成材质迁移扩散模型轻量适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。