仅用一张参考图,就能精准迁移3D物体纹理并保持多视角一致性。
3DOT: Texture Transfer for 3DGS Objects from a Single Reference Image
- 分步生成+视角一致性梯度引导,确保多视图纹理连贯。
- 引入提示调优梯度机制,精准保留参考图的纹理特征。
- 适合需要高效定制3D纹理的设计师与内容创作者。
3D纹理替换可实现3D物体纹理的个性化定制,在3D编辑中提供高效多样的视觉变换。现有方法或依赖逐帧2D编辑(易导致视角不一致),或基于文本驱动(难保留参考图纹理特征)。为此,本文提出3DSwapping,融合三种新策略:1)渐进式生成,从单张参考图开始逐步扩散到邻近视角;2)视角一致性梯度引导,通过对比一致/不一致输出的特征差异来强化一致性;3)提示调优梯度引导,学习一个特殊标记以精确捕捉参考图与3D物体间的纹理差异,并指导编辑过程。实验表明,该方法在多视角下实现了更高保真度的纹理迁移,同时保持结构一致性。定性和定量评估验证了三类策略的有效性。代码将在录用后公开。
原文摘要 · Abstract (English)
3D texture swapping allows for the customization of 3D object textures, enabling efficient and versatile visual transformations in 3D editing. While no dedicated method exists, adapted 2D editing and text-driven 3D editing approaches can serve this purpose. However, 2D editing requires frame-by-frame manipulation, causing inconsistencies across views, while text-driven 3D editing struggles to preserve texture characteristics from reference images. To tackle these challenges, we introduce 3DSwapping, a 3D texture swapping method that integrates: 1) progressive generation, 2) view-consistency gradient guidance, and 3) prompt-tuned gradient guidance. To ensure view consistency, our progressive generation process starts by editing a single reference image and gradually propagates the edits to adjacent views. Our view-consistency gradient guidance further reinforces consistency by conditioning the generation model on feature differences between consistent and inconsistent outputs. To preserve texture characteristics, we introduce prompt-tuning-based gradient guidance, which learns a token that precisely captures the difference between the reference image and the 3D object. This token then guides the editing process, ensuring more consistent texture preservation across views. Overall, 3DSwapping integrates these novel strategies to achieve higher-fidelity texture transfer while preserving structural coherence across multiple viewpoints. Extensive qualitative and quantitative evaluations confirm that our three novel components enable convincing and effective 2D texture swapping for 3D objects. Code will be available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。