arXiv:2506.10612cs.CVcs.AI2025-06ICLR

让文字生成的物体纹理在多视角下保持一致,解决传统方法的渐变问题。

TexTailor: Customized Text-aligned Texturing via Effective Resampling

  • 通过重采样机制反复融合各视角已有纹理信息
  • 在Objaverse和ShapeNet car数据集上显著提升纹理一致性
  • 适配几何形状动态调整相机位,适合3D内容生成研究者

我们提出TexTailor,一种从文本描述生成一致物体纹理的新方法。现有文本到纹理合成方法使用深度感知扩散模型,逐视角生成图像并合成纹理,但因(1)扩散过程中对已生成纹理整合不足,(2)纹理生成的自回归特性,导致各视角间纹理属性逐渐偏移。此外,固定相机位置未考虑物体几何,限制了多视角纹理信息的有效利用,最终影响整体一致性。TexTailor通过(1)在扩散过程中引入重采样机制,反复融合此前生成的纹理信息;(2)基于重采样纹理微调深度感知扩散模型来解决该问题。实验发现,仅用少量训练图像会削弱模型生成高保真对齐图像的能力,因此提出性能保留损失加以缓解。同时,通过根据物体几何自适应调整相机位置,进一步提升视图一致性。在Objaverse子集与ShapeNet car数据集上的实验表明,TexTailor优于当前最优方法。代码已开源:https://github.com/Adios42/Textailor。

原文摘要 · Abstract (English)

We present TexTailor, a novel method for generating consistent object textures from textual descriptions. Existing text-to-texture synthesis approaches utilize depth-aware diffusion models to progressively generate images and synthesize textures across predefined multiple viewpoints. However, these approaches lead to a gradual shift in texture properties across viewpoints due to (1) insufficient integration of previously synthesized textures at each viewpoint during the diffusion process and (2) the autoregressive nature of the texture synthesis process. Moreover, the predefined selection of camera positions, which does not account for the object's geometry, limits the effective use of texture information synthesized from different viewpoints, ultimately degrading overall texture consistency. In TexTailor, we address these issues by (1) applying a resampling scheme that repeatedly integrates information from previously synthesized textures within the diffusion process, and (2) fine-tuning a depth-aware diffusion model on these resampled textures. During this process, we observed that using only a few training images restricts the model's original ability to generate high-fidelity images aligned with the conditioning, and therefore propose an performance preservation loss to mitigate this issue. Additionally, we improve the synthesis of view-consistent textures by adaptively adjusting camera positions based on the object's geometry. Experiments on a subset of the Objaverse dataset and the ShapeNet car dataset demonstrate that TexTailor outperforms state-of-the-art methods in synthesizing view-consistent textures. The source code for TexTailor is available at https://github.com/Adios42/Textailor

文本生成纹理扩散模型3D生成多视角一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。