arXiv:2505.23253cs.CV2025-05被引 24

用3D函数直接生成高保真纹理,避免传统UV映射的拓扑问题。

UniTEX: Universal High Fidelity Generative Texturing for 3D Shapes

  • 在统一3D空间中用连续函数表示纹理,不依赖网格拓扑。
  • 通过Transformer模型直接从图像和几何输入预测纹理函数,生成高质量多视角纹理。
  • 结合LoRA微调大模型,高效利用2D先验提升纹理细节,适合自动化建模场景。

我们提出UniTEX,一种两阶段3D纹理生成框架,用于为3D资产创建高质量且一致的纹理。现有方法主要依赖将多视角图像重投影至3D形状后进行基于UV的修复,但存在拓扑模糊的问题。为此,我们提出绕过UV映射的局限,直接在统一3D函数空间中操作。首先,引入纹理函数(TFs)——一种连续的体素表示,仅根据表面距离将任意3D点映射为纹理值,与网格拓扑无关。其次,提出使用基于Transformer的大纹理模型(LTM),直接从图像和几何输入预测这些TFs。为进一步提升纹理质量并利用强大的2D先验,我们开发了一种基于LoRA的策略,高效适配大规模扩散Transformer(DiTs)以实现高质量多视角纹理合成。大量实验表明,UniTEX在视觉质量和纹理完整性上均优于现有方法,提供了一种通用且可扩展的自动化3D纹理生成方案。代码将在https://github.com/YixunLiang/UniTEX发布。

原文摘要 · Abstract (English)

We present UniTEX, a novel two-stage 3D texture generation framework to create high-quality, consistent textures for 3D assets. Existing approaches predominantly rely on UV-based inpainting to refine textures after reprojecting the generated multi-view images onto the 3D shapes, which introduces challenges related to topological ambiguity. To address this, we propose to bypass the limitations of UV mapping by operating directly in a unified 3D functional space. Specifically, we first propose that lifts texture generation into 3D space via Texture Functions (TFs)--a continuous, volumetric representation that maps any 3D point to a texture value based solely on surface proximity, independent of mesh topology. Then, we propose to predict these TFs directly from images and geometry inputs using a transformer-based Large Texturing Model (LTM). To further enhance texture quality and leverage powerful 2D priors, we develop an advanced LoRA-based strategy for efficiently adapting large-scale Diffusion Transformers (DiTs) for high-quality multi-view texture synthesis as our first stage. Extensive experiments demonstrate that UniTEX achieves superior visual quality and texture integrity compared to existing approaches, offering a generalizable and scalable solution for automated 3D texture generation. Code will available in: https://github.com/YixunLiang/UniTEX.

3D生成纹理生成扩散模型Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。