用稀疏潜在场生成高保真3D纹理,突破传统映射限制
LaFiTe: A Generative Latent Field for 3D Native Texturing
- 构建3D生成式稀疏潜在颜色场,解耦纹理与网格拓扑
- 重建峰值信噪比超现有方法10 dB以上,纹理无缝且高保真
- 支持多风格、多几何体的纹理合成,适合数字内容创作
直接在3D表面上生成高保真、无缝的纹理(即3D原生纹理)仍是未解难题,现有方法受限于缺乏强大通用的潜在表示。本文提出LaFiTe框架,通过变分自编码器(VAE)将复杂表面外观编码为稀疏结构化潜在空间,并解码为连续颜色场,有效解耦纹理外观与网格拓扑及UV参数化。该表示在重建上超越现有方法超过10 dB PSNR,实现前所未有的保真度。在此基础上,采用条件修正流模型生成跨多样风格和几何体的高质量一致纹理。大量实验表明,LaFiTe不仅建立3D原生纹理新基准,还支持材质合成与纹理超分辨率等下游应用,推动下一代3D内容创作流程发展。
原文摘要 · Abstract (English)
Generating high-fidelity, seamless textures directly on 3D surfaces, what we term 3D-native texturing, remains a fundamental open challenge, with the potential to overcome long-standing limitations of UV-based and multi-view projection methods. However, existing native approaches are constrained by the absence of a powerful and versatile latent representation, which severely limits the fidelity and generality of their generated textures. We identify this representation gap as the principal barrier to further progress. We introduce LaFiTe, a framework that addresses this challenge by learning to generate textures as a 3D generative sparse latent color field. At its core, LaFiTe employs a variational autoencoder (VAE) to encode complex surface appearance into a sparse, structured latent space, which is subsequently decoded into a continuous color field. This representation achieves unprecedented fidelity, exceeding state-of-the-art methods by >10 dB PSNR in reconstruction, by effectively disentangling texture appearance from mesh topology and UV parameterization. Building upon this strong representation, a conditional rectified-flow model synthesizes high-quality, coherent textures across diverse styles and geometries. Extensive experiments demonstrate that LaFiTe not only sets a new benchmark for 3D-native texturing but also enables flexible downstream applications such as material synthesis and texture super-resolution, paving the way for the next generation of 3D content creation workflows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。