arXiv:2511.23051cs.CV2025-11NeurIPS被引 2

用深度感知分层纹理,让3D模型内外表面都无缝贴图

GOATex: Geometry & Occlusion-Aware Texturing

  • 基于多视角射线投射划分可见层级,按深度顺序处理内外表面
  • 分两阶段渐进式揭示内部区域,生成无接缝的高质量纹理
  • 无需微调扩散模型,支持内外分别提示,适合精细控制

我们提出GOATex,一种基于扩散模型的3D网格纹理生成方法,可为外部和内部表面生成高质量纹理。现有方法在可见区域表现良好,但缺乏处理遮挡内部的机制,导致纹理不完整且出现明显接缝。为此,我们引入基于“击中层级”(hit levels)的遮挡感知纹理框架,通过多视角射线投射量化网格面片的相对深度,将其划分为从外到内的有序可见层。随后采用两阶段可见性控制策略,逐步揭示具有结构一致性的内部区域,并使用预训练扩散模型对每层进行纹理生成。为实现跨层纹理的无缝融合,提出基于视点依赖可见性置信度的软UV空间混合方法。实验表明,GOATex在可见与遮挡表面均显著优于现有方法,生成无接缝、高保真的纹理。与以往工作不同,GOATex无需微调预训练扩散模型,支持对外部和内部区域独立提示,实现分层外观的细粒度控制。

原文摘要 · Abstract (English)

We present GOATex, a diffusion-based method for 3D mesh texturing that generates high-quality textures for both exterior and interior surfaces. While existing methods perform well on visible regions, they inherently lack mechanisms to handle occluded interiors, resulting in incomplete textures and visible seams. To address this, we introduce an occlusion-aware texturing framework based on the concept of hit levels, which quantify the relative depth of mesh faces via multi-view ray casting. This allows us to partition mesh faces into ordered visibility layers, from outermost to innermost. We then apply a two-stage visibility control strategy that progressively reveals interior regions with structural coherence, followed by texturing each layer using a pretrained diffusion model. To seamlessly merge textures obtained across layers, we propose a soft UV-space blending technique that weighs each texture's contribution based on view-dependent visibility confidence. Empirical results demonstrate that GOATex consistently outperforms existing methods, producing seamless, high-fidelity textures across both visible and occluded surfaces. Unlike prior works, GOATex operates entirely without costly fine-tuning of a pretrained diffusion model and allows separate prompting for exterior and interior mesh regions, enabling fine-grained control over layered appearances. For more qualitative results, please visit our project page: https://goatex3d.github.io/.

3D纹理扩散模型几何感知多视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。