arXiv:2503.09439cs.CV2025-03中稿 · IEEE TVCG被引 3

用AI给低精度3D模型加细节,保持纹理一致。

SuperCarver: Texture-Consistent 3D Geometry Super-Resolution for High-Fidelity Surface Detail Generation

  • 基于多视角渲染与法向量扩散模型,生成高保真表面细节。
  • 在真实纹理映射下,显著提升低质量网格的几何精度。
  • 适合修复旧资产或减少3D雕刻工作量。

传统高精度网格资产制作依赖专业3D艺术家的手动雕刻,过程繁琐。近年来,基于AI的3D内容生成在图像或文本提示下已能生成合理结构和复杂外观,但真实表面细节的合成仍具挑战,尤其是对已有低质量网格进行几何保真度增强,仍是开放问题。本文提出SuperCarver,一种3D几何超分辨率流程,可在给定粗糙网格上补充与纹理一致的表面细节。首先将原始带纹理网格从多视角渲染至图像域。为实现细节增强,构建一个在精心筛选的成对无细节与有细节法向量图数据集上微调的确定性先验引导法向量扩散模型。为从可能不完美的法向量预测中更新网格表面,设计了一种抗噪的可变形距离场逆渲染方案。实验表明,SuperCarver能生成由实际纹理外观驱动的真实且富有表现力的表面细节,是升级历史低质量3D资产和降低高多边形网格雕刻工作量的强大工具。

原文摘要 · Abstract (English)

Conventional production workflow of high-precision mesh assets necessitates a cumbersome and laborious process of manual sculpting by specialized 3D artists/modelers. The recent years have witnessed remarkable advances in AI-empowered 3D content creation for generating plausible structures and intricate appearances from images or text prompts. However, synthesizing realistic surface details still poses great challenges, and enhancing the geometry fidelity of existing lower-quality 3D meshes (instead of image/text-to-3D generation) remains an open problem. In this paper, we introduce SuperCarver, a 3D geometry super-resolution pipeline for supplementing texture-consistent surface details onto a given coarse mesh. We start by rendering the original textured mesh into the image domain from multiple viewpoints. To achieve detail boosting, we construct a deterministic prior-guided normal diffusion model, which is fine-tuned on a carefully curated dataset of paired detail-lacking and detail-rich normal map renderings. To update mesh surfaces from potentially imperfect normal map predictions, we design a noise-resistant inverse rendering scheme through deformable distance field. Experiments demonstrate that our SuperCarver is capable of generating realistic and expressive surface details depicted by the actual texture appearance, making it a powerful tool to both upgrade historical low-quality 3D assets and reduce the workload of sculpting high-poly meshes.

3D生成几何增强纹理一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。