分离几何与外观,实现高效高质多视角表面重建与渲染。
Disentangled Geometry and Appearance for Efficient Multi-View Surface Reconstruction and Rendering
- 分离几何与外观建模,避免深度网络依赖,提升学习效率。
- 训练仅需4.84分钟,渲染速度达0.023秒,性能领先。
- 支持网格编辑与纹理修改,适合实际应用开发。
本文针对基于神经渲染的多视角表面重建方法存在的缺陷——需额外提取网格且易产生网格伪影——提出一种高效解决方案。基于显式网格表示与可微光栅化框架,该方法在保持高效率的同时显著提升重建质量与适用性。核心在于提出解耦几何与外观的模型,不依赖深度网络,通过神经变形场引入全局几何上下文以增强几何学习,并设计新型正则化约束传递至神经着色器的几何特征,确保着色精度。对于外观,将视角无关的漫反射项分离并烘焙至网格顶点,进一步提升渲染效率。实验表明,该方法在训练时间(4.84分钟)和渲染速度(0.023秒)上达到当前最优水平,重建质量媲美顶尖方法。此外,其支持网格与纹理编辑等实用功能,展现出强泛化能力与应用潜力。
原文摘要 · Abstract (English)
This paper addresses the limitations of neural rendering-based multi-view surface reconstruction methods, which require an additional mesh extraction step that is inconvenient and would produce poor-quality surfaces with mesh aliasing, restricting downstream applications. Building on the explicit mesh representation and differentiable rasterization framework, this work proposes an efficient solution that preserves the high efficiency of this framework while significantly improving reconstruction quality and versatility. Specifically, we introduce a disentangled geometry and appearance model that does not rely on deep networks, enhancing learning and broadening applicability. A neural deformation field is constructed to incorporate global geometric context, enhancing geometry learning, while a novel regularization constrains geometric features passed to a neural shader to ensure its accuracy and boost shading. For appearance, a view-invariant diffuse term is separated and baked into mesh vertices, further improving rendering efficiency. Experimental results demonstrate that the proposed method achieves state-of-the-art training (4.84 minutes) and rendering (0.023 seconds) speeds, with reconstruction quality that is competitive with top-performing methods. Moreover, the method enables practical applications such as mesh and texture editing, showcasing its versatility and application potential. This combination of efficiency, competitive quality, and broad applicability makes our approach a valuable contribution to multi-view surface reconstruction and rendering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。