针对室内大空间无纹理区域的渲染模糊问题,提出新深度损失与正则化方法。
Improving Geometric Consistency for 360-Degree Neural Radiance Fields in Indoor Scenarios
- 设计专用深度损失函数,提升无纹理区域的几何一致性。
- 在两个360度合成场景上,相比标准损失,视觉质量显著改善。
- 适合需要高保真室内三维重建的应用,如虚拟现实与路径规划。
真实感渲染与新视角合成在人机交互任务中至关重要,从游戏到路径规划均有应用。神经辐射场(NeRFs)将场景建模为连续体素函数,实现卓越的渲染质量。然而,NeRF在大范围、低纹理区域常出现称为“浮点伪影”的云状模糊,降低场景真实感,尤其在墙壁、天花板、地板等无特征建筑表面的室内环境中更为明显。此前工作通过整合几何约束来改进,通常依赖于运动恢复结构或多视图立体生成的深度信息。但传统基于RGB特征对应的方法在无纹理区域难以准确估计深度,导致约束不可靠。这一挑战在360度“内向”视角中尤为突出,相邻图像间视觉重叠稀疏,进一步阻碍深度估计。为此,我们提出一种高效且鲁棒的密集深度先验计算方法,专为室内大范围低纹理建筑表面优化。引入新型深度损失函数,增强此类困难区域的渲染质量;同时,互补的深度块正则化进一步提升其他区域的深度一致性。在两个合成360度室内场景上使用Instant-NGP进行实验,结果表明,相比标准光度损失和均方误差深度监督,本方法在视觉保真度方面有明显提升。
原文摘要 · Abstract (English)
Photo-realistic rendering and novel view synthesis play a crucial role in human-computer interaction tasks, from gaming to path planning. Neural Radiance Fields (NeRFs) model scenes as continuous volumetric functions and achieve remarkable rendering quality. However, NeRFs often struggle in large, low-textured areas, producing cloudy artifacts known as ''floaters'' that reduce scene realism, especially in indoor environments with featureless architectural surfaces like walls, ceilings, and floors. To overcome this limitation, prior work has integrated geometric constraints into the NeRF pipeline, typically leveraging depth information derived from Structure from Motion or Multi-View Stereo. Yet, conventional RGB-feature correspondence methods face challenges in accurately estimating depth in textureless regions, leading to unreliable constraints. This challenge is further complicated in 360-degree ''inside-out'' views, where sparse visual overlap between adjacent images further hinders depth estimation. In order to address these issues, we propose an efficient and robust method for computing dense depth priors, specifically tailored for large low-textured architectural surfaces in indoor environments. We introduce a novel depth loss function to enhance rendering quality in these challenging, low-feature regions, while complementary depth-patch regularization further refines depth consistency across other areas. Experiments with Instant-NGP on two synthetic 360-degree indoor scenes demonstrate improved visual fidelity with our method compared to standard photometric loss and Mean Squared Error depth supervision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。