arXiv:2503.20066cs.ROcs.CV2025-03TPAMI

提出SDDF新模型,高效精准重建3D场景几何。

Learning Scene-Level Signed Directional Distance Function with Ellipsoidal Priors and Neural Residuals

  • 结合椭球先验与神经残差,实现方向感知的距离函数建模。
  • 预测速度比SDF和NeRF更快,几何一致性优于NeRF与高斯泼溅。
  • 适合需要高精度几何重建与高效渲染的3D视觉任务。

密集重建与可微渲染是3D视觉与计算机图形学中的基础且紧密关联的任务。近年来,神经隐式表示在重建保真度和可微性方面相比传统离散表示(如网格、点云、体素)展现出显著优势。然而,许多神经隐式模型(如神经辐射场NeRF和符号距离函数SDF网络)在渲染时效率较低,需沿每条相机射线多次查询。此外,NeRF与高斯泼溅方法虽能实现出色的光度重建,但通常需要精细监督才能获得准确的几何重建。为此,本文提出一种新型表示——符号方向距离函数(SDDF)。与SDF类似,SDDF以位置和视角方向为输入;与NeRF不同,它直接输出到表面的距离而非沿视图射线积分。因此,SDDF实现了精确的几何重建与高效的可微方向距离预测。为高效学习和预测场景级SDDF,我们构建了一种可微分的混合表示,融合显式的椭球先验与隐式的神经残差。该方法能有效处理障碍物边界处的距离不连续性,同时保持高密度、高保真距离预测能力。大量实验表明,SDDF在(i)SDDF预测精度上具有竞争力,(ii)预测速度超过SDF与NeRF,(iii)几何一致性优于NeRF与高斯泼溅。

原文摘要 · Abstract (English)

Dense reconstruction and differentiable rendering are fundamental tightly connected operations in 3D vision and computer graphics. Recent neural implicit representations demonstrate compelling advantages in reconstruction fidelity and differentiability over conventional discrete representations such as meshes, point clouds, and voxels. However, many neural implicit models, such as neural radiance fields (NeRF) and signed distance function (SDF) networks, are inefficient in rendering due to the need to perform multiple queries along each camera ray. Moreover, NeRF and Gaussian Splatting methods offer impressive photometric reconstruction but often require careful supervision to achieve accurate geometric reconstruction. To address these challenges, we propose a novel representation called signed directional distance function (SDDF). Unlike SDF and similar to NeRF, SDDF has a position and viewing direction as input. Like SDF and unlike NeRF, SDDF directly provides distance to the observed surface rather than integrating along the view ray. As a result, SDDF achieves accurate geometric reconstruction and efficient differentiable directional distance prediction. To learn and predict scene-level SDDF efficiently, we develop a differentiable hybrid representation that combines explicit ellipsoid priors and implicit neural residuals. This allows the model to handle distance discontinuities around obstacle boundaries effectively while preserving the ability for dense high-fidelity distance prediction. Through extensive evaluation against state-of-the-art representations, we show that SDDF achieves (i) competitive SDDF prediction accuracy, (ii) faster prediction speed than SDF and NeRF, and (iii) superior geometric consistency compared to NeRF and Gaussian Splatting.

3D重建神经隐式距离函数可微渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。