用3D高斯点云加速SDF-NeRF训练,提升机器人场景重建效率。
SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splats
- 在架构层融合3D高斯点云作为输入,直接引导SDF-NeRF训练。
- 收敛速度提升3倍,几何精度与渲染质量优于现有方法。
- 适合需要快速建模与实时推理的机器人导航系统。
符号距离辐射场(SDF-NeRF)是一种兼具逼真渲染与几何推理能力的环境表示方法,适用于碰撞避让等任务。然而其训练速度慢、收敛困难,限制了在实际机器人系统中的应用。本文提出SplatSDF,一种新型SDF-NeRF架构,通过3D高斯点云(3DGS)加速收敛。不同于以往需引入一致性损失的分立模型方法,SplatSDF在架构层面直接将3DGS作为输入嵌入训练过程,采用新颖的稀疏3DGS融合策略,在物体表面附近注入3DGS的神经嵌入,同时支持无3DGS的轻量级推理。实验表明,SplatSDF相比最优基线实现3倍更快的收敛速度,且在Chamfer Distance和峰值信噪比上超越当前先进SDF-NeRF方法;此外,梯度与海森矩阵计算加速3倍。这些改进有望推动SDF-NeRF在实际系统中的部署。
原文摘要 · Abstract (English)
Signed distance-radiance field (SDF-NeRF) is a promising environment representation that offers both photo-realistic rendering and geometric reasoning such as proximity queries for collision avoidance. However, the slow training speed and convergence of SDF-NeRF hinder their use in practical robotic systems. We propose SplatSDF, a novel SDF-NeRF architecture that accelerates convergence using 3D Gaussian splats (3DGS), which can be quickly pre-trained. Unlike prior approaches that introduce a consistency loss between separate 3DGS and SDF-NeRF models, SplatSDF directly fuses 3DGS at an architectural level by consuming it as an input to SDF-NeRF during training. This is achieved using a novel sparse 3DGS fusion strategy that injects neural embeddings of 3DGS into SDF-NeRF around the object surface, while also permitting inference without 3DGS for minimal operation. Experimental results show SplatSDF achieves 3X faster convergence to the same geometric accuracy than the best baseline, and outperforms state-of-the-art SDF-NeRF methods in terms of chamfer distance and peak signal to noise ratio, unlike consistency loss-based approaches that in fact provide limited gains. We also present computational techniques for accelerating gradient and Hessian steps by 3X. We expect these improvements will contribute to deploying SDF-NeRF on practical systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。