arXiv:2503.11199cs.CV2025-03

用归一化流提升神经场表达,实现车载场景下稀疏数据中的精准物体三维重建

NF-SLAM: Effective, Normalizing Flow-supported Neural Field representations for object-level visual SLAM in automotive applications

  • 引入归一化流增强神经隐式表示,仅用16维潜在码实现车辆3D形状高精度建模
  • 在稀疏噪声数据下性能显著优于传统方法,真实数据测试表现媲美含深度信息的方案
  • 适合自动驾驶中依赖视觉的实时物体级定位与建图,尤其适用于弱纹理或低采样场景

我们提出一种面向车载应用的纯视觉物体级SLAM框架,通过隐式符号距离函数表示3D形状。核心创新在于在标准神经表示基础上引入归一化流网络,使仅需16维潜在码的紧凑网络即可对道路车辆实现强表达能力。该架构在仅有稀疏噪声数据条件下表现出显著性能提升,已在合成数据上验证。模块嵌入基于双目视觉的后端,支持联合增量式形状优化。损失函数包含稀疏3D点SDF损失、稀疏渲染损失和基于语义掩码的轮廓一致性项。同时利用语义信息调控前端关键点提取密度。真实数据实验表明,该方法性能准确可靠,可与依赖直接深度读数的替代框架媲美。即使仅使用束调整获得的稀疏3D点,系统仍能稳定运行,并在仅依赖掩码一致性项时持续输出可靠结果。

原文摘要 · Abstract (English)

We propose a novel, vision-only object-level SLAM framework for automotive applications representing 3D shapes by implicit signed distance functions. Our key innovation consists of augmenting the standard neural representation by a normalizing flow network. As a result, achieving strong representation power on the specific class of road vehicles is made possible by compact networks with only 16-dimensional latent codes. Furthermore, the newly proposed architecture exhibits a significant performance improvement in the presence of only sparse and noisy data, which is demonstrated through comparative experiments on synthetic data. The module is embedded into the back-end of a stereo-vision based framework for joint, incremental shape optimization. The loss function is given by a combination of a sparse 3D point-based SDF loss, a sparse rendering loss, and a semantic mask-based silhouette-consistency term. We furthermore leverage semantic information to determine keypoint extraction density in the front-end. Finally, experimental results on real-world data reveal accurate and reliable performance comparable to alternative frameworks that make use of direct depth readings. The proposed method performs well with only sparse 3D points obtained from bundle adjustment, and eventually continues to deliver stable results even under exclusive use of the mask-consistency term.

视觉SLAM神经场自动驾驶3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。