用深度特征替换ORB,显著提升SLAM在复杂环境下的精度。
SuperPoint-SLAM3: Augmenting ORB-SLAM3 with Deep Features, Adaptive NMS, and Learning-Based Loop Closure
- 用自监督SuperPoint替代手工特征,增强关键点鲁棒性
- 在KITTI上平移误差从4.15%降到0.34%,旋转误差减半
- 保持实时运行,适合需要高精度的机器人导航场景
视觉同步定位与建图(SLAM)需在极端视角、尺度和光照变化下保持精度。广泛使用的ORB-SLAM3因依赖手工设计的ORB关键点,在此类条件下表现不佳。本文提出SuperPoint-SLAM3,作为即插即用的升级方案:(i) 用自监督的SuperPoint检测器-描述符替代ORB;(ii) 通过自适应非极大值抑制(ANMS)实现空间均匀的关键点分布;(iii) 集成轻量级NetVLAD地名识别模块以实现学习型回环检测。在KITTI里程计基准测试中,平均平移误差从4.15%降至0.34%,平均旋转误差从0.0027度/米降至0.0010度/米。在EuRoC MAV数据集上,所有序列误差大致减半(如V2_03:1.58% → 0.79%)。结果表明,融合现代深度特征与学习型回环模块可显著提升ORB-SLAM3的精度,同时维持其实时性。代码、预训练权重及复现脚本见https://github.com/shahram95/SuperPointSLAM3。
原文摘要 · Abstract (English)
Visual simultaneous localization and mapping (SLAM) must remain accurate under extreme viewpoint, scale and illumination variations. The widely adopted ORB-SLAM3 falters in these regimes because it relies on hand-crafted ORB keypoints. We introduce SuperPoint-SLAM3, a drop-in upgrade that (i) replaces ORB with the self-supervised SuperPoint detector--descriptor, (ii) enforces spatially uniform keypoints via adaptive non-maximal suppression (ANMS), and (iii) integrates a lightweight NetVLAD place-recognition head for learning-based loop closure. On the KITTI Odometry benchmark SuperPoint-SLAM3 reduces mean translational error from 4.15% to 0.34% and mean rotational error from 0.0027 deg/m to 0.0010 deg/m. On the EuRoC MAV dataset it roughly halves both errors across every sequence (e.g., V2\_03: 1.58% -> 0.79%). These gains confirm that fusing modern deep features with a learned loop-closure module markedly improves ORB-SLAM3 accuracy while preserving its real-time operation. Implementation, pretrained weights and reproducibility scripts are available at https://github.com/shahram95/SuperPointSLAM3.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。