用事件相机提升快速运动下的三维定位与建图稳定性
EvenNICER-SLAM: Event-based Neural Implicit Encoding SLAM
- 将事件相机数据引入NICE-SLAM,通过事件损失反向传播增强跟踪
- 在低频RGB-D输入下,性能仍优于原版NICE-SLAM
- 适合高速移动场景的鲁棒性SLAM系统研发者参考
密集视觉同步定位与建图(SLAM)的发展得益于神经隐式表示的兴起。以NICE-SLAM为代表的神经隐式编码SLAM在大规模室内场景中表现优异,但通常依赖高帧率的RGB-D图像流。当输入帧率不足或相机运动过快时,这类方法易崩溃或出现显著的跟踪与建图精度下降。本文提出EvenNICER-SLAM,通过引入事件相机解决该问题。事件相机响应亮度变化而非绝对亮度,具有高时间分辨率和低延迟特性。我们将在原NICE-SLAM流程中加入事件损失反向传播分支,以在低频RGB-D输入下提升相机跟踪能力。定量评估表明,引入高频事件图像输入后,EvenNICER-SLAM在降低RGB-D输入频率的情况下仍显著优于传统NICE-SLAM。结果表明,事件相机可有效提升密集SLAM系统在真实场景中应对快速相机运动的鲁棒性。
原文摘要 · Abstract (English)
The advancement of dense visual simultaneous localization and mapping (SLAM) has been greatly facilitated by the emergence of neural implicit representations. Neural implicit encoding SLAM, a typical example of which is NICE-SLAM, has recently demonstrated promising results in large-scale indoor scenes. However, these methods typically rely on temporally dense RGB-D image streams as input in order to function properly. When the input source does not support high frame rates or the camera movement is too fast, these methods often experience crashes or significant degradation in tracking and mapping accuracy. In this paper, we propose EvenNICER-SLAM, a novel approach that addresses this issue through the incorporation of event cameras. Event cameras are bio-inspired cameras that respond to intensity changes instead of absolute brightness. Specifically, we integrated an event loss backpropagation stream into the NICE-SLAM pipeline to enhance camera tracking with insufficient RGB-D input. We found through quantitative evaluation that EvenNICER-SLAM, with an inclusion of higher-frequency event image input, significantly outperforms NICE-SLAM with reduced RGB-D input frequency. Our results suggest the potential for event cameras to improve the robustness of dense SLAM systems against fast camera motion in real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。