用微秒级事件数据实现快速定位,定位速度提升10倍以上。
Prepare for Warp Speed: Sub-millisecond Visual Place Recognition Using Event Cameras
- 只用毫秒内事件数据,通过二值化编码快速匹配位置。
- 在室内和室外数据集上,召回率比基线高5.9到11.3倍。
- 适合对实时性要求极高的自动驾驶与机器人导航场景。
视觉位置识别(VPR)是自主导航的基础任务,用于判断系统是否曾访问过某位置。现有基于事件相机的VPR方法依赖于密集表征,需数十至数百毫秒事件数据才能完成定位。本文提出Flash系统,首次实现亚毫秒级事件数据下的VPR。该方法利用活跃像素点作为强判别特征,通过高效二值帧编码并使用快速位运算计算相似度,再根据查询与参考帧的事件活跃度进行归一化。在室内QCR-Event-Dataset上,Flash的Recall@1较基线提升11.33倍;在8公里长的Brisbane-Event-VPR数据集上提升5.92倍。同时,通过新提出的定位延迟指标Time to Correct Match(TCM),验证了系统显著降低机器人无位置感知时间的能力。这是首个展示事件相机实现亚毫秒级VPR的工作。
原文摘要 · Abstract (English)
Visual Place Recognition (VPR) enables systems to identify previously visited locations within a map, a fundamental task for autonomous navigation. Prior works have developed VPR solutions using event cameras, which asynchronously measure per-pixel brightness changes with microsecond temporal resolution. However, these approaches rely on dense representations of the inherently sparse camera output and require tens to hundreds of milliseconds of event data to predict a place. Here, we break this paradigm with Flash, a lightweight VPR system that predicts places using sub-millisecond slices of event data. Our method is based on the observation that active pixel locations provide strong discriminative features for VPR. Flash encodes these active pixel locations using efficient binary frames and computes similarities via fast bitwise operations, which are then normalized based on the relative event activity in the query and reference frames. Flash improves Recall@1 for sub-millisecond VPR over existing baselines by 11.33x on the indoor QCR-Event-Dataset and 5.92x on the 8 km Brisbane-Event-VPR dataset. Moreover, our approach reduces the duration for which the robot must operate without awareness of its position, as evidenced by a localization latency metric we term Time to Correct Match (TCM). To the best of our knowledge, this is the first work to demonstrate sub-millisecond VPR using event cameras.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。