arXiv:2410.21615cs.CV2024-10ICRA被引 8

构建首个纽约城市级高分辨率事件相机定位数据集,助力机器人在复杂环境精准识别位置。

NYC-Event-VPR: A Large-Scale High-Resolution Event-Based Visual Place Recognition Dataset in Dense Urban Environments

  • 采用事件相机与RGB、GPS同步采集,捕捉真实城市动态场景。
  • 覆盖260公里、13小时以上数据,含昼夜、多天气及重复访问的多样条件。
  • 支持多框架评估,推动事件相机在机器人定位中的应用创新。

视觉位置识别(VPR)使自主机器人能够识别先前访问过的地点,对同时定位与地图构建(SLAM)等任务至关重要。传统VPR面临图像邻域精准检索及景观外观变化的挑战。事件相机(动态视觉传感器)凭借1MHz时钟、微秒级延迟和超过120dB的动态范围,具备高时间分辨率、低延迟和强光照适应性,能有效缓解运动模糊并提升复杂光照下的鲁棒性,是解决该问题的有前景方案。然而,由于事件相机的新颖性和成本较高,事件基VPR数据集稀缺,制约了其发展。为此,本文提出NYC-Event-VPR数据集,使用Prophesee IMX636 HD事件传感器(1280x720分辨率),搭配RGB相机与GPS模块,采集超过13小时、覆盖260公里的地理标记事件数据,涵盖纽约市多种光照、天气、昼夜及多次访问场景。此外,本文采用三种框架进行泛化性能评估,推动事件基VPR方法创新及其在机器人应用中的集成。

原文摘要 · Abstract (English)

Visual place recognition (VPR) enables autonomous robots to identify previously visited locations, which contributes to tasks like simultaneous localization and mapping (SLAM). VPR faces challenges such as accurate image neighbor retrieval and appearance change in scenery. Event cameras, also known as dynamic vision sensors, are a new sensor modality for VPR and offer a promising solution to the challenges with their unique attributes: high temporal resolution (1MHz clock), ultra-low latency (in μs), and high dynamic range (>120dB). These attributes make event cameras less susceptible to motion blur and more robust in variable lighting conditions, making them suitable for addressing VPR challenges. However, the scarcity of event-based VPR datasets, partly due to the novelty and cost of event cameras, hampers their adoption. To fill this data gap, our paper introduces the NYC-Event-VPR dataset to the robotics and computer vision communities, featuring the Prophesee IMX636 HD event sensor (1280x720 resolution), combined with RGB camera and GPS module. It encompasses over 13 hours of geotagged event data, spanning 260 kilometers across New York City, covering diverse lighting and weather conditions, day/night scenarios, and multiple visits to various locations. Furthermore, our paper employs three frameworks to conduct generalization performance assessments, promoting innovation in event-based VPR and its integration into robotics applications.

事件相机视觉定位城市导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。