arXiv:2603.05807cs.CV2026-03

事件相机实现高精度实时定位,通过全局局部特征融合提升识别效果。

EventGeM: Global-to-Local Feature Matching for Event-Based Visual Place Recognition

  • 用ViT提取全局特征,MaxViT检测局部关键点,结合RANSAC优化匹配
  • 在多个数据集和光照条件下超越现有方法,实现实时运行
  • 适合机器人导航、低功耗视觉任务,支持真实场景事件流部署

动态视觉传感器(事件相机)因其稀疏激活和高时间分辨率,在机器人与计算机视觉任务中日益流行。本文提出EventGeM,一种事件相机视觉位置识别的先进全局到局部特征融合框架。采用预训练的ViT-S/16骨干网络从事件直方图图像中提取全局特征图用于初始匹配预测;利用预训练的MaxViT骨干网络检测局部特征关键点,并通过基于2D单应性的RANSAC重排序进行优化。为进一步精炼匹配结果,引入预训练视觉基础模型进行深度估计,比较参考图像与查询图像之间的结构相似性。实验表明,EventGeM在多个基准数据集和光照条件下均优于当前最佳事件相机位置识别方法,且可在多种计算架构上实现全实时运行。我们还在真实机器人平台上验证了其使用事件流进行在线定位的能力。

原文摘要 · Abstract (English)

Dynamic vision sensors, also known as event cameras, are rapidly rising in popularity for robotic and computer vision tasks due to their sparse activation and high-temporal resolution. Event cameras have been used in robotic navigation and localization tasks where accurate positioning needs to occur on small and frequent time scales, or when energy concerns are paramount. In this work, we present EventGeM, a state-of-the-art global to local feature fusion pipeline for event-based Visual Place Recognition. We use a pre-trained vision transformer (ViT-S/16) backbone to obtain global feature patch for initial match predictions embeddings from event histogram images. Local feature keypoints were then detected using a pre-trained MaxViT backbone for 2D-homography based re-ranking with RANSAC. For additional re-ranking refinement, we subsequently used a pre-trained vision foundation model for depth estimation to compare structural similarity between references and queries. Our work performs state-of-the-art localization when compared to the best currently available event-based place recognition method across several benchmark datasets and lighting conditions all whilst being fully capable of running in real-time when deployed across a variety of compute architectures. We demonstrate the capability of EventGeM in a real-world deployment on a robotic platform for online localization using event streams directly from an event camera. Project page: https://eventgemvpr.github.io/

事件相机视觉定位特征匹配机器人导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。