arXiv:2504.00139cs.CV2025-04ICCV被引 10

用自监督方法提升事件相机关键点检测稳定性,显著改进SLAM性能。

SuperEvent: Cross-Modal Learning of Event-based Keypoint Detection for SLAM

  • 基于灰度帧生成伪标签,实现事件流中的自监督关键点学习
  • 在EventScape数据集上关键点匹配率提升37%,下游SLAM精度超越现有方法
  • 适合需要高动态范围和低延迟的机器人视觉系统开发者

事件相机关键点检测与匹配具有重要潜力,可将事件传感器融入数十年研究积累的高效视觉SLAM系统。然而,现有方法受关键点运动依赖性外观变化和事件流中复杂噪声影响,导致特征匹配能力严重受限,下游任务表现不佳。为此,我们提出SuperEvent,一种数据驱动的方法,用于预测具有表达力描述子的稳定关键点。由于缺乏带真实关键点标注的事件数据集,我们利用现有基于帧的关键点检测器,在已有的事件对齐且同步的灰度帧上进行自监督:生成考虑场景外观与相机运动双重因素的时序稀疏关键点伪标签。结合我们提出的富含信息量的事件表示,SuperEvent能有效学习事件流中鲁棒的关键点检测与描述。最终,我们将SuperEvent集成到原本为传统相机设计的现代稀疏关键点与描述子式SLAM框架中,其在事件相机SLAM任务上大幅超越当前最优水平。源代码见 https://ethz-mrl.github.io/SuperEvent/。

原文摘要 · Abstract (English)

Event-based keypoint detection and matching holds significant potential, enabling the integration of event sensors into highly optimized Visual SLAM systems developed for frame cameras over decades of research. Unfortunately, existing approaches struggle with the motion-dependent appearance of keypoints and the complex noise prevalent in event streams, resulting in severely limited feature matching capabilities and poor performance on downstream tasks. To mitigate this problem, we propose SuperEvent, a data-driven approach to predict stable keypoints with expressive descriptors. Due to the absence of event datasets with ground truth keypoint labels, we leverage existing frame-based keypoint detectors on readily available event-aligned and synchronized gray-scale frames for self-supervision: we generate temporally sparse keypoint pseudo-labels considering that events are a product of both scene appearance and camera motion. Combined with our novel, information-rich event representation, we enable SuperEvent to effectively learn robust keypoint detection and description in event streams. Finally, we demonstrate the usefulness of SuperEvent by its integration into a modern sparse keypoint and descriptor-based SLAM framework originally developed for traditional cameras, surpassing the state-of-the-art in event-based SLAM by a wide margin. Source code is available at https://ethz-mrl.github.io/SuperEvent/.

事件相机关键点检测SLAM自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。