arXiv:2603.01839cs.CVcs.RO2026-03

用边缘感知提升事件相机与激光雷达定位的对齐精度

LEAR: Learning Edge-Aware Representations for Event-to-LiDAR Localization

  • 联合学习边缘结构与事件深度流,通过跨模态融合增强几何一致性
  • 在多个数据集上实现比现有方法更优的定位精度,显著提升鲁棒性
  • 适合做高动态、弱光环境下自动驾驶的传感器融合研究者

事件相机在高速运动和复杂光照下仍能提供高时间分辨率感知,适用于无GPS和视觉退化环境中的激光雷达点云定位。然而,将稀疏、异步的事件与密集激光雷达地图对齐本质上是病态问题,直接对应估计受模态差异影响严重。本文提出LEAR,一种双任务学习框架,联合估计边缘结构与密集事件-深度流场,以弥合传感模态差距。不同于将边缘作为事后辅助,LEAR通过交叉模态融合机制,将模态不变的几何线索注入运动表征,并采用迭代精化策略,在多步更新中强制两任务相互一致。这种协同作用生成具有边缘感知、深度对齐的流场,从而通过透视n点(PnP)求解器实现更鲁棒、准确的姿态恢复。在多个主流且具挑战性的数据集上,LEAR性能优于最佳基线方法。源代码、训练模型及演示视频已公开。

原文摘要 · Abstract (English)

Event cameras offer high-temporal-resolution sensing that remains reliable under high-speed motion and challenging lighting, making them promising for localization from LiDAR point clouds in GPS-denied and visually degraded environments. However, aligning sparse, asynchronous events with dense LiDAR maps is fundamentally ill-posed, as direct correspondence estimation suffers from modality gaps. We propose LEAR, a dual-task learning framework that jointly estimates edge structures and dense event-depth flow fields to bridge the sensing-modality divide. Instead of treating edges as a post-hoc aid, LEAR couples them with flow estimation through a cross-modal fusion mechanism that injects modality-invariant geometric cues into the motion representation, and an iterative refinement strategy that enforces mutual consistency between the two tasks over multiple update steps. This synergy produces edge-aware, depth-aligned flow fields that enable more robust and accurate pose recovery via Perspective-n-Point (PnP) solvers. On several popular and challenging datasets, LEAR achieves superior performance over the best prior method. The source code, trained models, and demo videos are made publicly available online.

事件相机激光雷达定位跨模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。