arXiv:2503.05112cs.RO2025-03被引 3

模仿心跳调节机制,让视觉里程计自适应触发,提升精度与效率。

THE-SEAN: A Heart Rate Variation-Inspired Temporally High-Order Event-Based Visual Odometry with Self-Supervised Spiking Event Accumulation Networks

  • 用类生物神经网络动态生成估计触发信号,响应运动变化。
  • 在多个数据集上实现13%精度提升、9%平滑度改善、38%触发效率提高。
  • 适合高速运动场景下的实时视觉定位,对事件相机系统有实用价值。

事件相机视觉里程计因高精度与实时性受到关注,其优势在于能主动累积信息以生成时间高阶的估计触发信号。现有方法多聚焦于估计后的事件表示优化,忽视了高效时间触发决策本身。本文提出一种新型事件相机视觉里程计THE-SEAN,首次实现根据运动与环境变化动态调整估计触发决策。受生物激素调节心率启发,设计了自监督脉冲神经网络,通过提取时间特征生成触发信号,并基于块匹配点数与费舍尔信息矩阵(FIM)迹值进行奖励反馈。在多个公开数据集上的实验表明,相比最先进方法,THE-SEAN平均提升13%估计精度、9%平滑度,触发效率提高38%。

原文摘要 · Abstract (English)

Event-based visual odometry has recently gained attention for its high accuracy and real-time performance in fast-motion systems. Unlike traditional synchronous estimators that rely on constant-frequency (zero-order) triggers, event-based visual odometry can actively accumulate information to generate temporally high-order estimation triggers. However, existing methods primarily focus on adaptive event representation after estimation triggers, neglecting the decision-making process for efficient temporal triggering itself. This oversight leads to the computational redundancy and noise accumulation. In this paper, we introduce a temporally high-order event-based visual odometry with spiking event accumulation networks (THE-SEAN). To the best of our knowledge, it is the first event-based visual odometry capable of dynamically adjusting its estimation trigger decision in response to motion and environmental changes. Inspired by biological systems that regulate hormone secretion to modulate heart rate, a self-supervised spiking neural network is designed to generate estimation triggers. This spiking network extracts temporal features to produce triggers, with rewards based on block matching points and Fisher information matrix (FIM) trace acquired from the estimator itself. Finally, THE-SEAN is evaluated across several open datasets, thereby demonstrating average improvements of 13\% in estimation accuracy, 9\% in smoothness, and 38\% in triggering efficiency compared to the state-of-the-art methods.

事件相机视觉里程计脉冲神经网络自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。