用事件相机精准时间戳直接估计运动,低延迟低功耗。
Event-based vision for egomotion estimation using precise event timing
- 直接处理事件流,不用转成图像帧
- 用脉冲网络编码局部光流,实现高精度运动估计
- 适合机器人等对功耗和实时性要求高的场景
自运动估计对自动驾驶和机器人导航至关重要,需兼顾精度与实时性。传统惯性传感器易受外部环境影响且长期使用会产生漂移。基于视觉的方法,特别是事件相机,仅在场景变化时采集数据,可显著降低功耗并提供高速、低延迟反馈。本文提出一种全事件域的自运动估计流水线,直接在事件域处理事件流,无需转换为帧图像,实现低延迟与低功耗。通过设计浅层脉冲神经网络,利用突触门控机制将精确事件时间转换为脉冲爆发,编码局部光流速度,并输出事件域的运动估计结果。在专用芯片上测试表明该方法具备优异的低延迟与低功耗潜力。仿真显示,大规模网络在事件相机任务中达到当前最优精度,是实时、低功耗机器人应用的有力解决方案。
原文摘要 · Abstract (English)
Egomotion estimation is crucial for applications such as autonomous navigation and robotics, where accurate and real-time motion tracking is required. However, traditional methods relying on inertial sensors are highly sensitive to external conditions, and suffer from drifts leading to large inaccuracies over long distances. Vision-based methods, particularly those utilising event-based vision sensors, provide an efficient alternative by capturing data only when changes are perceived in the scene. This approach minimises power consumption while delivering high-speed, low-latency feedback. In this work, we propose a fully event-based pipeline for egomotion estimation that processes the event stream directly within the event-based domain. This method eliminates the need for frame-based intermediaries, allowing for low-latency and energy-efficient motion estimation. We construct a shallow spiking neural network using a synaptic gating mechanism to convert precise event timing into bursts of spikes. These spikes encode local optical flow velocities, and the network provides an event-based readout of egomotion. We evaluate the network's performance on a dedicated chip, demonstrating strong potential for low-latency, low-power motion estimation. Additionally, simulations of larger networks show that the system achieves state-of-the-art accuracy in egomotion estimation tasks with event-based cameras, making it a promising solution for real-time, power-constrained robotics applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。