实时分离事件相机中的自身运动与独立移动物体干扰
Motion-aware Event Suppression for Event Cameras
- 基于运动感知的事件抑制框架,实时联合分割与预测动态物体运动
- 在EVIMO基准上分割准确率提升67%,推理速度高出53%
- 适合需要高效事件处理的自动驾驶与机器人视觉系统
事件相机以微秒级延迟异步报告像素亮度变化,将动态视觉信息编码为稀疏事件流。然而,其极高的时间分辨率导致自身运动和独立移动物体(IMOs)的事件交织,现有方法难以高效解耦,依赖高成本的密集3D重建或有限的手动调参滤波器。本文提出首个运动感知事件抑制框架,可实时学习过滤由IMO和自身运动引发的事件。模型在当前事件流中联合分割IMO并预测其未来运动,实现动态事件的前瞻抑制。轻量级架构在消费级GPU上达到173 Hz推理速度,内存占用低于1 GB,相较于以往最先进方法,在挑战性EVIMO基准上分割准确率提升67%,推理速率提高53%。此外,该方法显著提升下游应用性能:通过令牌剪枝使视觉变换器推理加速83%,并改善基于事件的视觉里程计,绝对轨迹误差(ATE)降低13%。
原文摘要 · Abstract (English)
Event cameras report asynchronously per-pixel brightness changes with microsecond latency, encoding dynamic visual information as a sparse stream of events. However, their extreme temporal resolution floods perception systems with entangled events from ego-motion and independently moving objects (IMOs), which existing solutions fail to efficiently decouple, relying instead on prohibitive dense 3D reconstructions or limited hand-tuned filters. In this work, we introduce the first framework for Motion-aware Event Suppression, which learns to filter events triggered by IMOs and ego-motion in real time. Our model jointly segments IMOs in the current event stream while predicting their future motion, enabling anticipatory suppression of dynamic events before they occur. Our lightweight architecture achieves 173 Hz inference on consumer-grade GPUs with less than 1 GB of memory usage, outperforming previous state-of-the-art methods on the challenging EVIMO benchmark by 67\% in segmentation accuracy while operating at a 53\% higher inference rate. Moreover, we demonstrate significant benefits for downstream applications: our method accelerates Vision Transformer inference by 83\% via token pruning and improves event-based visual odometry accuracy, reducing Absolute Trajectory Error (ATE) by 13\%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。