事件相机实时重建图像,提升无人机在暗光下的感知能力。
An Event-based Fast Intensity Reconstruction Scheme for UAV Real-time Perception
- 单次积分结合优化衰减算法,高效重建亮度图。
- 实现100 FPS高帧率,计算负载低,适合机载部署。
- 在2-10lux极暗环境下仍有效,优于现有方法。
事件相机具有宽动态范围、高时间分辨率和抗运动模糊等优势,适用于复杂视觉条件。本文提出一种轻量级事件流强度重建方案——事件基单次积分(ESI),通过单次积分事件流并结合改进的衰减算法,实现高效实时重建。该方法可无缝迁移传统基于帧的视觉算法至事件相机场景,同时保留事件相机固有优势。实验表明,ESI在运行效率、重建质量与高帧率方面显著优于现有先进算法,支持高达100 FPS的实时重建。在无人机机载视觉追踪场景中,其低计算开销适配嵌入式平台。飞行测试显示,在2-10lux极端低光照条件下,ESI表现优异,而其他对比算法因帧率不足、图像质量差或实时性差而失效。
原文摘要 · Abstract (English)
Event cameras offer significant advantages, including a wide dynamic range, high temporal resolution, and immunity to motion blur, making them highly promising for addressing challenging visual conditions. Extracting and utilizing effective information from asynchronous event streams is essential for the onboard implementation of event cameras. In this paper, we propose a streamlined event-based intensity reconstruction scheme, event-based single integration (ESI), to address such implementation challenges. This method guarantees the portability of conventional frame-based vision methods to event-based scenarios and maintains the intrinsic advantages of event cameras. The ESI approach reconstructs intensity images by performing a single integration of the event streams combined with an enhanced decay algorithm. Such a method enables real-time intensity reconstruction at a high frame rate, typically 100 FPS. Furthermore, the relatively low computation load of ESI fits onboard implementation suitably, such as in UAV-based visual tracking scenarios. Extensive experiments have been conducted to evaluate the performance comparison of ESI and state-of-the-art algorithms. Compared to state-of-the-art algorithms, ESI demonstrates remarkable runtime efficiency improvements, superior reconstruction quality, and a high frame rate. As a result, ESI enhances UAV onboard perception significantly under visual adversary surroundings. In-flight tests, ESI demonstrates effective performance for UAV onboard visual tracking under extremely low illumination conditions(2-10lux), whereas other comparative algorithms fail due to insufficient frame rate, poor image quality, or limited real-time performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。