轻量级事件视觉自编码器,实现低功耗设备上高速高精度感知。
LiteEvent-AE: Lightweight Autoencoder for Event-Based Vision on Low-Latency Energy-Constrained Edge Devices

- 设计轻量卷积编码结构,适配事件流的异步特性与噪声
- 在SEFD/EBCD数据集上精度超YOLOv9,参数量少35.6倍
- 部署于树莓派/杰逊Nano,能耗比YOLOv9低726倍
事件视觉作为节能人工智能的新范式,提供稀疏、低延迟的视觉信号,减少冗余处理,支持可持续边缘计算。然而,事件流的异步性和噪声性给传统深度学习模型带来挑战,后者常因计算开销过大而不适合低功耗嵌入式平台。本文提出一种紧凑且可配置的事件驱动自编码器,高效压缩类脑数据的同时保留关键时空结构以支持下游推理。该架构结合轻量卷积编码、自适应事件阈值下的鲁棒性能及最小分类头,显著降低计算成本而不牺牲识别精度。在Smart Event Face Dataset (SEFD) 和 Event-Based Crossing Dataset (EBCD) 上的大量实验表明,所提框架在精度上优于或媲美YOLOv9,参数量减少高达35.6倍。为评估实际可持续性,模型部署于资源受限硬件:Raspberry Pi 4B 和 NVIDIA Jetson Nano。在Jetson Nano上实现44.8 FPS实时吞吐;在Raspberry Pi 4B CPU上,50%自编码器分类器的推理功耗仅为16.19 J,相比相同测试条件下YOLOv9低约726.3倍。结果证明紧凑事件驱动模型有望推动自主、移动与嵌入式计算环境中环保型低功耗高速感知系统的发展。
原文摘要 · Abstract (English)
Event-based vision has emerged as a promising paradigm for energy-aware artificial intelligence (AI), offering sparse, low-latency visual signals that reduce redundant data processing and support sustainable edge computing. However, the asynchronous and noise-prone nature of event streams creates challenges for conventional deep learning models, which are often too computationally intensive for low-power embedded platforms. This work presents a compact and configurable event-driven autoencoder that efficiently compresses neuromorphic data while preserving essential spatiotemporal structure for downstream inference. The architecture integrates lightweight convolutional encoding with robust performance under adaptive event thresholding and a minimal classifier head, enabling substantial reductions in computational cost without degrading recognition fidelity. Extensive evaluations on the Smart Event Face Dataset (SEFD) and Event-Based Crossing Dataset (EBCD) show that the proposed framework achieves competitive or superior accuracy compared to YOLOv9 while requiring up to 35.6$\times$ fewer parameters. To assess real-world sustainability, the model is deployed on resource-constrained hardware: a Raspberry Pi 4B and a NVIDIA Jetson Nano. On NVIDIA Jetson Nano, it delivers real-time throughput of 44.8 FPS. On a Raspberry Pi 4B CPU, the 50\% autoencoder classifier consumes 16.19 J for the evaluated inference workload, corresponding to approximately 726.3$\times$ lower energy consumption than YOLOv9 under the same evaluation protocol. These results demonstrate the potential of compact event-driven models to advance environmentally conscious, low-power AI systems for high-speed perception in autonomous, mobile, and embedded computing environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。