HOMI实现事件相机的超低延迟端到端边缘智能,兼顾高精度与高速处理。
HOMI: Ultra-Fast EdgeAI platform for Event Cameras
- 基于事件相机与FPGA构建端到端平台,优化预处理流水线支持多种时间表征。
- 在DVS手势数据集上达94%准确率,低延迟模式下达到1000帧/秒吞吐量。
- 资源占用仅33%逻辑单元,适合部署复杂模型或多任务场景。
事件相机因其异步工作和稀疏事件输出,在边缘机器人应用中具有显著优势,适用于需要快速高效闭环控制的任务,如基于手势的人机交互。尽管潜力巨大,现有事件处理方案仍受限于缺乏完整端到端实现、延迟高以及未能充分利用事件数据稀疏性。本文提出HOMI,一个超低延迟的端到端边缘AI平台,包含Prophesee IMX636事件传感器芯片与Xilinx Zynq UltraScale+ MPSoC FPGA芯片,并集成自研AI加速器。我们开发了硬件优化的预处理流水线,支持恒定时间与恒定事件数两种模式下的直方图累积及线性与指数时间表面生成。该通用设计兼顾高精度与低延迟需求。作为用例,在高精度配置下,HOMI在DVS Gesture数据集上达到94%准确率;在低延迟配置下,吞吐量达1000 fps。硬件优化流水线保持紧凑内存占用,仅使用FPGA 33%的查找表资源,为后续降低延迟、模型并行、多任务部署或集成更复杂架构留出充足空间。
原文摘要 · Abstract (English)
Event cameras offer significant advantages for edge robotics applications due to their asynchronous operation and sparse, event-driven output, making them well-suited for tasks requiring fast and efficient closed-loop control, such as gesture-based human-robot interaction. Despite this potential, existing event processing solutions remain limited, often lacking complete end-to-end implementations, exhibiting high latency, and insufficiently exploiting event data sparsity. In this paper, we present HOMI, an ultra-low latency, end-to-end edge AI platform comprising a Prophesee IMX636 event sensor chip with an Xilinx Zynq UltraScale+MPSoC FPGA chip, deploying an in-house developed AI accelerator. We have developed hardware-optimized pre-processing pipelines supporting both constant-time and constant-event modes for histogram accumulation, linear and exponential time surfaces. Our general-purpose implementation caters to both accuracy-driven and low-latency applications. HOMI achieves 94% accuracy on the DVS Gesture dataset as a use case when configured for high accuracy operation and provides a throughput of 1000 fps for low-latency configuration. The hardware-optimised pipeline maintains a compact memory footprint and utilises only 33% of the available LUT resources on the FPGA, leaving ample headroom for further latency reduction, model parallelisation, multi-task deployments, or integration of more complex architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。