为移动智能体设计实时脉冲神经网络检测系统,兼顾速度与精度。
Real Time Scheduling Framework for Multi Object Detection via Spiking Neural Networks
- 通过可调步数和膜电位复用,实现灵活执行策略。
- 在Spiking-YOLO上验证,满足实时性且能耗显著降低。
- 适合对能效与安全有严苛要求的自动驾驶场景。
受自主移动代理(如无人车辆)能源限制影响,脉冲神经网络(SNN)正逐渐成为传统人工神经网络的更高效替代方案。这些代理需通过多摄像头进行多目标检测(MOD),以识别周边物体,同时确保两个核心目标:(R1) 实时性保障与 (R2) 高精度以确保安全。本文提出RT-SNN,首个面向SNN-based MOD系统在自主移动代理上同时实现R1与R2的系统设计。利用SNN通过多时间步迭代计算收集输入图像特征(即膜电位)的特性,RT-SNN提供可调时间步的多种执行选项,并提出膜电位复用新方法以支持R1。随后,引入均方绝对误差与膜置信度的新概念,量化不同执行策略对R2的影响。进一步地,构建新的调度框架,包含离线可调度性分析以保障R1,以及基于膜置信度的运行时调度算法以优化R2。我们将RT-SNN部署于基于ANN转SNN转换得到的Spiking-YOLO模型上,实验验证其在满足R1与R2需求的同时,实现了显著的能效提升。
原文摘要 · Abstract (English)
Given the energy constraints in autonomous mobile agents (AMAs), such as unmanned vehicles, spiking neural networks (SNNs) are increasingly favored as a more efficient alternative to traditional artificial neural networks. AMAs employ multi-object detection (MOD) from multiple cameras to identify nearby objects while ensuring two essential objectives, (R1) timing guarantee and (R2) high accuracy for safety. In this paper, we propose RT-SNN, the first system design, aiming at achieving R1 and R2 in SNN-based MOD systems on AMAs. Leveraging the characteristic that SNNs gather feature data of input image termed as membrane potential, through iterative computation over multiple timesteps, RT-SNN provides multiple execution options with adjustable timesteps and a novel method for reusing membrane potential to support R1. Then, it captures how these execution strategies influence R2 by introducing a novel notion of mean absolute error and membrane confidence. Further, RT-SNN develops a new scheduling framework consisting of offline schedulability analysis for R1 and a run-time scheduling algorithm for R2 using the notion of membrane confidence. We deployed RT-SNN to Spiking-YOLO, the SNN-based MOD model derived from ANN-to-SNN conversion, and our experimental evaluation confirms its effectiveness in meeting the R1 and R2 requirements while providing significant energy efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。