arXiv:2410.16769cs.CV2024-10被引 15

在微控制器上实现实时小目标检测,精度不降且功耗极低。

DSORT-MCU: Detecting Small Objects in Real-Time on Microcontroller Units

  • 提出自适应分块方法,提升轻量模型在低功耗设备上的小目标检测能力。
  • F1分数最高提升225%,目标计数误差降低最多89%。
  • 适合边缘计算、物联网等资源受限场景的实时视觉应用。

轻量级神经网络的发展推动了计算机视觉在物联网诸多应用中的落地,如远程监控与过程自动化。然而,小目标检测这一关键问题在当前研究中仍被忽视,尤其在资源受限的嵌入式设备上。本文提出一种自适应分块方法,用于轻量且节能的对象检测网络(包括基于YOLO的模型和FOMO网络),可在不损失精度的前提下实现低功耗MCU上的检测。该方法在搭载内置机器学习加速器的新型RISC-V MCU上验证,实验表明其使FOMO和TinyissimoYOLO的F1分数分别提升最高225%,平均目标计数误差降低76%和89%。此外发现,使用软F1损失可隐式实现FOMO网络的非极大值抑制。在GreenWaves Technologies的RISC-V GAP9微控制器上部署测试,结果显示系统在高分辨率图像下实现58%–95% F1分数,推理延迟0.6–16.2毫秒,能耗31微焦–1.27毫焦,兼顾性能、速度与能效。

原文摘要 · Abstract (English)

Advances in lightweight neural networks have revolutionized computer vision in a broad range of IoT applications, encompassing remote monitoring and process automation. However, the detection of small objects, which is crucial for many of these applications, remains an underexplored area in current computer vision research, particularly for low-power embedded devices that host resource-constrained processors. To address said gap, this paper proposes an adaptive tiling method for lightweight and energy-efficient object detection networks, including YOLO-based models and the popular FOMO network. The proposed tiling enables object detection on low-power MCUs with no compromise on accuracy compared to large-scale detection models. The benefit of the proposed method is demonstrated by applying it to FOMO and TinyissimoYOLO networks on a novel RISC-V-based MCU with built-in ML accelerators. Extensive experimental results show that the proposed tiling method boosts the F1-score by up to 225% for both FOMO and TinyissimoYOLO networks while reducing the average object count error by up to 76% with FOMO and up to 89% for TinyissimoYOLO. Furthermore, the findings of this work indicate that using a soft F1 loss over the popular binary cross-entropy loss can serve as an implicit non-maximum suppression for the FOMO network. To evaluate the real-world performance, the networks are deployed on the RISC-V based GAP9 microcontroller from GreenWaves Technologies, showcasing the proposed method's ability to strike a balance between detection performance ($58% - 95%$ F1 score), low latency (0.6 ms/Inference - 16.2 ms/Inference}), and energy efficiency (31 uJ/Inference} - 1.27 mJ/Inference) while performing multiple predictions using high-resolution images on a MCU.

小目标检测边缘计算微控制器轻量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。