系统梳理模型量化在微控制器上的方法与应用,助力轻量级AI落地。
Neural Network Quantization for Microcontrollers: A Comprehensive Survey of Methods, Platforms, and Applications
- 从硬件视角分析量化方法与微控器性能的权衡。
- 覆盖主流MCU平台及支持低精度推理的专用核。
- 适合做边缘AI部署的工程师和研究者参考。
将量化神经网络(QNNs)部署在资源受限的边缘设备(如微控制器,MCUs)上,面临模型性能、计算复杂度与内存约束之间的根本性挑战。微型机器学习(TinyML)通过协同推进机器学习算法、硬件架构与软件优化技术,实现嵌入式系统上的深度神经网络推理。本综述从硬件角度出发,系统回顾了适用于MCU及超边缘设备的量化方法,重点分析模型性能与MCU硬件能力之间的关键权衡,包括内存层级、数值表示和加速器支持。综述还涵盖了当前主流的MCU硬件平台,包括基于ARM和RISC-V的设计,以及集成神经处理单元(NPUs)用于低精度推理的MCU,及其配套软件栈。此外,分析了量化模型在MCU上的实际部署案例,并归纳了其应用领域。最后,讨论了现存挑战,并展望了可扩展、节能且可持续的边缘AI部署未来方向。
原文摘要 · Abstract (English)
The deployment of Quantized Neural Networks (QNNs) on resource-constrained edge devices, such as microcontrollers (MCUs), introduces fundamental challenges in balancing model performance, computational complexity, and memory constraints. Tiny Machine Learning (TinyML) addresses these issues by jointly advancing machine learning algorithms, hardware architectures, and software optimization techniques to enable deep neural network inference on embedded systems. This survey provides a hardware-oriented perspective on neural network quantization, systematically reviewing the quantization methods most relevant to MCUs and extreme-edge devices. Particular emphasis is placed on the critical trade-offs between model performance and the capabilities of MCU-class hardware, including memory hierarchies, numerical representations, and accelerator support. The survey further reviews contemporary MCU hardware platforms, including ARM-based and RISC-V-based designs, as well as MCUs integrating neural processing units (NPUs) for low-precision inference, together with the supporting software stacks. In addition, we analyze real-world deployments of quantized models on MCUs and consolidate the application domains in which such systems are used. Finally, we discuss open challenges and outline promising future directions toward scalable, energy-efficient, and sustainable AI deployment on edge devices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。