arXiv:2603.15106cs.AI2026-03中稿 · KDD被引 1

快速为微控制器定制高效神经网络,几分钟内完成设计与优化。

PrototypeNAS: Rapid Design of Deep Neural Networks for Microcontroller Units

  • 从单一大模型中分解并组合多种结构,支持剪枝与量化协同优化。
  • 使用多代理评估与超体积选择,实现精度与计算量的最优权衡。
  • 适合嵌入式开发人员快速部署轻量级模型于资源受限设备。

在不同硬件约束的边缘设备上实现高效的深度神经网络(DNN)推理是一项挑战,通常需为每种设备单独设计DNN架构。为避免大量人工工作,可采用神经架构搜索(NAS)。然而,现有多数NAS方法资源消耗大、耗时长,且未考虑目标系统的资源限制。为此,我们提出PrototypeNAS,一种零样本NAS方法,用于加速和自动化DNN在不同微控制器单元(MCUs)上的选择、压缩与专用化。我们设计了一种三步搜索策略,将DNN设计与专用化过程解耦于训练之外。首先,提出新型搜索空间,不仅可从单一大模型中裁剪出小型DNN,还可融合多种架构类型,并联合优化其剪枝与量化配置。其次,探索使用一组零样本代理替代单一代理进行优化。第三,提出使用超体积子集选择法,从多目标优化的帕累托前沿中提取最具代表性的模型,以平衡精度与浮点运算次数(FLOPs)。我们在12个不同数据集上评估了PrototypeNAS在图像分类、时间序列分类和目标检测三项任务中的有效性。结果表明,PrototypeNAS可在数分钟内识别出足够小、可直接部署于现成MCUs的DNN模型,且性能接近大型DNN模型。

原文摘要 · Abstract (English)

Enabling efficient deep neural network (DNN) inference on edge devices with different hardware constraints is a challenging task that typically requires DNN architectures to be specialized for each device separately. To avoid the huge manual effort, one can use neural architecture search (NAS). However, many existing NAS methods are resource-intensive and time-consuming because they require the training of many different DNNs from scratch. Furthermore, they do not take the resource constraints of the target system into account. To address these shortcomings, we propose PrototypeNAS, a zero-shot NAS method to accelerate and automate the selection, compression, and specialization of DNNs to different target microcontroller units (MCUs). We propose a novel three-step search method that decouples DNN design and specialization from DNN training for a given target platform. First, we present a novel search space that not only cuts out smaller DNNs from a single large architecture, but instead combines the structural optimization of multiple architecture types, as well as optimization of their pruning and quantization configurations. Second, we explore the use of an ensemble of zero-shot proxies during optimization instead of a single one. Third, we propose the use of Hypervolume subset selection to distill DNN architectures from the Pareto front of the multi-objective optimization that represent the most meaningful tradeoffs between accuracy and FLOPs. We evaluate the effectiveness of PrototypeNAS on 12 different datasets in three different tasks: image classification, time series classification, and object detection. Our results demonstrate that PrototypeNAS is able to identify DNN models within minutes that are small enough to be deployed on off-the-shelf MCUs and still achieve accuracies comparable to the performance of large DNN models.

神经网络边缘计算模型压缩NAS

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。