针对嵌入式设备的神经网络搜索,实测运行时表现更准确。
CREST: Deployment-Realistic Hardware-in-the-Loop NAS for Embedded Sensing Systems

- 在真实硬件上做架构搜索,动态测量能量与延迟
- 相比传统方法,推理能耗降低41.7%,避免不可行部署
- 适合关注低功耗边缘设备部署的开发者
在低功耗微控制器(MCU)上部署神经网络需在内存、延迟和能耗约束下选择模型架构。现有流程常简化为使用静态代理指标(如浮点运算量或参数量)、以单一MCU为代表,以及连续推理测试而非实际部署感知调度。这些假设可能导致候选方案排序错误、遗漏不可行部署,并忽略调度依赖的能量消耗。本文提出CREST(跨平台运行时评估与搜索工具),一个面向MCU感知系统的部署真实硬件在环(HIL)神经架构搜索框架。CREST保持优化器、测量边界、日志和回放流程固定,同时将工作负载、模型族、目标后端、调度策略、量化方式和评分策略作为可配置维度,使部署影响可在同一可复用流程中分离实验。我们在三个Arm Cortex-M目标上对惯性里程计和音频分类任务进行评估。对于惯性里程计,基于实测能量的HIL搜索相较浮点运算量选择降低41.7%的每推理能耗,相较内存流量选择降低40.8%的能耗,且误差相近;而浮点运算量选择在内存受限目标上选择了不可行部署。在STM32 N657上,连续推理与周期调度搜索得出不同的帕累托前沿。对于音频分类,相同应用策略在不同板子上选择不同DS-CNN架构,跨板回放显著改变部署成本。总体表明,部署真实的MCU NAS必须联合优化模型架构、目标平台、运行时调度和部署策略,而非仅依赖静态代理指标或连续推理测量。
原文摘要 · Abstract (English)
Deploying neural networks on low-power microcontrollers (MCUs) requires selecting model architectures under tight memory, latency, and energy constraints. Existing workflows often simplify this process along one or more axes: static proxy costs such as FLOPs or parameters, treating one MCU as representative, and continuous-inference tests instead of deployed sensing schedules. These assumptions can mis-rank Pareto-front candidates, miss infeasible deployments, and obscure schedule-dependent energy. We present CREST (Cross-platform Runtime Evaluation and Search Tool), a deployment-realistic hardware-in-the-loop (HIL) neural architecture search (NAS) framework for MCU sensing systems. CREST keeps the optimizer, HIL measurement boundary, logging, and replay workflow fixed while exposing workload, model family, target backend, schedule, quantization, and scoring policy as configurable axes. This makes deployment effects experimentally separable within one reusable workflow. We evaluate CREST on inertial odometry and audio classification across three Arm Cortex-M targets. For inertial odometry, measured-energy HIL search reduces median per-inference energy by 41.7% versus FLOPs-based selection and 40.8% versus memory-traffic-based selection at similar error. FLOPs-based selection also chooses infeasible deployments on memory-constrained targets. On the STM32 N657 target, continuous-inference and duty-cycled searches produce different Pareto frontiers. For audio classification, the same application-level policy selects different DS-CNN architectures on different boards, and cross-board replay changes deployment cost substantially. Overall, CREST shows that deployment-realistic MCU NAS must jointly optimize model architecture, target platform, runtime schedule, and deployment policy rather than relying only on static proxy costs or continuous-inference measurements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。