arXiv:2502.12690cs.NEcs.AI2025-02被引 2

同时优化数据配置与模型架构,提升嵌入式设备上的运行效率。

Fast Data Aware Neural Architecture Search via Supernet Accelerated Evaluation

  • 联合搜索输入数据参数与神经网络结构,实现端到端优化。
  • 在不同硬件和时间约束下,性能优于传统仅优化模型的方法。
  • 适用于资源受限场景,如医疗监测、工业维护等嵌入式应用。

微型机器学习(TinyML)有望通过在低功耗嵌入式系统上运行模型,推动医疗、环境监测和工业维护等领域的发展。然而,成功部署所需复杂优化仍阻碍其广泛应用。自动机器学习(AutoML)可将繁琐的优化流程简化为关键决策,其中硬件感知神经架构搜索(Hardware Aware NAS)已取得显著进展,生成了当前广泛使用的部分TinyML模型。但仅优化模型架构仍显不足,因TinyML系统需在极端资源限制下运行,输入数据配置(如分辨率或采样率)也极大影响整体效率。因此,真正最优的TinyML系统需联合调优数据与模型架构。尽管重要性突出,该“数据感知神经架构搜索”仍研究较少。为此,本文提出一种新的领先方法,并在新型的TinyML「Wake Vision」数据集上验证其有效性。实验表明,在不同时间和硬件约束下,数据感知架构搜索始终优于仅关注架构的方法,凸显数据感知优化对推进TinyML的关键作用。

原文摘要 · Abstract (English)

Tiny machine learning (TinyML) promises to revolutionize fields such as healthcare, environmental monitoring, and industrial maintenance by running machine learning models on low-power embedded systems. However, the complex optimizations required for successful TinyML deployment continue to impede its widespread adoption. A promising route to simplifying TinyML is through automatic machine learning (AutoML), which can distill elaborate optimization workflows into accessible key decisions. Notably, Hardware Aware Neural Architecture Searches - where a computer searches for an optimal TinyML model based on predictive performance and hardware metrics - have gained significant traction, producing some of today's most widely used TinyML models. Nevertheless, limiting optimization solely to neural network architectures can prove insufficient. Because TinyML systems must operate under extremely tight resource constraints, the choice of input data configuration, such as resolution or sampling rate, also profoundly impacts overall system efficiency. Achieving truly optimal TinyML systems thus requires jointly tuning both input data and model architecture. Despite its importance, this "Data Aware Neural Architecture Search" remains underexplored. To address this gap, we propose a new state-of-the-art Data Aware Neural Architecture Search technique and demonstrate its effectiveness on the novel TinyML ``Wake Vision'' dataset. Our experiments show that across varying time and hardware constraints, Data Aware Neural Architecture Search consistently discovers superior TinyML systems compared to purely architecture-focused methods, underscoring the critical role of data-aware optimization in advancing TinyML.

TinyML神经架构搜索数据感知嵌入式

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。