arXiv:2504.00663cs.LG2025-04

用10次真实测试,让NAS在无预存数据时自动适配设备找最优模型。

Searching on a Budget: HW-NAS with 10 Latency Probes

  • 先在虚拟设备上训练控制器,再部署到真实设备
  • 仅需10次高精度延迟测量,就能找到低延迟架构
  • 无需训练,适合资源受限的实时部署场景

现有硬件感知神经网络架构搜索(HW-NAS)方法通常依赖目标设备的精确延迟信息,或通过学习预测器获取。这类近似方法可能引入误差,影响高风险应用。本文提出一种两阶段HW-NAS框架:首先在合成设备分布上训练架构控制器,再直接部署至目标设备。测试时,控制器不依赖任何预先收集的数据,仅通过少量高保真延迟测量与目标设备交互。预训练阶段使用免训练的精度代理,避免全量训练开销。在HW-NATS-Bench上验证表明,该方法可泛化至未见设备,仅用少量真实延迟评估即实现上下文自适应,搜索出高效延迟架构。

原文摘要 · Abstract (English)

Existing hardware-aware NAS (HW-NAS) methods typically assume access to precise information circa the target device, either via analytical approximations of the post-compilation latency model, or through learned latency predictors. Such approximate approaches risk introducing estimation errors that may prove detrimental in risk-sensitive applications. In this work, we propose a two-stage HW-NAS framework, in which we first learn an architecture controller on a distribution of synthetic devices, and then directly deploy the controller on a target device. At test-time, our network controller deploys directly to the target device without relying on any pre-collected information, and only exploits direct interactions. In particular, the pre-training phase on synthetic devices enables the controller to design an architecture for the target device by interacting with it through a small number of high-fidelity latency measurements. To guarantee accessibility of our method, we only train our controller with training-free accuracy proxies, allowing us to scale the meta-training phase without incurring the overhead of full network training. We benchmark on HW-NATS-Bench, demonstrating that our method generalizes to unseen devices and searches for latency-efficient architectures by in-context adaptation using only a few real-world latency evaluations at test-time.

NAS硬件感知低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。