arXiv:2409.04829cs.LGcs.AI2024-09被引 1

NASH协同搜索低乘法模型与加速器,提升边缘设备部署效率。

NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models

  • 用零样本指标预筛选优质混合模型,避免训练耗时和梯度冲突。
  • 在CIFAR-100上实现2.14倍吞吐、2.01倍帧率,精度仅降0.25%。
  • 适合关注边缘AI硬件效率的开发者与研究者。

深度神经网络(DNN)的乘法计算开销阻碍其在边缘设备上的部署。尽管无乘法模型可提升硬件效率,但通常牺牲准确率。为此,乘法减少的混合模型应运而生,兼顾两者优势。现有方法如NASA和NASA-F利用神经架构搜索(NAS)构建此类模型,但在搜索效率与准确率上受限于高昂重训练成本或梯度冲突,且忽略加速器搜索带来的加速潜力。为此,本文提出NASH框架,针对NAS设计专用零样本指标,提前筛选有潜力的混合模型,提升搜索效率并缓解梯度冲突;针对加速器搜索,创新采用粗到精搜索策略简化流程。进一步将两层搜索无缝融合,获得最优模型-加速器配对。实验验证有效性:相较最先进基于乘法的系统,在CIFAR-100上实现↑2.14×吞吐、↑2.01×FPS,精度仅↓0.25%;在Tiny-ImageNet上实现↑1.40×吞吐、↑1.19×FPS,精度↑0.56%。代码已开源。

原文摘要 · Abstract (English)

The significant computational cost of multiplications hinders the deployment of deep neural networks (DNNs) on edge devices. While multiplication-free models offer enhanced hardware efficiency, they typically sacrifice accuracy. As a solution, multiplication-reduced hybrid models have emerged to combine the benefits of both approaches. Particularly, prior works, i.e., NASA and NASA-F, leverage Neural Architecture Search (NAS) to construct such hybrid models, enhancing hardware efficiency while maintaining accuracy. However, they either entail costly retraining or encounter gradient conflicts, limiting both search efficiency and accuracy. Additionally, they overlook the acceleration opportunity introduced by accelerator search, yielding sub-optimal hardware performance. To overcome these limitations, we propose NASH, a Neural architecture and Accelerator Search framework for multiplication-reduced Hybrid models. Specifically, as for NAS, we propose a tailored zero-shot metric to pre-identify promising hybrid models before training, enhancing search efficiency while alleviating gradient conflicts. Regarding accelerator search, we innovatively introduce coarse-to-fine search to streamline the search process. Furthermore, we seamlessly integrate these two levels of searches to unveil NASH, obtaining the optimal model and accelerator pairing. Experiments validate our effectiveness, e.g., when compared with the state-of-the-art multiplication-based system, we can achieve $\uparrow$$2.14\times$ throughput and $\uparrow$$2.01\times$ FPS with $\uparrow$$0.25\%$ accuracy on CIFAR-100, and $\uparrow$$1.40\times$ throughput and $\uparrow$$1.19\times$ FPS with $\uparrow$$0.56\%$ accuracy on Tiny-ImageNet. Codes are available at \url{https://github.com/xuyang527/NASH.}

神经架构搜索边缘计算加速器搜索低乘法模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。