用硬件感知NAS优化早期退出网络的分支,更省能且更准
AEBNAS: Strengthening Exit Branches in Early-Exit Networks through Hardware-Aware Neural Architecture Search
- 基于硬件感知NAS动态设计退出分支的深度和结构
- 在CIFAR-10/100/SVHN上实现更高准确率,相同或更低的平均MAC数
- 适合资源受限设备部署,尤其关注能效与推理速度的场景
早期退出网络通过根据输入数据复杂度调整计算量,有效降低深度学习模型的整体能耗和延迟。其在架构中引入中间退出分支,对简单样本进行轻量级计算,特别适用于能源敏感的边缘设备。然而,设计此类网络需权衡效率与性能,过程耗时且复杂。近期研究采用神经架构搜索(NAS)优化退出位置与数量,以降低平均延迟并提升准确率。本文进一步考虑退出分支的深度与层类型对效率与准确率的影响,提出硬件感知的NAS方法,在优化过程中同时兼顾准确率与效率。在CIFAR-10、CIFAR-100和SVHN数据集上的实验表明,所提框架结合可变深度分支与自适应阈值调优,生成的早期退出网络在相同或更低平均MAC数下达到更高准确率,优于当前最优方法。
原文摘要 · Abstract (English)
Early-exit networks are effective solutions for reducing the overall energy consumption and latency of deep learning models by adjusting computation based on the complexity of input data. By incorporating intermediate exit branches into the architecture, they provide less computation for simpler samples, which is particularly beneficial for resource-constrained devices where energy consumption is crucial. However, designing early-exit networks is a challenging and time-consuming process due to the need to balance efficiency and performance. Recent works have utilized Neural Architecture Search (NAS) to design more efficient early-exit networks, aiming to reduce average latency while improving model accuracy by determining the best positions and number of exit branches in the architecture. Another important factor affecting the efficiency and accuracy of early-exit networks is the depth and types of layers in the exit branches. In this paper, we use hardware-aware NAS to strengthen exit branches, considering both accuracy and efficiency during optimization. Our performance evaluation on the CIFAR-10, CIFAR-100, and SVHN datasets demonstrates that our proposed framework, which considers varying depths and layers for exit branches along with adaptive threshold tuning, designs early-exit networks that achieve higher accuracy with the same or lower average number of MACs compared to the state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。