AdaScale让手机端模型自动适应环境变化,提升性能并省电。
AdaScale: Dynamic Context-aware DNN Scaling via Automated Adaptation Loop on Mobile Devices
- 通过自进化模型和压缩组合,动态调整网络结构以适应设备条件。
- 推理速度提升1.51至6.2倍,能耗降低4.69倍,准确率提高5.09%。
- 适合移动设备上需实时运行、资源受限的深度学习应用。
深度学习正在重塑移动端应用,越来越多的深度神经网络(DNN)被直接部署在移动与嵌入式设备上,以满足实时性与隐私需求。然而,移动设备的动态多样环境带来挑战:不同设备对延迟、精度、内存和能耗的要求各异,手动适配成本高。处理器状态变化、内存波动及后台进程竞争也频繁要求模型重新压缩以维持用户体验。为此,我们提出AdaScale——一个弹性推理框架,可自动适应动态环境。它利用自进化模型简化网络生成,结合多种压缩算子减少搜索空间并提升效果,并集成资源感知模块与性能分析器,构建自动化适应闭环。实验表明,AdaScale将准确率提升5.09%,训练开销降低66.89%,推理延迟缩短1.51至6.2倍,能耗下降4.69倍。
原文摘要 · Abstract (English)
Deep learning is reshaping mobile applications, with a growing trend of deploying deep neural networks (DNNs) directly to mobile and embedded devices to address real-time performance and privacy. To accommodate local resource limitations, techniques like weight compression, convolution decomposition, and specialized layer architectures have been developed. However, the \textit{dynamic} and \textit{diverse} deployment contexts of mobile devices pose significant challenges. Adapting deep models to meet varied device-specific requirements for latency, accuracy, memory, and energy is labor-intensive. Additionally, changing processor states, fluctuating memory availability, and competing processes frequently necessitate model re-compression to preserve user experience. To address these issues, we introduce AdaScale, an elastic inference framework that automates the adaptation of deep models to dynamic contexts. AdaScale leverages a self-evolutionary model to streamline network creation, employs diverse compression operator combinations to reduce the search space and improve outcomes, and integrates a resource availability awareness block and performance profilers to establish an automated adaptation loop. Our experiments demonstrate that AdaScale significantly enhances accuracy by 5.09%, reduces training overhead by 66.89%, speeds up inference latency by 1.51 to 6.2 times, and lowers energy costs by 4.69 times.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。