针对边缘设备训练,自动调优批量大小以提升吞吐量两倍。
TASTE: Throughput-Aware Batch Size Tuning for On-Device Edge Learning
- 用贝叶斯优化自动找最优批量大小,适配资源受限设备。
- 在树莓派4上实现吞吐量翻倍,且不降低模型准确率。
- 适合注重隐私的边缘智能场景,尤其持续学习任务。
随着隐私保护人工智能的发展,模型适应与个性化正转向在本地设备上进行学习,即利用用户本地数据直接在边缘硬件上微调深度学习模型。然而,这要求在资源受限设备上优化深度学习训练,以在保持预测精度的前提下最大化吞吐量。本文提出一种新颖的设备端模型训练技术,采用高效的基于贝叶斯优化的批量大小调优方法,以最大化硬件吞吐量。为评估该超参数对学习动态的影响,我们研究了两种不同范式:标准监督学习(SL)和在线持续学习(CL)。实验结果表明,在多种边缘设备上存在吞吐量上限,超过该阈值后增加批量大小不再带来性能提升。所提调优方法能识别出最优批量大小,结合梯度累积与线性学习率缩放,使树莓派4等平台的训练吞吐量最高提升2倍,且不损害模型准确率。此外,在持续学习范式中,最优批量大小有效维持了稳定性-可塑性平衡,显著缓解灾难性遗忘,同时最大化边缘硬件的计算效率。
原文摘要 · Abstract (English)
The rise of privacy-preserving artificial intelligence (AI) has shifted the focus of model adaptation and personalization towards on-device learning, where deep learning models are finetuned directly on edge hardware using local user data. However, this shift requires optimization of deep learning training on resource-constrained hardware to maximize throughput while maintaining predictive accuracy. This paper introduces a novel technique for on-device model training that incorporates an efficient Bayesian optimization-based batch size tuning approach to maximize hardware throughput. To evaluate the impact of this hyperparameter on the learning dynamics, we investigated two distinct paradigms: standard supervised learning (SL) and online continual learning (CL). Experimental results across various edge devices demonstrate a throughput ceiling, beyond which increasing the batch size yields no additional throughput gains. The proposed tuning approach identifies the optimal batch size, which, when combined with gradient accumulation and linear learning rate scaling, achieves up to a 2X increase in training throughput on platforms such as Raspberry Pi 4 compared to maximum batch sizes, without compromising model accuracy. Furthermore, in the CL paradigm, we demonstrate that optimal batch sizes maintain the stability-plasticity balance required for incremental learning, effectively mitigating catastrophic forgetting while maximizing computational efficiency on edge-hardware.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。