arXiv:2607.18101cs.LGcs.AR2026-07中稿 · KDD

用边缘加速器实现设备端高效模型更新,省电又快。

Empowering On-Device Model Adaptation with an Edge AI Inference Accelerator

论文配图:Empowering On-Device Model Adaptation with an Edge AI Inference Accelerator
图 1 · 摘自论文原文
  • 用边缘芯片跑预训练主干网络,只在主机微调分类头。
  • 相比树莓派5,训练速度最快提升15.4倍,能耗更低。
  • 适合资源受限设备做频繁个性化更新,如手机、IoT终端。

设备端模型适应对实现资源受限硬件上的终身个性化至关重要,但计算、功耗和内存限制使得现代深度神经网络的端到端反向传播不可行。本文提出一种异构适应流程,将商用边缘AI推理加速器Hailo-8L重新用于设备训练中的冻结主干特征提取。计算图被分割:预训练主干量化为INT8并在加速器上运行,仅轻量级FP32分类头在主机CPU上微调,实现频繁、节能的现场更新,多数权重保持不变。在多个架构与数据集上,该流程相比树莓派5 CPU基线,壁钟训练时间最多提升15.4倍,特定场景下吞吐量具竞争力,且持续降低每样本能耗。结果显示,训练后量化恢复对保持加速器生成特征质量、缓解量化敏感架构的精度损失至关重要。整体证明了利用面向推理的边缘加速器实现高效设备端适应的可行性。代码已开源:https://github.com/MatPiech/accelerator-training。

原文摘要 · Abstract (English)

On-device model adaptation is essential to enable lifelong personalization on resource-constrained hardware, but compute, power, and memory limitations of such devices make end-to-end backpropagation impractical for modern deep neural networks. This work proposes a heterogeneous adaptation pipeline that repurposes a commercial edge AI inference accelerator, Hailo-8L, for frozen-backbone feature extraction during on-device training. The computational graph is partitioned so that the pre-trained backbone is quantized to INT8 and run on the accelerator, while only a lightweight FP32 classification head is fine-tuned on the host CPU, enabling frequent, energy-efficient in-field updates with most weights remaining fixed. Across multiple architectures and datasets, this pipeline achieves up to 15.4x faster wall-clock training time compared to a Raspberry Pi 5 CPU baseline, offers competitive throughput in favorable settings, and consistently reduces energy per sample. Post-training quantization restoration is shown to be crucial for preserving the quality of accelerator-generated features and mitigating accuracy loss in quantization-sensitive architectures. Overall, the results demonstrate a practical approach to efficient on-device adaptation using inference-oriented edge accelerators. The implementation is available at https://github.com/MatPiech/accelerator-training.

边缘计算模型适配能效优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。