arXiv:2502.14968cs.LG2025-02

通过芯片功耗数据恢复模型权重,实现无访问权限的迁移学习。

P2W: From Power Traces to Weights Matrix -- An Unconventional Transfer Learning Approach

  • 从嵌入式芯片运行时的功耗信号中反推模型权重矩阵
  • 在数据有限时,新模型准确率最高提升3倍
  • 适合无法获取原始模型的边缘设备迁移学习场景

嵌入式系统上芯片(SoC)部署机器学习(ML)模型的快速发展,推动了医疗和自动驾驶等领域的变革。然而,在嵌入式设备上训练模型的主要挑战是缺乏高质量公开训练数据。迁移学习通过利用现有模型的知识作为新模型的起点来缓解此问题,但现有方法通常需要直接访问目标模型,这在部署于嵌入式SoC的模型中往往不可行。为此,本文提出一种新颖的非常规迁移学习方法:在不访问SoC内部模型的情况下,通过捕获其运行时的功耗测量值,将其转换为近似权重矩阵,并用于初始化新模型。该方法显著提升了新模型的学习效率和预测性能,尤其在数据稀缺场景下效果突出。实验表明,与传统方法使用相同有限数据相比,新模型准确率最高可提升3倍。

原文摘要 · Abstract (English)

The rapid growth of deploying machine learning (ML) models within embedded systems on a chip (SoCs) has led to transformative shifts in fields like healthcare and autonomous vehicles. One of the primary challenges for training such embedded ML models is the lack of publicly available high-quality training data. Transfer learning approaches address this challenge by utilizing the knowledge encapsulated in an existing ML model as a starting point for training a new ML model. However, existing transfer learning approaches require direct access to the existing model which is not always feasible, especially for ML models deployed on embedded SoCs. Therefore, in this paper, we introduce a novel unconventional transfer learning approach to train a new ML model by extracting and using weights from an existing ML model running on an embedded SoC without having access to the model within the SoC. Our approach captures power consumption measurements from the SoC while it is executing the ML model and translates them to an approximated weights matrix used to initialize the new ML model. This improves the learning efficiency and predictive performance of the new model, especially in scenarios with limited data available to train the model. Our novel approach can effectively increase the accuracy of the new ML model up to 3 times compared to classical training methods using the same amount of limited training data.

迁移学习边缘计算功耗分析模型逆向

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。