arXiv:2508.02313cs.LG2025-08被引 4

无需模型即可高效选样,边端训练能耗大幅降低

NMS: Efficient Edge DNN Training via Near-Memory Sampling on Manifolds

  • 提出无模型采样算法DE-SNE,避免深度网络带来的泛化偏差
  • 利用近内存计算,仅需少量图像访问主存,降低90%以上能耗
  • 适合资源受限的边端设备,尤其适用于隐私敏感场景

在边缘设备上训练深度神经网络(DNN)因能缓解领域适配与隐私问题而受到关注。然而,传统方法依赖大规模数据集,导致显著能耗,难以在边缘设备实现。现有数据集压缩方法如核代表集选择和数据蒸馏虽可降低成本,但存在两大缺陷:(1) 需依赖DNN评估样本质量,引入模型归纳偏置,引发严重泛化问题;(2) 所有训练图像需通过长距离PCB连接频繁访问DDR,造成巨大能量开销。为此,受人脑非线性流形驻定特性启发,本文提出首个无模型采样算法DE-SNE,解决泛化问题;并创新采用近内存计算实现DE-SNE,使仅少量图像需经长距离访问DDR,显著降低能耗。由此构建的NMS系统具备高效在位近内存采样能力,是首个兼具无模型、低能耗特性的边缘DNN训练方案。实验表明,NMS在准确率上优于当前最优方法DQ、DQAS与NeSSA。

原文摘要 · Abstract (English)

Training deep neural networks (DNNs) on edge devices has attracted increasing attention due to its potential to address challenges related to domain adaptation and privacy preservation. However, DNNs typically rely on large datasets for training, which results in substantial energy consumption, making the training in edge devices impractical. Some dataset compression methods have been proposed to solve this challenge. For instance, the coreset selection and dataset distillation reduce the training cost by selecting and generating representative samples respectively. Nevertheless, these methods have two significant defects: (1) The necessary of leveraging a DNN model to evaluate the quality of representative samples, which inevitably introduces inductive bias of DNN, resulting in a severe generalization issue; (2) All training images require multiple accesses to the DDR via long-distance PCB connections, leading to substantial energy overhead. To address these issues, inspired by the nonlinear manifold stationary of the human brain, we firstly propose a DNN-free sample-selecting algorithm, called DE-SNE, to improve the generalization issue. Secondly, we innovatively utilize the near-memory computing technique to implement DE-SNE, thus only a small fraction of images need to access the DDR via long-distance PCB. It significantly reduces DDR energy consumption. As a result, we build a novel expedited DNN training system with a more efficient in-place Near-Memory Sampling characteristic for edge devices, dubbed NMS. As far as we know, our NMS is the first DNN-free near-memory sampling technique that can effectively alleviate generalization issues and significantly reduce DDR energy caused by dataset access. The experimental results show that our NMS outperforms the current state-of-the-art (SOTA) approaches, namely DQ, DQAS, and NeSSA, in model accuracy.

边缘计算模型压缩近内存计算采样优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。