arXiv:2509.18118cs.LGcs.AR2025-09被引 1

将轻量级训练算法移植到低功耗RISC-V设备,实现本地高效学习。

Decentor-V: Lightweight ML Training on Low-Power RISC-V Edge Devices

  • 基于L-SGD算法,适配RISC-V架构的微控制器。
  • 8位量化使内存减少近4倍,训练速度提升2.2倍,精度损失极小。
  • 适合资源受限的边缘设备本地训练,提升隐私与离线能力。

现代物联网设备越来越多依赖本地机器学习处理数据,但多数平台缺乏图形处理器(GPU)或专用加速器,导致设备端训练几乎不可行,通常需依赖云端服务,引发隐私问题并依赖持续网络连接。联邦学习(FL)通过在设备上分布式协作训练解决此问题,但需要高效的优化算法。本文将轻量级随机梯度下降(L-SGD)扩展至基于RISC-V的微控制器,该架构尚缺乏对设备端训练的完善支持。在32位浮点运算下,对比了Arm与RISC-V平台性能,揭示了RISC-V微控制器缺乏浮点单元(FPU)的影响。为缓解此问题,提出8位量化版本的L-SGD,在保持精度几乎不变的前提下,内存使用降低约4倍,训练时间提速2.2倍。

原文摘要 · Abstract (English)

Modern IoT devices increasingly rely on machine learning solutions to process data locally. However, the lack of graphics processing units (GPUs) or dedicated accelerators on most platforms makes on-device training largely infeasible, often requiring cloud-based services to perform this task. This procedure often raises privacy-related concerns, and creates dependency on reliable and always-on connectivity. Federated Learning (FL) is a new trend that addresses these issues by enabling decentralized and collaborative training directly on devices, but it requires highly efficient optimization algorithms. L-SGD, a lightweight variant of stochastic gradient descent, has enabled neural network training on Arm Cortex-M Microcontroller Units (MCUs). This work extends L-SGD to RISC-V-based MCUs, an open and emerging architecture that still lacks robust support for on-device training. L-SGD was evaluated on both Arm and RISC-V platforms using 32-bit floating-point arithmetic, highlighting the performance impact of the absence of Floating-Point Units (FPUs) in RISC-V MCUs. To mitigate these limitations, we introduce an 8-bit quantized version of L-SGD for RISC-V, which achieves nearly 4x reduction in memory usage and a 2.2x speedup in training time, with negligible accuracy degradation.

边缘计算轻量化训练RISC-V量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。