arXiv:2509.15097cs.LG2025-09被引 2

用FPGA加速神经网络分层训练,省电又快。

The Energy-Efficient Hierarchical Neural Network with Fast FPGA-Based Incremental Learning

  • 分两层:底层用FPGA解方程快速提取特征,上层增量学习持续更新。
  • 相比传统方法,计算成本大幅降低,性能几乎不变。
  • 适合边缘设备实时更新,节能型AI部署首选。

深度学习尤其是基础模型和大语言模型(LLMs)带来的计算与能耗压力日益严峻。传统基于梯度的训练方法效率低、耗能高。为此,我们提出一种混合框架,结合分层分解、FPGA直接求解方程与增量学习。将神经网络分为两层:下层通过FPGA单步方程求解实现高效并行特征提取;上层采用自适应增量学习,支持持续更新而无需全量重训。在此基础上,引入复合式LLM框架,将LLM模块分别部署于双层结构中:底层负责可复用的表征学习,能耗极低;上层通过节能更新实现自适应决策。该设计显著提升可扩展性,减少冗余计算,契合可持续人工智能理念。理论分析与架构洞察表明,本方法大幅降低计算开销且保持高模型性能,适用于边缘部署及能源受限环境下的实时适应。

原文摘要 · Abstract (English)

The rising computational and energy demands of deep learning, particularly in large-scale architectures such as foundation models and large language models (LLMs), pose significant challenges to sustainability. Traditional gradient-based training methods are inefficient, requiring numerous iterative updates and high power consumption. To address these limitations, we propose a hybrid framework that combines hierarchical decomposition with FPGA-based direct equation solving and incremental learning. Our method divides the neural network into two functional tiers: lower layers are optimized via single-step equation solving on FPGAs for efficient and parallelizable feature extraction, while higher layers employ adaptive incremental learning to support continual updates without full retraining. Building upon this foundation, we introduce the Compound LLM framework, which explicitly deploys LLM modules across both hierarchy levels. The lower-level LLM handles reusable representation learning with minimal energy overhead, while the upper-level LLM performs adaptive decision-making through energy-aware updates. This integrated design enhances scalability, reduces redundant computation, and aligns with the principles of sustainable AI. Theoretical analysis and architectural insights demonstrate that our method reduces computational costs significantly while preserving high model performance, making it well-suited for edge deployment and real-time adaptation in energy-constrained environments.

FPGA增量学习节能大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。