提出无线大模型低碳服务框架,降低推理碳排放。
AOLO: Analysis and Optimization For Low-Carbon Oriented Wireless Large Language Model Services
- 构建端到端碳足迹模型,覆盖计算与通信环节。
- 结合脉冲神经网络,实现碳排放减少18.77%。
- 适合关注绿色AI与可持续通信的开发者。
大语言模型(LLMs)的广泛应用带来显著的环境影响,尤其在推理阶段的高能耗与碳排放问题日益突出。现有研究多聚焦于计算层面优化,忽视了网络协同服务系统的碳足迹分析与优化。为此,本文提出AOLO框架,涵盖从计算推理到无线通信的全链路碳排放量化模型。针对整体碳足迹最小化目标,在用户体验与系统性能约束下,提出联合优化推理输出与发射功率的方案。通过采用脉冲神经网络(SNN)作为策略网络,设计基于SNN的深度强化学习算法(SDRL),实现高效低碳优化。大规模仿真表明,相比基准软演员-批评算法(SAC),SDRL可实现18.77%的碳排放降幅,验证了其在可持续大模型服务中的潜力。
原文摘要 · Abstract (English)
Recent advancements in large language models (LLMs) have led to their widespread adoption and large-scale deployment across various domains. However, their environmental impact, particularly during inference, has become a growing concern due to their substantial energy consumption and carbon footprint. Existing research has focused on inference computation alone, overlooking the analysis and optimization of carbon footprint in network-aided LLM service systems. To address this gap, we propose AOLO, a framework for analysis and optimization for low-carbon oriented wireless LLM services. AOLO introduces a comprehensive carbon footprint model that quantifies greenhouse gas emissions across the entire LLM service chain, including computational inference and wireless communication. Furthermore, we formulate an optimization problem aimed at minimizing the overall carbon footprint, which is solved through joint optimization of inference outputs and transmit power under quality-of-experience and system performance constraints. To achieve this joint optimization, we leverage the energy efficiency of spiking neural networks (SNNs) by adopting SNN as the actor network and propose a low-carbon-oriented optimization algorithm, i.e., SNN-based deep reinforcement learning (SDRL). Comprehensive simulations demonstrate that SDRL algorithm significantly reduces overall carbon footprint, achieving an 18.77% reduction compared to the benchmark soft actor-critic, highlighting its potential for enabling more sustainable LLM inference services.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。