用大模型引导多智能体强化学习,让电力交易更公平
Scalable Fairness Shaping with LLM-Guided Multi-Agent Reinforcement Learning for Peer-to-Peer Electricity Markets
- 大模型实时评估交易公平性并反馈到奖励函数
- 降低用户用电成本,提升本地电力交易比例
- 适合关注能源公平与去中心化市场的研究者
点对点(P2P)电力交易正成为现代配电系统的核心,但现有市场与强化学习设计多侧重效率或私利,缺乏实时公平性引导。为此,提出公平感知的多智能体强化学习框架FairMarket-RL,利用大语言模型(LLM)在部分可观测的连续双拍卖中生成公平性评分:电网公平性(FTG)、卖方间公平性(FBS)和定价公平性(FPP),通过可调系数融入奖励,使公平性指导与经济激励协同。环境模拟真实居民负荷与光伏出力,强制价格、物理可行性与策略更新稳定性约束。从小规模试点到大规模仿真社区及混合资产真实数据集的实验表明,该框架促进本地交易、降低用户购电成本,维持各参与方强公平性,并保障系统可行性。敏感性分析显示,在不同太阳能可用性和总需求下表现稳健,验证了其可扩展性,为兼具经济效率、社会公平与技术可行性的去中心化电力市场提供了路径。
原文摘要 · Abstract (English)
Peer-to-peer (P2P) energy trading is becoming central to modern distribution systems as rooftop PV and home energy management systems become pervasive, yet most existing market and reinforcement learning designs emphasize efficiency or private profit and offer little real-time guidance to ensure equitable outcomes under uncertainty. To address this gap, a fairness-aware multiagent reinforcement learning framework, FairMarket-RL, is proposed in which a large language model (LLM) critic shapes bidding policies within a continuous double auction under partial observability and discrete price-quantity actions. After each trading slot, the LLM returns normalized fairness scores Fairness-to-Grid (FTG), Fairness-Between-Sellers (FBS), and Fairness-of-Pricing (FPP) that are integrated into the reward via ramped coefficients and tunable scaling, so that fairness guidance complements, rather than overwhelms, economic incentives. The environment models realistic residential load and PV profiles and enforce hard constraints on prices, physical feasibility, and policy-update stability. Across a progression of experiments from a small pilot to a larger simulated community and a mixed-asset real-world dataset, the framework shifts exchanges toward local P2P trades, lowers consumer costs relative to grid-only procurement, sustains strong fairness across participants, and preserves utility viability. Sensitivity analyses over solar availability and aggregate demand further indicate robust performance, suggesting a scalable, LLM-guided pathway to decentralized electricity markets that are economically efficient, socially equitable, and technically sound.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。