用大模型实时评估交易公平性,让去中心化市场更公正
FairMarket-RL: LLM-Guided Fairness Shaping for Multi-Agent Reinforcement Learning in Peer-to-Peer Markets
- 大模型充当公平性裁判,动态生成奖励信号
- 买家需求满足率超90%,卖家利润差距显著缩小
- 适合研究能源共享、多智能体公平交易的学者
点对点(P2P)交易日益成为去中心化市场调控的关键机制,但现有方法往往缺乏稳健的公平性保障框架。本文提出FairMarket-RL,一种结合大语言模型(LLM)与强化学习(RL)的混合框架,使交易智能体具备公平意识。在模拟的多卖方-多买方微电网中,LLM作为实时公平性评判者,使用公平性-对买家(FTB)和公平性-卖家间(FBS)两个指标评估每轮交易。这些评分通过可调度的λ系数融入代理奖励,形成自适应的LLM引导奖励塑造闭环,取代脆弱的规则式公平约束。采用独立近端策略优化(IPPO)训练的代理实现了均衡结果:买家需求满足率超过90%,卖家利润率保持公平,且持续维持FTB与FBS得分高于0.80。训练过程表明,公平反馈提升了收敛速度,减少了买家短缺,并缩小了卖家间利润差异。该框架具备自然扩展性,其在含家庭产消者的大型电力配网中的应用验证了其实用价值。FairMarket-RL为去中心化能源系统中的自主交易提供了一种可扩展、以公平为核心驱动的解决方案。
原文摘要 · Abstract (English)
Peer-to-peer (P2P) trading is increasingly recognized as a key mechanism for decentralized market regulation, yet existing approaches often lack robust frameworks to ensure fairness. This paper presents FairMarket-RL, a novel hybrid framework that combines Large Language Models (LLMs) with Reinforcement Learning (RL) to enable fairness-aware trading agents. In a simulated P2P microgrid with multiple sellers and buyers, the LLM acts as a real-time fairness critic, evaluating each trading episode using two metrics: Fairness-To-Buyer (FTB) and Fairness-Between-Sellers (FBS). These fairness scores are integrated into agent rewards through scheduled λ-coefficients, forming an adaptive LLM-guided reward shaping loop that replaces brittle, rule-based fairness constraints. Agents are trained using Independent Proximal Policy Optimization (IPPO) and achieve equitable outcomes, fulfilling over 90% of buyer demand, maintaining fair seller margins, and consistently reaching FTB and FBS scores above 0.80. The training process demonstrates that fairness feedback improves convergence, reduces buyer shortfalls, and narrows profit disparities between sellers. With its language-based critic, the framework scales naturally, and its extension to a large power distribution system with household prosumers illustrates its practical applicability. FairMarket-RL thus offers a scalable, equity-driven solution for autonomous trading in decentralized energy systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。