arXiv:2508.11618cs.LG2025-08

用马尔可夫博弈建模多主体碳封存管理,兼顾安全约束与多方利益。

Optimal CO2 storage management considering safety constraints in multi-stakeholder multi-site CCS projects: a Markov game perspective

  • 将多主体碳封存问题转化为带安全约束的强化学习框架。
  • 通过代理模型降低高保真模拟计算成本,提升求解效率。
  • 适用于有多个利益相关方、地质相连的碳封存项目规划。

碳捕集与封存(CCS)项目通常涉及公共、私人和监管等多方利益相关者,各自目标与责任不同。由于项目规模大、周期长且地质上相互关联,各主体是否可独立优化其利益,或需形成合作联盟,成为有效规划的核心问题。碳封存站点常位于地质成熟的盆地,曾用于油气开采或废水处置,可利用现有基础设施,但这也使单一主体优化变得复杂且不现实。本文提出基于马尔可夫博弈的分析范式,量化不同联盟结构对各利益相关者目标的影响。将多主体多场地问题建模为带有安全约束的多智能体强化学习问题,使智能体在遵守安全规范前提下学习最优策略。以多个运营商在地质相连盆地中注入二氧化碳为例,采用基于嵌入-控制(E2C)框架的代理模型,缓解高保真模型重复仿真的计算负担。结果表明,该框架能有效实现多主体、多目标下的碳封存最优管理。

原文摘要 · Abstract (English)

Carbon capture and storage (CCS) projects typically involve a diverse array of stakeholders or players from public, private, and regulatory sectors, each with different objectives and responsibilities. Given the complexity, scale, and long-term nature of CCS operations, determining whether individual stakeholders can independently maximize their interests or whether collaborative coalition agreements are needed remains a central question for effective CCS project planning and management. CCS projects are often implemented in geologically connected sites, where shared geological features such as pressure space and reservoir pore capacity can lead to competitive behavior among stakeholders. Furthermore, CO2 storage sites are often located in geologically mature basins that previously served as sites for hydrocarbon extraction or wastewater disposal in order to leverage existing infrastructures, which makes unilateral optimization even more complicated and unrealistic. In this work, we propose a paradigm based on Markov games to quantitatively investigate how different coalition structures affect the goals of stakeholders. We frame this multi-stakeholder multi-site problem as a multi-agent reinforcement learning problem with safety constraints. Our approach enables agents to learn optimal strategies while compliant with safety regulations. We present an example where multiple operators are injecting CO2 into their respective project areas in a geologically connected basin. To address the high computational cost of repeated simulations of high-fidelity models, a previously developed surrogate model based on the Embed-to-Control (E2C) framework is employed. Our results demonstrate the effectiveness of the proposed framework in addressing optimal management of CO2 storage when multiple stakeholders with various objectives and goals are involved.

碳封存马尔可夫博弈多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。