arXiv:2606.14130cs.LGcs.MA2026-06中稿 · EUMAS 2026, the 23…

让多个智能体在不依赖中央控制的情况下,安全协作完成任务。

Contract-Based Compositional Shielding for Safe Multi-Agent Reinforcement Learning

论文配图:Contract-Based Compositional Shielding for Safe Multi-Agent Reinforcement Learning
图 1 · 摘自论文原文
  • 用局部逻辑承诺构建合约,联合保证全局安全
  • 在6个环境15种算法下实现团队最优且安全的行为
  • 适合需要分布式安全控制的多智能体系统

在多智能体强化学习中,当单一智能体无法单独保障全局安全时,会出现安全协调问题:一个智能体的动作是否可接受,取决于其他智能体的行为。去中心化的防护机制可在运行时保证安全,但纯粹分解的权限限制会排除仅通过协作才安全的最优团队行为。本文研究在去中心化执行下,对训练与部署的智能体提供确定性安全保证,恢复无需集中控制的团队最优安全行为。各智能体共享一个全局安全规范ϕ(属于线性时序逻辑的安全部分,记为$$\mathsf{LTL}_{\mathsf{safe}}\u0024$),并从一组局部$$\mathsf{LTL}_{\mathsf{safe}}\u0024$义务组合中选择,其合取蕴含全局规范ϕ。每个智能体可依赖其他智能体的局部义务作为前提,因整个合约元组被同时验证,并可投影为本地动作掩码。学习阶段,非平稳多臂赌博机从局部$$\mathsf{LTL}_{\mathsf{safe}}\u0024$义务库中选择最优组合以最大化团队奖励,全程保持端到端安全。方法在6个环境和15种算法变体上进行了评估。

原文摘要 · Abstract (English)

Safe coordination problems surface in multi-agent reinforcement learning when global safety cannot be enforced by any agent unilaterally: the admissibility of one agent's action may depend on the dynamics of other agents. Decentralised shields can enforce safety at runtime, but purely factorised permissions often exclude optimal team behaviour that is safe only through coordination. We study deterministic safety guarantees for agents trained and deployed under decentralised execution, recovering team-optimal safe behaviour without centralised runtime control. Agents have a shared global specification $ϕ$ in the safety fragment of Linear Temporal Logic ($\mathsf{LTL}_{\mathsf{safe}}$ ), and select among tuples of local $\mathsf{LTL}_{\mathsf{safe}}$ obligations whose conjunction implies the global specification $ϕ$. Each agent may rely on the other agents' local obligations as assumptions because the whole contract tuple is certified simultaneously and allows projection into local action masks. At learning time, a non-stationary multi-armed bandit chooses among a library of local $\mathsf{LTL}_{\mathsf{safe}}$ obligations to select the tuple that optimises team reward, all without forgoing end-to-end safety. We evaluate the approach across 6 environments and 15 algorithmic variants.

多智能体安全强化学习形式化验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。