arXiv:2603.00186cs.CRcs.AI2026-03

用多智能体强化学习实现金融系统实时防御,兼顾响应速度与业务影响。

RLShield: Practical Multi-Agent RL for Financial Cyber Defense with Attack-Surface MDPs and Real-Time Response Orchestration

  • 将攻击面建模为带状态与动作的马尔可夫决策过程,支持真实响应操作。
  • 在相同约束下,比静态规则和单智能体方法更快遏制攻击并减少暴露。
  • 考虑成本与干扰,适合金融场景中需协同决策的自动化安全团队。

金融系统持续运行,必须在遭受网络攻击时仍保持可靠。现代攻击跨越多个服务(应用、API、身份认证、支付通道),防守方需在时间压力下做出一系列动作。现有安全工具多依赖固定规则或静态预案,难以适应攻击者行为变化。强化学习(RL)适合序列决策,但多数金融领域研究聚焦交易,未考虑实际防御限制如动作成本、服务中断和跨资产协调。本文提出RLShield,一种面向金融网络安全防御的实用多智能体强化学习流程。我们将企业攻击面建模为马尔可夫决策过程(MDP),状态包含告警、资产暴露与服务健康度,动作代表具体响应操作(如隔离主机、轮换凭证、限流API、封禁账户或触发恢复)。RLShield在多个智能体(资产或服务组)间学习协同策略,并优化兼顾遏制速度、业务中断与响应成本的风险敏感目标。我们还引入博弈感知评估,测试策略对自适应攻击者的有效性,报告运营结果而非仅奖励。实验表明,RLShield在保持干扰在预设预算内的情况下,显著缩短了遏制时间并降低残留暴露,优于静态规则基线和单智能体强化学习,在相同约束下表现更优。结果表明,多智能体、成本感知的强化学习可为金融安全运维提供可部署的自动化响应层。

原文摘要 · Abstract (English)

Financial systems run nonstop and must stay reliable even during cyber incidents. Modern attacks move across many services (apps, APIs, identity, payment rails), so defenders must make a sequence of actions under time pressure. Most security tools still use fixed rules or static playbooks, which can be slow to adapt when the attacker changes behavior. Reinforcement learning (RL) is a good fit for sequential decisions, but much of the RL-in-finance literature targets trading and does not model real cyber response limits such as action cost, service disruption, and defender coordination across many assets. This paper proposes RLShield, a practical multi-agent RL pipeline for financial cyber defense. We model the enterprise attack surface as a Markov decision process (MDP) where states summarize alerts, asset exposure, and service health, and actions represent real response steps (e.g., isolate a host, rotate credentials, ratelimit an API, block an account, or trigger recovery). RLShield learns coordinated policies across multiple agents (assets or service groups) and optimizes a risk-sensitive objective that balances containment speed, business disruption, and response cost. We also include a game-aware evaluation that tests policies against adaptive attackers and reports operational outcomes, not only reward. Experiments show that RLShield reduces time-to-containment and residual exposure while keeping disruption within a fixed response budget, outperforming static rule baselines and single-agent RL under the same constraints. These results suggest that multi-agent, cost-aware RL can provide a deployable layer for automated response in financial security operations.

多智能体强化学习网络安全金融防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。