用因果模型+对抗双智能体,让自动防御更准更可信。
Explainable Autonomous Cyber Defense using Adversarial Multi-Agent Reinforcement Learning
- 构建因果图约束防御动作,只允许合理响应路径。
- 在真实数据集上将误报率从11.2%降到1.8%,精度达0.997。
- 通过策略分歧度提示人类介入,提升可解释性,适合安全运维人员。
自主智能体在攻防对抗中日益普及,但高级持续性威胁(APT)利用“就地取材”技术与目标遥测扰动,使监控系统产生歧义,导致自动化防御误判正常行为为恶意活动。现有单体或多智能体防御系统多依赖相关性信号,缺乏对响应动作的结构约束,且在模糊或对抗输入下易发生推理漂移。本文提出因果多智能体决策框架(C-MADF),结合因果建模与对抗双策略强化学习。首先从历史遥测数据学习结构因果模型(SCM),生成调查层级的有向无环图(DAG),定义合法响应转移路径;该路径被形式化为马尔可夫决策过程(MDP),其动作空间严格受限于因果一致转移。在此约束空间内,由对抗性蓝队(攻击优化)与红队(保守设计)双智能体协同决策。两策略分歧通过策略分歧得分量化,并通过人机协同界面中的可解释性透明度得分提示不确定状态下的升级。在真实世界CICIoT2023数据集上,C-MADF将误报率从文献中三个先进基线的11.2%、9.7%、8.4%降至1.8%,实现0.997精度、0.961召回率和0.979 F1分数。
原文摘要 · Abstract (English)
Autonomous agents are increasingly deployed in both offensive and defensive cyber operations, creating high-speed, closed-loop interactions in critical infrastructure environments. Advanced Persistent Threat (APT) actors exploit "Living off the Land" techniques and targeted telemetry perturbations to induce ambiguity in monitoring systems, causing automated defenses to overreact or misclassify benign behavior as malicious activity. Existing monolithic and multi-agent defense pipelines largely operate on correlation-based signals, lack structural constraints on response actions, and are vulnerable to reasoning drift under ambiguous or adversarial inputs. We present the Causal Multi-Agent Decision Framework (C-MADF), a structurally constrained architecture for autonomous cyber defense that integrates causal modeling with adversarial dual-policy control. C-MADF first learns a Structural Causal Model (SCM) from historical telemetry and compiles it into an investigation-level Directed Acyclic Graph (DAG) that defines admissible response transitions. This roadmap is formalized as a Markov Decision Process (MDP) whose action space is explicitly restricted to causally consistent transitions. Decision-making within this constrained space is performed by a dual-agent reinforcement learning system in which a threat-optimizing Blue-Team policy is counterbalanced by a conservatively shaped Red-Team policy. Inter-policy disagreement is quantified through a Policy Divergence Score and exposed via a human-in-the-loop interface equipped with an Explainability-Transparency Score that serves as an escalation signal under uncertainty. On the real-world CICIoT2023 dataset, C-MADF reduces the false-positive rate from 11.2%, 9.7%, and 8.4% in three cutting-edge literature baselines to 1.8%, while achieving 0.997 precision, 0.961 recall, and 0.979 F1-score.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。