提出分层对抗鲁棒的多智能体强化学习框架,提升工业物联网安全防御能力。
Hierarchical Adversarially-Resilient Multi-Agent Reinforcement Learning for Cyber-Physical Systems Security
- 分层结构:局部智能体负责子系统防护,全局协调器统筹整体防御策略。
- 对抗训练使系统检测准确率显著提升,响应时间大幅缩短。
- 适合研究工业物联网安全与智能防御系统的学者和工程师。
工业物联网在制造、能源分配及自动驾驶等关键领域发挥重要作用,但其日益增强的连通性使其极易遭受自适应和零日攻击,传统基于规则的入侵检测和单智能体强化学习难以应对。为此,本文提出一种新型分层对抗鲁棒多智能体强化学习(HAMARL)框架。该框架采用分层结构,包含负责子系统安全的本地智能体和统筹全局防御策略的全局协调器,并引入对抗训练机制,模拟并预判不断演化的网络威胁,实现主动防御。在模拟的工业物联网测试平台上进行的大量实验表明,相较于传统多智能体强化学习方法,HAMARL显著提升了攻击检测准确率,缩短了响应时间,保障了系统持续运行。结果证明,结合分层多智能体协同与对抗感知训练,能有效增强下一代工控系统的韧性与安全性。
原文摘要 · Abstract (English)
Cyber-Physical Systems play a critical role in the infrastructure of various sectors, including manufacturing, energy distribution, and autonomous transportation systems. However, their increasing connectivity renders them highly vulnerable to sophisticated cyber threats, such as adaptive and zero-day attacks, against which traditional security methods like rule-based intrusion detection and single-agent reinforcement learning prove insufficient. To overcome these challenges, this paper introduces a novel Hierarchical Adversarially-Resilient Multi-Agent Reinforcement Learning (HAMARL) framework. HAMARL employs a hierarchical structure consisting of local agents dedicated to subsystem security and a global coordinator that oversees and optimizes comprehensive, system-wide defense strategies. Furthermore, the framework incorporates an adversarial training loop designed to simulate and anticipate evolving cyber threats, enabling proactive defense adaptation. Extensive experimental evaluations conducted on a simulated industrial IoT testbed indicate that HAMARL substantially outperforms traditional multi-agent reinforcement learning approaches, significantly improving attack detection accuracy, reducing response times, and ensuring operational continuity. The results underscore the effectiveness of combining hierarchical multi-agent coordination with adversarially-aware training to enhance the resilience and security of next-generation CPS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。