用多智能体系统自动设计抗攻击的Kubernetes弹性扩容方案
Streamlining Resilient Kubernetes Autoscaling with Multi-Agent Systems via an Automated Online Design Framework
- 将系统韧性拆解为故障特定子目标,由协作智能体分担
- 在模拟环境中训练智能体,实测在攻击下比现有方案更稳
- 适合云原生系统运维人员和高可用架构师参考
在云原生系统中,依赖服务的Kubernetes集群常因资源阻塞、瓶颈或持续的Pod崩溃导致运行韧性下降。这些脆弱性在分布式拒绝服务攻击(DDoS)等对抗场景中被进一步放大。传统水平Pod自动扩缩容(HPA)难以应对动态变化,而基于强化学习的方法虽更灵活,但通常仅优化延迟或资源使用等单一目标,忽视了更广泛的故障场景。本文提出将维持运行韧性的总体目标分解为针对特定故障的子目标,交由协同智能体共同构成HPA多智能体系统(MAS)。我们引入一个自动化四阶段在线设计框架:1)从集群日志构建数字孪生;2)在模拟中针对故障场景定制角色与任务训练智能体;3)分析智能体行为以实现可解释性;4)将学习到的策略部署至真实集群。实验结果表明,生成的HPA MAS在复杂集群中面对多种对抗条件时,显著优于三种最先进的HPA系统,在保持运行韧性方面表现更优。
原文摘要 · Abstract (English)
In cloud-native systems, Kubernetes clusters with interdependent services often face challenges to their operational resilience due to poor workload management issues such as resource blocking, bottlenecks, or continuous pod crashes. These vulnerabilities are further amplified in adversarial scenarios, such as Distributed Denial-of-Service attacks (DDoS). Conventional Horizontal Pod Autoscaling (HPA) approaches struggle to address such dynamic conditions, while reinforcement learning-based methods, though more adaptable, typically optimize single goals like latency or resource usage, neglecting broader failure scenarios. We propose decomposing the overarching goal of maintaining operational resilience into failure-specific sub-goals delegated to collaborative agents, collectively forming an HPA Multi-Agent System (MAS). We introduce an automated, four-phase online framework for HPA MAS design: 1) modeling a digital twin built from cluster traces; 2) training agents in simulation using roles and missions tailored to failure contexts; 3) analyzing agent behaviors for explainability; and 4) transferring learned policies to the real cluster. Experimental results demonstrate that the generated HPA MASs outperform three state-of-the-art HPA systems in sustaining operational resilience under various adversarial conditions in a proposed complex cluster.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。