用大模型自动完成混沌工程全流程,让普通人低成本构建抗故障系统。
LLM-Powered Fully Automated Chaos Engineering: Towards Enabling Anyone to Build Resilient Software Systems at Low Cost
- 用大模型驱动自动化混沌工程流程,分步完成需求、编码、测试任务。
- 在大小型Kubernetes系统上验证,耗时和成本显著降低,结果可靠。
- 适合非专家用户快速提升系统韧性,尤其适合资源有限的团队。
混沌工程旨在提升分布式系统的韧性,通过主动注入故障来测试系统稳定性并发现潜在弱点。现有工具仅能自动化执行预设实验,但实验设计与结果优化仍需人工干预,过程繁琐且需跨领域知识。为解决此问题,本文提出ChaosEater,一个基于大语言模型(LLM)的全自动混沌工程系统。该系统遵循标准化的混沌工程流程,将任务分解并分配给LLM执行,涵盖需求定义、代码生成、测试与调试等软件工程操作。ChaosEater专用于基于Kubernetes构建的系统。通过在小型和大型Kubernetes系统上的案例研究验证,ChaosEater能持续完成合理且高效的混沌工程周期,显著降低时间和金钱成本。其结果经人工工程师及大模型双重质化评估,确认有效性。
原文摘要 · Abstract (English)
Chaos Engineering (CE) is an engineering technique aimed at improving the resilience of distributed systems. It involves intentionally injecting faults into a system to test its resilience, uncover weaknesses, and address them before they cause failures in production. Recent CE tools automate the execution of predefined CE experiments. However, planning such experiments and improving the system based on the experimental results still remain manual. These processes are labor-intensive and require multi-domain expertise. To address these challenges and enable anyone to build resilient systems at low cost, this paper proposes ChaosEater, a system that automates the entire CE cycle with Large Language Models (LLMs). It predefines an agentic workflow according to a systematic CE cycle and assigns subdivided processes within the workflow to LLMs. ChaosEater targets CE for software systems built on Kubernetes. Therefore, the LLMs in ChaosEater complete CE cycles through software engineering tasks, including requirement definition, code generation, testing, and debugging. We evaluate ChaosEater through case studies on small- and large-scale Kubernetes systems. The results demonstrate that it consistently completes reasonable CE cycles with significantly low time and monetary costs. Its cycles are also qualitatively validated by human engineers and LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。