arXiv:2502.20825cs.LGcs.AI2025-02被引 12

用大模型自动优化云配置,减少人工干预和错误。

LADs: Leveraging LLMs for AI-Driven DevOps

  • 通过提示链与反馈循环,让大模型动态学习配置策略。
  • 实测可降低手动调优成本,提升系统可靠性与资源利用率。
  • 适合需要智能运维的云平台开发者和DevOps工程师。

自动化云配置与部署面临基础设施演进、硬件异构和负载波动等挑战。现有方案适应性差且需大量人工调优,导致效率低下和配置错误。我们提出LADs——首个基于大模型的框架,通过深入分析不同条件下优化的有效性,实现鲁棒、自适应、高效的自动化云管理。LADs结合检索增强生成、少样本学习、思维链推理与基于反馈的提示链技术,生成精准配置,并从部署失败中持续学习优化系统参数。实验揭示性能、成本与可扩展性之间的权衡关系,帮助实践者选择适配场景的策略。例如,基于提示链的自适应反馈回路提升了多租户环境的容错能力,结构化日志结合示例样本显著提高配置准确性。大规模评估表明,LADs有效减少人工投入,优化资源利用并增强系统可靠性。项目已开源,旨在推动AI驱动的DevOps自动化发展。

原文摘要 · Abstract (English)

Automating cloud configuration and deployment remains a critical challenge due to evolving infrastructures, heterogeneous hardware, and fluctuating workloads. Existing solutions lack adaptability and require extensive manual tuning, leading to inefficiencies and misconfigurations. We introduce LADs, the first LLM-driven framework designed to tackle these challenges by ensuring robustness, adaptability, and efficiency in automated cloud management. Instead of merely applying existing techniques, LADs provides a principled approach to configuration optimization through in-depth analysis of what optimization works under which conditions. By leveraging Retrieval-Augmented Generation, Few-Shot Learning, Chain-of-Thought, and Feedback-Based Prompt Chaining, LADs generates accurate configurations and learns from deployment failures to iteratively refine system settings. Our findings reveal key insights into the trade-offs between performance, cost, and scalability, helping practitioners determine the right strategies for different deployment scenarios. For instance, we demonstrate how prompt chaining-based adaptive feedback loops enhance fault tolerance in multi-tenant environments and how structured log analysis with example shots improves configuration accuracy. Through extensive evaluations, LADs reduces manual effort, optimizes resource utilization, and improves system reliability. By open-sourcing LADs, we aim to drive further innovation in AI-powered DevOps automation.

AI运维大模型应用自动化部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。