arXiv:2511.01316cs.SEcs.AI2025-11

用大模型提升CI配置迁移效率,实测性能提升近三倍。

Exploringand Unleashing the Power of Large Language Models in CI/CD Configuration Translation

  • 基于大模型的提示工程与迭代优化,实现CI配置自动翻译。
  • 迁移中平均需读38行旧配置、写58行新配置,近半数需多次提交。
  • 结合规则引导与迭代修正,成功率提升至75.5%,显著优于基础方案。

持续集成(CI)是现代协同开发的核心,各平台间迁移频繁。迁移关键在于配置转换,但因配置复杂性和平台语义差异而困难。本文研究基于大语言模型(LLM)的配置翻译,聚焦从Travis CI到GitHub Actions的迁移。基于811条迁移记录分析发现,开发者平均阅读38行Travis配置,编写58行GitHub Actions配置,近半迁移需多轮提交。评估四种LLM发现共存在1,121个问题,主要为逻辑不一致(38%)、平台差异(32%)、环境错误(25%)和语法错误(5%)。通过三种增强策略对比,结合规则提示与迭代优化效果最佳,构建成功率达75.5%,较GPT-4o基础提示提升近三倍。

原文摘要 · Abstract (English)

Continuous Integration (CI) is a cornerstone of modern collaborative software development, and numerous CI platforms are available. Differences in maintenance overhead, reliability, and integration depth with code-hosting platforms make migration between CI platforms a common practice. A central step in migration is translating CI configurations, which is challenging due to the intrinsic complexity of CI configurations and the need to understand semantic differences and relationships across CI platforms. With the advent of large language models (LLMs), recent advances in software engineering highlight their potential for CI configuration translation. In this paper, we present a study on LLM-based CI configuration translation, focusing on the migration from Travis CI to GitHub Actions. First, using 811 migration records, we quantify the effort involved and find that developers read an average of 38 lines of Travis configuration and write 58 lines of GitHub Actions configuration, with nearly half of the migrations requiring multiple commits. We further analyze translations produced by each of the four LLMs and identify 1,121 issues grouped into four categories: logic inconsistencies (38%), platform discrepancies (32%), environment errors (25%), and syntax errors (5%). Finally, we evaluate three enhancement strategies and show that combining guideline-based prompting with iterative refinement achieves the best performance, reaching a Build Success Rate of 75.5%-nearly a threefold improvement over GPT-4o with a basic prompt.

CI/CD大模型应用代码迁移自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。