arXiv:2511.18538cs.SEcs.CL2025-11综述被引 12

全面解析代码大模型从训练到应用的全流程,手把手教你用好AI编程工具。

From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence

  • 梳理代码大模型从预训练到强化学习的完整技术链条
  • 实测显示顶尖模型在HumanEval上正确率超95%
  • 适合开发者、研究者参考落地实践与研究方向

大型语言模型(LLMs)已彻底改变自动化软件开发,实现自然语言到可运行代码的直接转换,推动了GitHub Copilot(微软)、Cursor(Anysphere)、Trae(字节跳动)和Claude Code(Anthropic)等工具的商业化。从规则系统演进至基于Transformer的架构,模型性能在HumanEval等基准上实现从个位数到超过95%的成功率跃升。本文提供代码大模型的综合分析与实用指南(一系列分析与探测实验),系统考察从数据构建到后训练的全生命周期,涵盖高级提示范式、代码预训练、监督微调、强化学习及自主编码代理。对比分析通用大模型(GPT-4、Claude、LLaMA)与代码专用模型(StarCoder、Code LLaMA、DeepSeek-Coder、QwenCoder)的能力,深入探讨技术路径、设计决策与权衡。揭示学术研究(如基准测试)与真实部署(如代码正确性、安全性、大规模代码库上下文感知、开发流程集成)之间的差距,并映射有前景的研究方向至实际需求。最后通过一系列实验,对代码预训练、监督微调与强化学习进行全面分析,涵盖缩放定律、框架选择、超参数敏感性、模型结构与数据集比较。

原文摘要 · Abstract (English)

Large language models (LLMs) have fundamentally transformed automated software development by enabling direct translation of natural language descriptions into functional code, driving commercial adoption through tools like Github Copilot (Microsoft), Cursor (Anysphere), Trae (ByteDance), and Claude Code (Anthropic). While the field has evolved dramatically from rule-based systems to Transformer-based architectures, achieving performance improvements from single-digit to over 95\% success rates on benchmarks like HumanEval. In this work, we provide a comprehensive synthesis and practical guide (a series of analytic and probing experiments) about code LLMs, systematically examining the complete model life cycle from data curation to post-training through advanced prompting paradigms, code pre-training, supervised fine-tuning, reinforcement learning, and autonomous coding agents. We analyze the code capability of the general LLMs (GPT-4, Claude, LLaMA) and code-specialized LLMs (StarCoder, Code LLaMA, DeepSeek-Coder, and QwenCoder), critically examining the techniques, design decisions, and trade-offs. Further, we articulate the research-practice gap between academic research (e.g., benchmarks and tasks) and real-world deployment (e.g., software-related code tasks), including code correctness, security, contextual awareness of large codebases, and integration with development workflows, and map promising research directions to practical needs. Last, we conduct a series of experiments to provide a comprehensive analysis of code pre-training, supervised fine-tuning, and reinforcement learning, covering scaling law, framework selection, hyperparameter sensitivity, model architectures, and dataset comparisons.

代码生成大模型编程助手实践指南

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。