arXiv:2507.13334cs.CL2025-07综述被引 149

系统梳理大模型上下文工程,揭示理解强生成弱的核心差距

A Survey of Context Engineering for Large Language Models

  • 将上下文工程拆解为检索生成、处理管理等基础模块
  • 分析1400篇论文发现模型理解力强但长文本生成能力不足
  • 适合研究上下文增强与推理系统的工程师和学者

大型语言模型(LLMs)的表现本质上由推理阶段提供的上下文信息决定。本文提出上下文工程(Context Engineering)这一系统性学科,超越简单提示设计,聚焦于对大模型信息负载的优化。我们构建了一个全面的分类体系,将上下文工程分解为基础组件与高级系统实现。首先分析基础组件:上下文检索与生成、上下文处理、上下文管理。随后探讨这些组件如何架构集成,形成复杂系统:检索增强生成(RAG)、记忆系统与工具融合推理、多智能体系统。通过对1400余篇研究论文的系统分析,本综述不仅建立该领域的技术路线图,更揭示关键研究空白:当前模型在上下文工程支持下虽具备卓越的复杂上下文理解能力,但在生成同等复杂度的长文本输出方面存在明显局限。填补这一鸿沟是未来研究的核心优先事项。最终,本综述为推进上下文感知AI的研究者与工程师提供了统一框架。

原文摘要 · Abstract (English)

The performance of Large Language Models (LLMs) is fundamentally determined by the contextual information provided during inference. This survey introduces Context Engineering, a formal discipline that transcends simple prompt design to encompass the systematic optimization of information payloads for LLMs. We present a comprehensive taxonomy decomposing Context Engineering into its foundational components and the sophisticated implementations that integrate them into intelligent systems. We first examine the foundational components: context retrieval and generation, context processing and context management. We then explore how these components are architecturally integrated to create sophisticated system implementations: retrieval-augmented generation (RAG), memory systems and tool-integrated reasoning, and multi-agent systems. Through this systematic analysis of over 1400 research papers, our survey not only establishes a technical roadmap for the field but also reveals a critical research gap: a fundamental asymmetry exists between model capabilities. While current models, augmented by advanced context engineering, demonstrate remarkable proficiency in understanding complex contexts, they exhibit pronounced limitations in generating equally sophisticated, long-form outputs. Addressing this gap is a defining priority for future research. Ultimately, this survey provides a unified framework for both researchers and engineers advancing context-aware AI.

上下文工程大模型RAG多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。