arXiv:2409.14924cs.CLcs.AI2024-09综述被引 145

为大模型外接数据应用提供分类框架,帮开发者选对技术方案。

Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely

论文配图:Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely
图 1 · 摘自论文原文
  • 按查询类型分四类:显性事实、隐性事实、可解释推理、隐藏推理。
  • 揭示不同任务下检索与推理的瓶颈,给出适配技术路径。
  • 适合想系统构建外接数据应用的研发者参考。

大型语言模型(LLMs)通过引入外部数据,在完成真实世界任务方面展现出显著能力。将外部数据整合到LLMs中的技术,如检索增强生成(RAG)和微调,正受到越来越多关注并广泛应用于实际场景。然而,在各类专业领域中有效部署数据增强型LLMs仍面临巨大挑战,涵盖从检索相关数据、准确理解用户意图,到充分挖掘LLMs在复杂任务中的推理能力等多个层面。我们认为,数据增强型LLMs的应用并无‘万能’解决方案。实践中性能不佳往往源于未能正确识别任务核心,或任务本身需要多种能力融合,需解耦处理。本文提出一种RAG任务分类方法,根据所需外部数据类型与任务核心焦点,将用户查询分为四类:显性事实查询、隐性事实查询、可解释推理查询、隐藏推理查询。定义各类查询,提供对应数据集,并总结其关键挑战与最有效应对技术。最后讨论三种外部数据集成形式:上下文注入、小型模型辅助、微调,阐明各自优劣及适用问题类型。本工作旨在帮助读者深入理解数据需求与核心瓶颈,为构建数据增强型LLM应用提供系统化指导。

原文摘要 · Abstract (English)

Large language models (LLMs) augmented with external data have demonstrated remarkable capabilities in completing real-world tasks. Techniques for integrating external data into LLMs, such as Retrieval-Augmented Generation (RAG) and fine-tuning, are gaining increasing attention and widespread application. Nonetheless, the effective deployment of data-augmented LLMs across various specialized fields presents substantial challenges. These challenges encompass a wide range of issues, from retrieving relevant data and accurately interpreting user intent to fully harnessing the reasoning capabilities of LLMs for complex tasks. We believe that there is no one-size-fits-all solution for data-augmented LLM applications. In practice, underperformance often arises from a failure to correctly identify the core focus of a task or because the task inherently requires a blend of multiple capabilities that must be disentangled for better resolution. In this survey, we propose a RAG task categorization method, classifying user queries into four levels based on the type of external data required and primary focus of the task: explicit fact queries, implicit fact queries, interpretable rationale queries, and hidden rationale queries. We define these levels of queries, provide relevant datasets, and summarize the key challenges and most effective techniques for addressing these challenges. Finally, we discuss three main forms of integrating external data into LLMs: context, small model, and fine-tuning, highlighting their respective strengths, limitations, and the types of problems they are suited to solve. This work aims to help readers thoroughly understand and decompose the data requirements and key bottlenecks in building LLM applications, offering solutions to the different challenges and serving as a guide to systematically developing such applications.

RAG大模型外接数据任务分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。