arXiv:2507.05714cs.CLcs.AI2025-07EMNLP被引 7

提出分层思维指令微调,让模型更聪明地用外部知识回答问题。

HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation

  • 设计三层能力:筛选信息、整合段落语义、结合内外知识推理。
  • 在多个数据集上性能显著提升,尤其在复杂问答任务中效果明显。
  • 适合需要精准利用外部知识的智能问答系统开发者参考。

检索增强生成(RAG)已成为应对大语言模型在处理实时信息和领域特定问题时挑战的基础范式。传统RAG系统主要依赖大模型自身的上下文学习能力,但对RAG生成模型所需具体能力的研究仍显不足,导致文档质量不一致与检索系统缺陷等问题。即使已有少量研究对RAG生成模型进行微调,也往往缺乏对RAG任务的细粒度关注或对思维链过程的深入利用。为此,我们提出RAG模型应具备三种逐级递进的能力:(1) 过滤:筛选相关信息;(2) 组合:整合跨段落语义信息;(3) RAG特异性推理:利用内部知识进一步处理外部知识。因此,我们提出新的RAG指令微调方法——分层思维指令微调检索增强生成(HIRAG),引入“先思考再回答”策略,通过多层级渐进式思维链增强模型的开卷考试能力。实验表明,该训练策略在RGB、PopQA、MuSiQue、HotpotQA和PubmedQA等多个数据集上均显著提升模型性能。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) has become a fundamental paradigm for addressing the challenges faced by large language models in handling real-time information and domain-specific problems. Traditional RAG systems primarily rely on the in-context learning (ICL) capabilities of the large language model itself. Still, in-depth research on the specific capabilities needed by the RAG generation model is lacking, leading to challenges with inconsistent document quality and retrieval system imperfections. Even the limited studies that fine-tune RAG generative models often \textit{lack a granular focus on RAG task} or \textit{a deeper utilization of chain-of-thought processes}. To address this, we propose that RAG models should possess three progressively hierarchical abilities (1) Filtering: the ability to select relevant information; (2) Combination: the ability to combine semantic information across paragraphs; and (3) RAG-specific reasoning: the ability to further process external knowledge using internal knowledge. Thus, we introduce our new RAG instruction fine-tuning method, Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation (HIRAG) incorporates a "think before answering" strategy. This method enhances the model's open-book examination capability by utilizing multi-level progressive chain-of-thought. Experiments show that the HIRAG training strategy significantly improves the model's performance on datasets such as RGB, PopQA, MuSiQue, HotpotQA, and PubmedQA.

RAG思维链指令微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。