arXiv:2412.15101cs.CL2024-12综述被引 3

动态重写时间信息,提升大模型多跳问答准确性

Review-Then-Refine: A Dynamic Framework for Multi-Hop Question Answering with Temporal Adaptability

  • 先审查后精炼:用时间信息动态重写子问题
  • 自适应检索减少无效召回,降低幻觉风险
  • 适合需要精准时序推理的问答任务

检索增强生成(RAG)框架为多跳问答(Multi-Hop QA)提供了外部知识补充,缓解大语言模型(LLMs)的知识缺陷。然而,传统‘检索-阅读’范式在涉及时间信息的任务中表现不佳,难以准确获取和整合时间相关知识。为此,本文提出一种新框架「review-then-refine」,通过审查阶段动态重写含时间信息的子问题,实现后续自适应检索与推理。该机制有效减少冗余检索,降低幻觉概率。在精炼阶段,模型融合各子问题的检索结果与内部知识,生成连贯答案。跨多个数据集的实验验证了该框架的有效性,显著提升了大模型在时序型多跳问答中的表现。

原文摘要 · Abstract (English)

Retrieve-augmented generation (RAG) frameworks have emerged as a promising solution to multi-hop question answering(QA) tasks since it enables large language models (LLMs) to incorporate external knowledge and mitigate their inherent knowledge deficiencies. Despite this progress, existing RAG frameworks, which usually follows the retrieve-then-read paradigm, often struggle with multi-hop QA with temporal information since it has difficulty retrieving and synthesizing accurate time-related information. To address the challenge, this paper proposes a novel framework called review-then-refine, which aims to enhance LLM performance in multi-hop QA scenarios with temporal information. Our approach begins with a review phase, where decomposed sub-queries are dynamically rewritten with temporal information, allowing for subsequent adaptive retrieval and reasoning process. In addition, we implement adaptive retrieval mechanism to minimize unnecessary retrievals, thus reducing the potential for hallucinations. In the subsequent refine phase, the LLM synthesizes the retrieved information from each sub-query along with its internal knowledge to formulate a coherent answer. Extensive experimental results across multiple datasets demonstrate the effectiveness of our proposed framework, highlighting its potential to significantly improve multi-hop QA capabilities in LLMs.

多跳问答时序推理RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。