轻量模型也能高效答多跳问题,靠动态优化提问链和精准检索。
Resource-Friendly Dynamic Enhancement Chain for Multi-Hop Question Answering
- 将复杂问题拆解为逻辑连贯的子问题,避免幻觉。
- 通过上下文重写迭代优化提问,提升检索精度。
- 关键词提取模块低开销,8B模型上表现顶尖。
知识密集型多跳问答任务需整合多源证据以回答复杂问题,常依赖大语言模型进行多轮检索与迭代生成。然而,大量文档和长上下文会引发轻量级模型(参数较少)的幻觉与语义漂移问题。本文提出新型框架DEC(Dynamic Enhancement Chain),先将复杂问题分解为逻辑连贯的子问题,构建无幻觉推理链;再通过上下文感知重写迭代优化子问题,生成有效查询。检索阶段引入轻量级判别式关键词提取模块,利用提取关键词实现精准、低开销文档召回。在三个多跳QA数据集上的实验表明,DEC性能媲美或超越现有最佳基准,同时显著降低令牌消耗。尤其在80亿参数模型上达到最先进水平,验证其在资源受限环境中的有效性。
原文摘要 · Abstract (English)
Knowledge-intensive multi-hop question answering (QA) tasks, which require integrating evidence from multiple sources to address complex queries, often necessitate multiple rounds of retrieval and iterative generation by large language models (LLMs). However, incorporating many documents and extended contexts poses challenges -such as hallucinations and semantic drift-for lightweight LLMs with fewer parameters. This work proposes a novel framework called DEC (Dynamic Enhancement Chain). DEC first decomposes complex questions into logically coherent subquestions to form a hallucination-free reasoning chain. It then iteratively refines these subquestions through context-aware rewriting to generate effective query formulations. For retrieval, we introduce a lightweight discriminative keyword extraction module that leverages extracted keywords to achieve targeted, precise document recall with relatively low computational overhead. Extensive experiments on three multi-hop QA datasets demonstrate that DEC performs on par with or surpasses state-of-the-art benchmarks while significantly reducing token consumption. Notably, our approach attains state-of-the-art results on models with 8B parameters, showcasing its effectiveness in various scenarios, particularly in resource-constrained environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。