让小模型也能高效推理,提升问答准确率
LIR$^3$AG: A Lightweight Rerank Reasoning Strategy Framework for Retrieval-Augmented Generation
- 重构检索结果生成推理链,使非推理模型具备推理能力
- 减少98%输出token和58.6%推理时间,性能超越32B大模型
- 适合资源有限但需高精度问答的部署场景
检索增强生成(RAG)通过引入外部知识提升大语言模型性能。在多跳问答任务中,推理模型能整合多文档证据并进行推理,但带来高昂计算开销。我们系统研究了此类模型的推理策略,发现其主要采用两种模式:基于上下文的推理(依赖检索内容)和知识调和推理(用内部知识解决冲突或缺失)。为此,提出轻量级重排序推理策略框架LiR$^3$AG,通过重构检索证据生成连贯推理链,使非推理模型可迁移推理能力。该方法将平均输出token开销降低98%,推理时间减少58.6%,同时使8B模型的F1得分提升6.2%至22.5%,在RAG任务中超越32B推理模型表现,为高效实用的RAG系统提供新路径。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require integrating and reasoning over multiple pieces of evidence across different documents to answer a complex question. However, they often introduce substantial computational costs, including increased token consumption and inference latency. To better understand and mitigate this trade-off, we conduct a comprehensive study of reasoning strategies for reasoning models in RAG multi-hop QA tasks. Our findings reveal that reasoning models adopt structured strategies to integrate retrieved and internal knowledge, primarily following two modes: Context-Grounded Reasoning, which relies directly on retrieved content, and Knowledge-Reconciled Reasoning, which resolves conflicts or gaps using internal knowledge. To this end, we propose a novel Lightweight Rerank Reasoning Strategy Framework for RAG (LiR$^3$AG) to enable non-reasoning models to transfer reasoning strategies by restructuring retrieved evidence into coherent reasoning chains. LiR$^3$AG significantly reduce the average 98% output tokens overhead and 58.6% inferencing time while improving 8B non-reasoning model's F1 performance ranging from 6.2% to 22.5% to surpass the performance of 32B reasoning model in RAG, offering a practical and efficient path forward for RAG systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。