用大模型理解复杂模糊查询,提升实时问答系统准确性
Leveraging LLM-Assisted Query Understanding for Live Retrieval-Augmented Generation
- 用大模型预处理查询,自动纠错并拆分多意图问题
- 对每个子问题分别检索,再整合结果提高答案相关性
- 适合需要高鲁棒性的实时智能问答场景
现实中的实时检索增强生成(RAG)系统在处理噪声大、歧义多且含多重意图的用户查询时面临巨大挑战。尽管RAG通过外部知识增强大语言模型(LLM),但现有系统通常在更清洁的数据上训练或评估,难以应对复杂输入。本文提出Omni-RAG框架,通过大模型辅助查询理解,在开放域实时场景中提升RAG系统的鲁棒性与有效性。该框架包含三个模块:(1)深度查询理解与分解,利用定制提示的LLM进行去噪(如纠正拼写错误)并拆分多意图查询为结构化子查询;(2)意图感知的知识检索,对每个子查询从语料库(即FineWeb使用OpenSearch)中检索,并聚合结果;(3)重排序与生成,由重排序器(BGE)优化文档选择后,采用链式思考提示让大模型(Falcon-10B)生成最终回答。Omni-RAG旨在弥合当前RAG能力与真实应用需求之间的差距,如SIGIR 2025 LiveRAG挑战所揭示的问题。
原文摘要 · Abstract (English)
Real-world live retrieval-augmented generation (RAG) systems face significant challenges when processing user queries that are often noisy, ambiguous, and contain multiple intents. While RAG enhances large language models (LLMs) with external knowledge, current systems typically struggle with such complex inputs, as they are often trained or evaluated on cleaner data. This paper introduces Omni-RAG, a novel framework designed to improve the robustness and effectiveness of RAG systems in live, open-domain settings. Omni-RAG employs LLM-assisted query understanding to preprocess user inputs through three key modules: (1) Deep Query Understanding and Decomposition, which utilizes LLMs with tailored prompts to denoise queries (e.g., correcting spelling errors) and decompose multi-intent queries into structured sub-queries; (2) Intent-Aware Knowledge Retrieval, which performs retrieval for each sub-query from a corpus (i.e., FineWeb using OpenSearch) and aggregates the results; and (3) Reranking and Generation, where a reranker (i.e., BGE) refines document selection before a final response is generated by an LLM (i.e., Falcon-10B) using a chain-of-thought prompt. Omni-RAG aims to bridge the gap between current RAG capabilities and the demands of real-world applications, such as those highlighted by the SIGIR 2025 LiveRAG Challenge, by robustly handling complex and noisy queries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。