用大模型模拟专家搜索,提升RAG的精准与速度。
SHRAG: AFrameworkfor Combining Human-Inspired Search with RAG
- 用大模型自动将自然语言转为逻辑查询,模仿专家检索
- 在ScienceON多语言数据集上实现高精度跨语言问答
- 兼顾检索精度与生成可靠性,适合需要精准答案的场景
检索增强生成(RAG)因其能缓解大模型幻觉并融入最新信息,正成为下一代信息检索的关键技术。然而,构建高质量检索系统需专业技能,且RAG因兼具检索与生成阶段,处理速度较传统检索系统慢。为此,本文提出SHRAG框架,实现信息检索与RAG的无缝融合,同时保证精确检索性能。SHRAG利用大语言模型作为查询策略器,将非结构化自然语言查询自动转化为逻辑结构化查询,并执行布尔检索,模拟专家搜索过程。此外,引入多语言查询扩展与多语言嵌入模型,支持在ScienceON挑战赛的多语言数据环境中高效进行跨语言问答。实验表明,结合逻辑检索与生成推理的方法,显著提升了RAG系统的准确率与可靠性。SHRAG突破了传统以文档为中心的检索方式,展现出提供直接、可靠答案的新搜索范式潜力。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) is gaining recognition as one of the key technological axes for next generation information retrieval, owing to its ability to mitigate the hallucination phenomenon in Large Language Models (LLMs)and effectively incorporate up-to-date information. However, specialized expertise is necessary to construct ahigh-quality retrieval system independently; moreover, RAGdemonstratesrelativelyslowerprocessing speeds compared to conventional pure retrieval systems because it involves both retrieval and generation stages. Accordingly, this study proposes SHRAG, a novel framework designed to facilitate the seamless integration of Information Retrieval and RAG while simultaneously securing precise retrieval performance. SHRAG utilizes a Large Language Model as a Query Strategist to automatically transform unstructured natural language queries into logically structured search queries, subsequently performing Boolean retrieval to emulate the search process of an expert human searcher. Furthermore, it incorporates multilingual query expansion and a multilingual embedding model, enabling it to perform efficient cross-lingual question answering within the multilingual dataset environment of the ScienceON Challenge. Experimental results demonstrate that the proposed method, combining logical retrieval capabilities and generative reasoning, can significantly enhance the accuracy and reliability of RAG systems. Furthermore, SHRAG movesbeyondconventionaldocument-centric retrieval methods, presenting the potential for a new search paradigm capable of providing direct and reliable responses to queries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。