企业文档搜索中,用多源检索+逐段验证确保答案准确可靠。
Hybrid Retrieval-Augmented Generation with Knowledge Graph Expansion, RRF Fusion, and Per-Chunk Grounded Evaluation for Enterprise Document Search
- 融合向量、关键词和知识图谱三类检索结果,用重排融合提升召回
- 每段文本独立评估是否答得全、有依据,未接地答案直接丢弃
- 在电信数据集上精准率比纯向量检索高15个百分点,接地率达89.6%
从大型企业文档库中获取准确且有依据的答案是一项挑战。仅依赖密集向量检索在涉及技术术语、厂商专有缩写或需跨多个非连续段落推理的查询上表现不佳。DocuSearch 是一个离线的多智能体文档智能系统,在生产级电信网络运维环境中构建并评估。它不依赖单一检索信号,而是整合三种互补证据:使用 BGE-Large 嵌入在 Qdrant 向量存储中进行语义搜索,基于 SQLite FTS5 索引的 BM25 全文搜索,以及来自结构化边表的知识图谱邻居扩展。这三个排序列表通过互逆排名融合(RRF)合并,向量搜索权重为 0.50,BM25 为 0.35,知识图谱为 0.15,平滑常数设为 60 以稳定得分。随后由交叉编码器重新排序,并使用平衡因子为 0.65 的最大边际相关性(MMR)去除冗余以保证相关性和多样性。其独特之处在于对每个文本块执行逐块评估循环,将每个块视为一个微型检索问题:大语言模型判断该块是否需要更多上下文、是否完整回答问题,以及答案是否基于检索到的文本。无依据的答案不予返回,系统会回退至多块合并策略。在电信语料库上,DocuSearch 实现 Precision@10 为 0.69,Recall@10 为 0.79,接地率高达 89.6%,相较于纯向量检索基线分别提升 15、16 和 18.4 个百分点。
原文摘要 · Abstract (English)
Getting accurate, grounded answers out of large enterprise document repositories is a difficult problem. Dense vector retrieval alone frequently performs poorly on queries that mix technical terminology, vendor-specific acronyms, or require reasoning across several non-adjacent sections. DocuSearch was built to address exactly this gap - an offline, multi-agent document intelligence system developed and evaluated in a production telecom network operations environment. Rather than relying on a single retrieval signal, DocuSearch pulls together three complementary sources of evidence: semantic search over a Qdrant vector store using BGE-Large embeddings, BM25 full text search over an SQLite FTS5 index, and Knowledge Graph neighbour expansion from a structured edge table. These three ranked lists are merged through Reciprocal Rank Fusion with signal weights of 0.50 for vector search, 0.35 for BM25, and 0.15 for the knowledge graph, using a smoothing constant of 60 to stabilize scores. A cross-encoder then reranks the fused list, and Maximal Marginal Relevance with a balance factor of 0.65 prunes results for relevance and diversity. What makes DocuSearch distinctive is a per-chunk evaluation loop treating each chunk as its own mini-retrieval problem: an LLM decides whether the chunk needs more context, whether it fully answers the query, and whether the answer is grounded in retrieved text. Ungrounded answers are not returned; the system falls back to a multi-chunk merge instead. On a telecom corpus, DocuSearch reaches Precision@10 of 0.69, Recall@10 of 0.79, and a grounding rate of 89.6% - gains of 15, 16, and 18.4 percentage points over a dense-only RAG baseline. Index Terms: retrieval-augmented generation, knowledge graph, reciprocal rank fusion, enterprise document search, agentic evaluation, BM25, cross-encoder reranking, on-premise deployment, LangGraph, telecom AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。