arXiv:2604.01733cs.IRcs.CL2026-04被引 1

对比10种检索方法,发现混合+重排序在金融文档问答中表现最佳

From BM25 to Corrective RAG: Benchmarking Retrieval Strategies for Text-and-Table Documents

  • 两阶段流程:先混合检索再用神经模型重排序
  • 混合+重排序达Recall@5 0.816,显著优于单一方法
  • 文本表格混合数据中,传统BM25仍胜过先进语义检索

检索增强生成(RAG)系统高度依赖检索质量,但针对包含文本与表格的异构文档,尚无对现代检索方法的系统性比较。本文在包含23,088个查询、7,318份文档的金融问答基准上,对十种检索策略进行了评估,涵盖稀疏、稠密、混合融合、交叉编码器重排序、查询扩展、索引增强和自适应检索。使用Recall@k、MRR、nDCG评估检索质量,以Number Match评估端到端生成质量,并进行配对自助法显著性检验。结果表明:(1) 两阶段流程(混合检索+神经重排序)在Recall@5达到0.816,MRR@3为0.605,大幅优于所有单阶段方法;(2) 在金融文档上,BM25表现优于当前最优稠密检索,挑战了语义搜索普遍更优的假设;(3) 查询扩展(HyDE、多查询)和自适应检索对精确数值查询帮助有限,而上下文检索带来稳定提升。提供融合方法与重排序深度的消融研究,给出可操作的成本-精度建议,并公开完整基准代码。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) systems critically depend on retrieval quality, yet no systematic comparison of modern retrieval methods exists for heterogeneous documents containing both text and tabular data. We benchmark ten retrieval strategies spanning sparse, dense, hybrid fusion, cross-encoder reranking, query expansion, index augmentation, and adaptive retrieval on a challenging financial QA benchmark of 23,088 queries over 7,318 documents with mixed text-and-table content. We evaluate retrieval quality via Recall@k, MRR, and nDCG, and end-to-end generation quality via Number Match, with paired bootstrap significance testing. Our results show that (1) a two-stage pipeline combining hybrid retrieval with neural reranking achieves Recall@5 of 0.816 and MRR@3 of 0.605, outperforming all single-stage methods by a large margin; (2) BM25 outperforms state-of-the-art dense retrieval on financial documents, challenging the common assumption that semantic search universally dominates; and (3) query expansion methods (HyDE, multi-query) and adaptive retrieval provide limited benefit for precise numerical queries, while contextual retrieval yields consistent gains. We provide ablation studies on fusion methods and reranker depth, actionable cost-accuracy recommendations, and release our full benchmark code.

检索增强金融问答混合检索RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。