arXiv:2608.00183cs.CEcs.AI2026-08被引 1

金融文档检索中,稀疏-稠密融合能显著提效,但按查询自适应调权效果有限。

Evidence-Unit Fairness and the Limits of Query-Adaptive Sparse-Dense Fusion in Financial Document Retrieval

  • 将长文档切分为模型输入窗口大小的片段,解决稠密模型遗漏关键证据的问题。
  • 融合BM25与紧凑稠密编码器后,命中率比单一方法提升约28%。
  • 按查询动态调整权重的三种轻量级方法均未显著优于固定融合,说明简单策略已足够强。

金融文件检索困难,因查询简短且含大量缩写,而答案证据分散在长篇、表格密集的文档中。我们在基于专家标注问题的FinDER基准上研究稀疏-稠密混合检索。首先发现:若检索单元超过稠密编码器输入窗口,稠密模型无法有效覆盖标注证据,干扰与全文稀疏基线的比较。通过将语料切分为编码器窗口大小的段落,消除该偏差。在修正后的数据集上,融合BM25与紧凑稠密编码器使参考级Hit@10提升约28%,训练无关的倒数排名融合在探索性对比中优于等权平均。进一步探究是否可通过每查询自适应调整融合权重:最优插值权重的理论上界为21.8%,但三种轻量级自适应路由器(得分置信度启发式、基于查询特征的随机森林、基于查询嵌入的岭回归)在公司分组交叉验证与聚类稳健推断下,均未实现统计显著提升,表明固定融合已是强基线。我们分析为何按查询加权未能捕捉潜在增益。

原文摘要 · Abstract (English)

Retrieval over financial filings is difficult because queries are short and acronym-heavy while the answer-bearing evidence sits inside long, table-dense documents. We study sparse-dense hybrid retrieval on FinDER, a benchmark of expert-annotated questions over corporate 10-K filings. Our first finding is methodological: if the retrieval unit is larger than the dense encoder's input window, the dense model never sees a large share of the labeled evidence, confounding comparison against a full-text sparse baseline. We measure this directly and remove it by segmenting the corpus into encoder-sized windows. On the corrected corpus, fusing BM25 and a compact dense encoder improves reference-level Hit@10 by roughly 28 percent over either component, and training-free, untuned reciprocal rank fusion exceeds the equal-weight blend in an exploratory comparison. We then ask whether choosing the fusion weight per query helps: an oracle over the interpolation-weight grid shows headroom of 21.8 percent, yet none of the three lightweight adaptive routers (a score-confidence heuristic, a random forest over query features, and a ridge regressor over query embeddings) establishes a statistically reliable improvement over the fixed blend under company-grouped cross-validation with cluster-robust inference. Simple fusion is a strong baseline here, and we discuss why per-query weighting does not capture the available headroom.

信息检索金融文本稠密检索融合策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。