arXiv:2606.10621cs.IRcs.AI2026-06

让关键词检索更快更准,无需重索引

STORM: Stepwise Token Optimization with Reward-Guided Beam Search

  • 逐词优化查询,用检索效果实时指导生成
  • 0.6B-8B模型在TREC/BEIR上超越主流LLM重写器
  • 零样本跨18语言,比专用多语言检索器更强

现代检索依赖密集型神经模型,但需重建专用索引,模型更新即需重索。传统词法检索如BM25效率高、透明性强,但存在词汇不匹配问题。大语言模型(LLM)查询重写可缓解,但提示式重写常生成无效或有害词,且训练时仅序列级延迟奖励,难以定位有效词汇。本文提出STORM(步进词元优化与奖励引导束搜索),一种自监督词法查询扩展框架。通过检索指标引导生成:每步对候选扩展词评分并剪枝低回报分支,将检索奖励转化为词级信号,聚焦于有效词汇探索。在TREC DL和BEIR数据集上,0.6B-8B规模的模型表现媲美甚至超越先进LLM重写器,同时保持与原始BM25相当的检索速度;8B模型性能接近更大规模专有重写器。该方法还可零样本迁移至18种语言(MIRACL),平均优于专用多语言密集检索器,为轻量级基础设施下的高效检索提供有力替代方案。

原文摘要 · Abstract (English)

Modern retrieval increasingly relies on dense and learned-sparse neural models that are effective but require encoding the entire corpus into a specialized index, rebuilt whenever the model changes. Lexical retrievers like BM25 stay efficient and transparent on a standard inverted index that need not change as models evolve, but suffer from vocabulary mismatch. LLM query rewriting can help, yet prompted rewriters emit well-formed but retrieval-ineffective or harmful-terms, and training against a retrieval reward gives only delayed, sequence-level supervision that obscures which terms helped. We introduce STORM (Stepwise Token Optimization with Reward-guided beaM search), a self-supervised framework for lexical query expansion. STORM trains the rewriter through generation guided by retrieval metrics: at each step, candidate expansions are scored against the BM25 index and low-reward continuations pruned, turning the retrieval reward into a token-level signal that concentrates exploration on retrieval-effective vocabulary. Across TREC DL and BEIR, STORM lets 0.6B-8B backbones match or surpass competitive LLM rewriters while retrieving as fast as plain BM25; at 8B it rivals far larger proprietary rewriters. It further transfers zero-shot to 18 languages (MIRACL), beating dedicated multilingual dense retrievers on average, making STORM a competitive, infrastructure-light alternative to dense neural retrieval.

检索增强查询重写词法检索零样本迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。