提出高效解耦的文档重排序模型,兼顾速度与相关性建模能力。
KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Reranking

- 分离查询与文档计算,通过交叉注意力保持相关性建模
- 0.27B参数模型在多个数据集上表现优于7-12B嵌入模型
- 适合追求效率与性能平衡的检索系统部署场景
随着检索系统规模扩大,高质量重排序愈发关键。现有大多数重排序器(基于编码器或解码器)需联合编码查询与文档,计算紧密耦合,限制了部署效率与灵活性。本文提出KaLM-Reranker-V1,一种快速但非延迟交互(FBNL)的重排序模型,通过解耦查询与文档计算,同时保留强相关性建模能力。该模型基于编码器-解码器架构:编码器使用马特约什卡嵌入池化预编码文档,解码器建模系统指令、用户指令和查询意图;交叉注意力捕捉查询上下文与文档表示间的相关性。此设计实现高效解耦编码,又不牺牲交互能力。我们构建了三种尺寸的版本:Nano(0.27B激活参数)、Small(1B)和Large(4B)。在BEIR、MIRACL和LMEB上的大量实验表明,KaLM-Reranker-V1在性能与效率方面均表现优异。在BEIR上达到顶尖水平,媲美Qwen3-Reranker等工业级模型;在未充分训练多语言数据的MIRACL上仍具出色表现;在LMEB上,即使是最小的0.27B Nano模型,也仍可匹敌7-12B嵌入模型。
原文摘要 · Abstract (English)
As retrieval systems scale, high-quality reranking becomes increasingly important. However, most existing rerankers, whether encoder-based or decoder-based, jointly encode the query and passage, tightly coupling their computation and limiting deployment efficiency as well as flexibility. We present KaLM-Reranker-V1, a fast but not late-interaction (FBNL) reranker that decouples query and passage computation while retaining expressive relevance modeling. Built on an encoder-decoder architecture, KaLM-Reranker-V1 uses the encoder to pre-encode passages with Matryoshka embedding pooling, while the decoder models the system instruction, user instruction, and query intent; cross-attention then captures relevance between the query context and passage representations. This design makes KaLM-Reranker-V1 efficient through decoupled passage encoding, yet not late interaction, by preserving rich relevance modeling through cross-attention. We instantiate KaLM-Reranker-V1 in three sizes, Nano, Small, and Large, with 0.27B, 1B, and 4B activated parameters, respectively. Extensive experiments on BEIR, MIRACL, and LMEB demonstrate that KaLM-Reranker-V1 achieves strong reranking performance with superior efficiency. On BEIR, KaLM-Reranker-V1 achieves state-of-the-art performance, on par with strong industrial models such as the Qwen3-Reranker series; on MIRACL, despite not being extensively trained on multilingual data, KaLM-Reranker-V1 still shows excellent reranking performance. Moreover, on LMEB, reranking models demonstrate a clear advantage, with even the 0.27B Nano model remaining competitive with 7-12B embedding models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。