用大模型做检索,别生成了,直接当编码器更高效
The Case Against Generation for Retrieval: Discriminative Language Models as Effective Retrievers

- 用大模型做双塔检索,共享编码器+句子结尾标记池化
- 在三个公开数据集上超越当前最佳模型,效率更高
- 适合工业级大规模检索系统,抗模型过时、可扩展性强
大语言模型在推荐系统中展现出巨大潜力,但将其作为生成式推荐或零样本排序器部署于网络规模时,面临计算开销过大和事实对齐困难的问题。本文通过将大模型作为语义表示骨干而非生成引擎,重振经典的高效双塔检索架构。提出一种原生适配大模型的双塔框架,支持高吞吐、大规模检索。创新包括:共享大模型编码器实现用户-物品联合建模,使用句末标记(EOS)进行紧凑序列嵌入,跨数据集迁移学习,从强交叉编码器教师模型中进行知识蒸馏,以及在用户塔中引入潜在推理机制。在三个公开基准上的实验证明,交叉编码器架构超越当前最优模型,而高效的双塔学生模型达到相当水平。内部大规模生产系统实验显示,检索性能显著提升,且对模型陈旧具有强鲁棒性,数据扩展能力优异。结果表明,结合现代表征学习技术后,传统双塔范式仍是工业检索系统的极具竞争力且实用的解决方案。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have emerged as powerful assets for recommender systems. However, deploying them as generative recommenders or zero-shot rankers at web-scale remains bottlenecked by prohibitive computational overhead and grounding challenges. In this paper, we revitalize the classic, highly efficient two-tower retrieval architecture by adapting LLMs as semantic representation backbones rather than generative engines. We introduce an LLM-native two-tower framework engineered for high-throughput, large-scale retrieval. Our architecture introduces several key innovations: a shared LLM encoder for joint user-item modeling, End-Of-Sentence (EOS) token pooling for compact sequence embedding, cross-dataset transfer learning, knowledge distillation from powerful cross-encoder teachers, and latent reasoning within the user tower. Extensive evaluation across three public benchmarks demonstrates that cross-encoder architecture outperforms current state-of-the-art (SoTA) models, while the efficient two-tower student achieves SoTA-comparable retrieval performance. Furthermore, experiments on internal large-scale production systems yield substantial topline retrieval improvements along with high resilience to model staleness and superior data scaling. Our findings demonstrate that when augmented with modern representation learning, the traditional two-tower paradigm remains an exceptionally competitive and practical solution for industrial retrieval systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。