让多向量检索模型训练像单向量一样简单,提升长文本和推理任务效果。
PyLate: Flexible Training and Retrieval for Late Interaction Models
- 基于Sentence Transformers构建,支持多向量架构的灵活训练
- 在长文本与复杂推理任务上显著优于传统单向量方法
- 适合想快速实验晚交互模型的研究者与工程师
神经排序已成为现代信息检索的核心。尽管单向量搜索仍是主流,但其将所有信息压缩为单一向量的做法,在跨域、长上下文和推理密集型任务中表现不佳。多向量方法(如ColBERT)通过保留每个词元的嵌入并使用MaxSim计算相似度,克服了这一缺陷,在跨域泛化、长文本处理和复杂检索场景中表现出色。然而,由于缺乏易用且模块化的训练工具,晚交互模型的实际应用仍远落后于单向量模型。为此,我们提出PyLate——一个基于Sentence Transformers的轻量级库,原生支持多向量架构,继承其高效训练、高级日志记录和自动模型卡生成能力,仅需少量代码修改即可接入现有流程。PyLate提供高效的索引功能,助力研究与生产环境中的晚交互模型开发。目前,已推动GTE-ModernColBERT和Reason-ModernColBERT等先进模型的诞生,验证了其实际价值。
原文摘要 · Abstract (English)
Neural ranking has become a cornerstone of modern information retrieval. While single vector search remains the dominant paradigm, it suffers from the shortcoming of compressing all the information into a single vector. This compression leads to notable performance degradation in out-of-domain, long-context, and reasoning-intensive retrieval tasks. Multi-vector approaches pioneered by ColBERT aim to address these limitations by preserving individual token embeddings and computing similarity via the MaxSim operator. This architecture has demonstrated superior empirical advantages, including enhanced out-of-domain generalization, long-context handling, and performance in complex retrieval scenarios. Despite these compelling empirical results and clear theoretical advantages, the practical adoption and public availability of late interaction models remain low compared to their single-vector counterparts, primarily due to a lack of accessible and modular tools for training and experimenting with such models. To bridge this gap, we introduce PyLate, a streamlined library built on top of Sentence Transformers to support multi-vector architectures natively, inheriting its efficient training, advanced logging, and automated model card generation while requiring minimal code changes to code templates users are already familiar with. By offering multi-vector-specific features such as efficient indexes, PyLate aims to accelerate research and real-world application of late interaction models, thereby unlocking their full potential in modern IR systems. Finally, PyLate has already enabled the development of state-of-the-art models, including GTE-ModernColBERT and Reason-ModernColBERT, demonstrating its practical utility for both research and production environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。