让无监督检索模型学会时间对齐,避免找错时间的文档。
Temporal Preference Optimization for Unsupervised Retrieval

- 用时间偏好学习替代传统对比学习,引导模型选时间匹配的文档。
- 在隐式和显式查询上分别提升4.04和4.98的nDCG@5,性能超越大模型。
- 无需时间戳标注,可泛化到未见过的时间段,适合长期文档检索场景。
无监督密集检索器通过对比学习从无标签文档中学习语义相似性,但难以捕捉时间相关性,常检索出语义相关却时间错位的文档(如查询“2019年总统是谁”时返回2023年的答案)。现有方法依赖带时间戳的有监督训练,不具普适性。本文提出TPOUR(Temporal Preference Optimization for Unsupervised Retriever),采用新型训练方法TRPO,将偏好学习重构为时间维度上的优化,引导检索器优先选择时间对齐的文档。TPOUR通过学习时间嵌入中的插值能力,实现对未见时间段的连续时间对齐。在时间信息检索(T-IR)任务上,相较无监督与有监督基线均有显著提升。相比Qwen-Embedding-8B,TPOUR Contriever体积小72.7倍,但在显式查询上nDCG@5提升+4.04(+12.15%),隐式查询上提升+4.98(+15.21%)。代码已开源:https://github.com/agwaBom/TPOUR。
原文摘要 · Abstract (English)
Unsupervised dense retrievers offer scalability by learning semantic similarity from unlabeled documents via contrastive learning, but they struggle to capture the temporal relevance, retrieving semantically related but temporally misaligned documents-an important aspect when a document collection spans multiple time periods (e.g., retrieving documents from 2018-2025 for "Who is the president in 2019?" introduces temporal ambiguity). Existing methods rely on supervised training with explicit timestamps, which are not always feasible. We propose TPOUR (Temporal Preference Optimization for Unsupervised Retriever), which uses our novel training method Temporal Retrieval Preference Optimization (TRPO). TRPO reinterprets preference learning in the temporal dimension, guiding the retriever to favor temporally aligned documents. TPOUR further generalizes to unseen time periods via interpolation in a learned time embedding, enabling continuous temporal alignment. Experiments on temporal information retrieval (T-IR), TPOUR outperforms both unsupervised and supervised baselines. Compared to Qwen-Embedding-8B, despite being about 72.7x smaller, TPOUR Contriever improves average nDCG@5 by +4.04 (+12.15%) on explicit and +4.98 (+15.21%) on implicit queries. We provide our code at https://github.com/agwaBom/TPOUR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。