让检索结果更符合时间背景,提升时敏问答准确率。
TempRetriever: Fusion-based Temporal Dense Passage Retrieval for Time-Sensitive Questions
- 将查询时间和文档时间都编码进检索模型,增强时间对齐
- 在两个档案数据集上,最高提升9.56%的召回准确率
- 适合需要精准时间定位的问答、历史文献检索场景
时间感知在信息检索中至关重要,尤其在相关性依赖于时间上下文的任务中。传统方法如BM25和密集段落检索(DPR)仅关注词汇或语义相似性,忽视了查询与文档之间的时间对齐,这在时敏任务如时间问答(TQA)中尤为关键。我们提出TempRetriever,一种扩展自DPR的新模型,通过将查询日期和文档时间戳嵌入检索过程,显式融合时间信息,从而检索出不仅语义相关且时间对齐的段落。在ArchivalQA和ChroniclingAmericaQA两个大规模数据集上评估显示,该模型优于基线模型。在ArchivalQA上,Top-1准确率提升6.63%,NDCG@10提升3.79%;在ChroniclingAmericaQA上,Top-1准确率提升9.56%,NDCG@10提升4.68%。我们还提出一种基于时间的负采样策略,进一步缓解训练中的时间错位问题。结果表明,时间因素在密集检索系统中极为重要,并建立了一个新的时间感知段落检索基准。
原文摘要 · Abstract (English)
Temporal awareness is crucial in many information retrieval tasks, particularly in scenarios where the relevance of documents depends on their alignment with the query's temporal context. Traditional approaches such as BM25 and Dense Passage Retrieval (DPR) focus on lexical or semantic similarity but tend to neglect the temporal alignment between queries and documents, which is essential for time-sensitive tasks like temporal question answering (TQA). We propose TempRetriever, a novel extension of DPR that explicitly incorporates temporal information by embedding both the query date and document timestamp into the retrieval process. This allows retrieving passages that are not only contextually relevant but also aligned with the temporal intent of queries. We evaluate TempRetriever on two large-scale datasets ArchivalQA and ChroniclingAmericaQA demonstrating its superiority over baseline retrieval models across multiple metrics. TempRetriever achieves a 6.63\% improvement in Top-1 retrieval accuracy and a 3.79\% improvement in NDCG@10 compared to the standard DPR on ArchivalQA. Similarly, for ChroniclingAmericaQA, TempRetriever exhibits a 9.56\% improvement in Top-1 retrieval accuracy and a 4.68\% improvement in NDCG@10. We also propose a novel, time-based negative sampling strategy which further enhances retrieval performance by addressing temporal misalignment during training. Our results underline the importance of temporal aspects in dense retrieval systems and establish a new benchmark for time-aware passage retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。