用未来行为信息优化文档排序,让模型更懂用户意图。
Bridge the Gap between Past and Future: Siamese Model Optimization for Context-Aware Document Ranking
- 构建双模型框架,历史+未来行为协同训练。
- 在多个基准数据集上超越现有方法,提升排序效果。
- 适合研究搜索排序与用户行为建模的学者和工程师。
在信息检索中,用户常通过多轮交互获取信息,形成行为序列。利用会话上下文有助于推断用户意图并改进文档排序。尽管已有多种方法利用会话内上下文,但历史数据难以捕捉用户意图的动态演变。本文提出将未来上下文信息融入会话建模,设计了孪生模型优化框架,包含仅依赖历史行为的ForeRanker与同时融合历史与预估未来行为的未来感知模型。两者通过监督标签和对方生成的伪标签进行协同训练。ForeRanker在训练中逐步学习未来相关特征,推理时仅使用历史数据。为缓解训练不一致,引入带动态门控的同伴知识蒸馏机制,实现上下文选择性融合。在多个基准数据集上的实验表明,ForeRanker显著优于现有方法。
原文摘要 · Abstract (English)
In the realm of information retrieval, users often engage in multi-turn interactions with search engines to acquire information, leading to the formation of sequences of user feedback behaviors. Leveraging the session context has proven to be beneficial for inferring user search intent and document ranking. A multitude of approaches have been proposed to exploit in-session context for improved document ranking. Despite these advances, the limitation of historical session data for capturing evolving user intent remains a challenge. In this work, we explore the integration of future contextual information into the session context to enhance document ranking. We present the siamese model optimization framework, comprising a history-conditioned model and a future-aware model. The former processes only the historical behavior sequence, while the latter integrates both historical and anticipated future behaviors. Both models are trained collaboratively using the supervised labels and pseudo labels predicted by the other. The history-conditioned model, referred to as ForeRanker, progressively learns future-relevant information to enhance ranking, while it singly uses historical session at inference time. To mitigate inconsistencies during training, we introduce the peer knowledge distillation method with a dynamic gating mechanism, allowing models to selectively incorporate contextual information. Experimental results on benchmark datasets demonstrate the effectiveness of our ForeRanker, showcasing its superior performance compared to existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。