让可微分检索索引同时兼顾相关性与多样性,无需后处理。
Inducing Diversity in Differentiable Search Indexing
- 基于MMR思想在训练中引入多样性约束
- 在NQ320K和MSMARCO上保持高相关性的同时提升多样性
- 适用于需要多主题覆盖的检索任务,如子话题搜索
可微分搜索索引(DSI)是一种利用Transformer神经网络作为文档索引的新范式,可简化检索流程并支持索引的修改、更新与扩展。本文受最大边际相关性(MMR)启发,探索在训练过程中平衡相关性与新颖信息内容(多样性)的方法,并证明该方法优于朴素的DSI训练方式。我们在NQ320K和MSMARCO数据集上进行了定量与定性评估,结果表明,所提方法可在不显著影响相关性的前提下实现多样性提升。由于多样性在训练阶段即被引入,模型已学会在保持相关性的同时生成多样化召回结果,从而避免了传统MRR等方法所需的后处理步骤。该方法对需兼顾相关性与多样性的检索任务(如子话题检索)具有重要意义,且可自然扩展至增量式DSI设置,实现在快速更新索引的同时检索多样化结果。
原文摘要 · Abstract (English)
Differentiable Search Indexing (DSI) is a recent paradigm for information retrieval which uses a transformer-based neural network architecture as the document index to simplify the retrieval process. A differentiable index has many advantages enabling modifications, updates or extensions to the index. In this work, we explore balancing relevance and novel information content (diversity) for training DSI systems inspired by Maximal Marginal Relevance (MMR), and show the benefits of our approach over the naive DSI training. We present quantitative and qualitative evaluations of relevance and diversity measures obtained using our method on NQ320K and MSMARCO datasets in comparison to naive DSI. With our approach, it is possible to achieve diversity without any significant impact to relevance. Since we induce diversity while training DSI, the trained model has learned to diversify while being relevant. This obviates the need for a post-processing step to induce diversity in the recall set as typically performed using MMR. Our approach will be useful for Information Retrieval problems where both relevance and diversity are important such as in sub-topic retrieval. Our work can also be easily be extended to the incremental DSI settings which would enable fast updates to the index while retrieving a diverse recall set.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。