用向量操作构建可组合的查询表示,提升复杂查询检索效果
Constructing Set-Compositional and Negated Representations for First-Stage Ranking
- 通过解耦否定与交集操作,实现零样本查询表示构造
- 在非欧洲君主书籍等罕见项检索中表现优于微调模型
- 适合需要精确逻辑表达的长尾信息检索场景
集合组合与否定查询对表达复杂信息需求至关重要,有助于发现如‘关于非欧洲君主的书’这类小众项目。尽管大语言模型进展迅速,一阶段排序仍因需独立编码查询与文档而面临挑战。本文提出一种零样本方法,利用语义锚定的稀疏检索(LSR)表示间的向量运算,构建包含逻辑运算或否定的查询表示。具体提出解耦否定机制,仅惩罚被否定部分;以及联合伪词法,增强LSR处理交集的能力。实验表明该方法在无微调情况下表现优异,常超越在组合数据上微调的检索器,揭示了现有LSR与密集检索器的局限性。最后,通过引入负向词分值机制,使LSR能有效惩罚包含否定项的文档,进一步提升其表示能力。
原文摘要 · Abstract (English)
Set compositional and negated queries are crucial for expressing complex information needs and enable the discovery of niche items like Books about non-European monarchs. Despite the recent advances in LLMs, first-stage ranking remains challenging due to the requirement of encoding documents and queries independently from each other. This limitation calls for constructing compositional query representations that encapsulate logical operations or negations, and can be used to match relevant documents effectively. In the first part of this work, we explore constructing such representations in a zero-shot setting using vector operations between lexically grounded Learned Sparse Retrieval (LSR) representations. Specifically, we introduce Disentangled Negation that penalizes only the negated parts of a query, and a Combined Pseudo-Term approach that enhances LSRs ability to handle intersections. We find that our zero-shot approach is competitive and often outperforms retrievers fine-tuned on compositional data, highlighting certain limitations of LSR and Dense Retrievers. Finally, we address some of these limitations and improve LSRs representation power for negation, by allowing them to attribute negative term scores and effectively penalize documents containing the negated terms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。