用逻辑一致性提升复杂查询的检索准确率
Logical Consistency is Vital: Neural-Symbolic Information Retrieval for Negative-Constraint Queries
- 结合一阶逻辑优化语义向量,确保查询与文档逻辑一致
- 在负向约束查询上零样本性能显著优于现有方法
- 适合需要精准理解复杂查询的搜索系统开发者
信息检索在资源定位中至关重要。当前稠密检索器通过嵌入向量相似度查找相关文档,主要依赖查询与文档间的词共现,忽视真实查询意图,导致大量无关结果。尤其在复杂查询(如负向约束查询)场景下,性能可能严重下降。为此,我们提出神经符号信息检索方法NS-IR,利用一阶逻辑(FOL)优化自然语言嵌入,考虑查询与文档间的逻辑一致性。具体引入两种新机制:逻辑对齐与连接约束,用于重排序候选文档,提升相关性。此外,构建新数据集NegConstraint,评估复杂检索场景下的表现。大量实验表明,NS-IR不仅在网页搜索和低资源检索任务中实现更优零样本性能,且在负向约束查询上表现更佳。
原文摘要 · Abstract (English)
Information retrieval plays a crucial role in resource localization. Current dense retrievers retrieve the relevant documents within a corpus via embedding similarities, which compute similarities between dense vectors mainly depending on word co-occurrence between queries and documents, but overlook the real query intents. Thus, they often retrieve numerous irrelevant documents. Particularly in the scenarios of complex queries such as \emph{negative-constraint queries}, their retrieval performance could be catastrophic. To address the issue, we propose a neuro-symbolic information retrieval method, namely \textbf{NS-IR}, that leverages first-order logic (FOL) to optimize the embeddings of naive natural language by considering the \emph{logical consistency} between queries and documents. Specifically, we introduce two novel techniques, \emph{logic alignment} and \emph{connective constraint}, to rerank candidate documents, thereby enhancing retrieval relevance. Furthermore, we construct a new dataset \textbf{NegConstraint} including negative-constraint queries to evaluate our NS-IR's performance on such complex IR scenarios. Our extensive experiments demonstrate that NS-IR not only achieves superior zero-shot retrieval performance on web search and low-resource retrieval tasks, but also performs better on negative-constraint queries. Our scource code and dataset are available at https://github.com/xgl-git/NS-IR-main.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。