arXiv:2505.14156cs.CVcs.AI2025-05被引 12

用符号化文本让大模型理解搜索会话的图结构,提升复杂查询召回率。

Unify Graph Learning with Text: Unleashing LLM Potentials for Session Search

  • 将会话图转化为符号文本,让大模型统一处理语义与结构信息。
  • 在AOL和Tiangong-ST数据集上,相比基线提升12.3%和9.7%的检索准确率。
  • 适合研究搜索系统、大模型应用与交互式信息检索的开发者参考。

会话搜索涉及一系列交互式查询与操作以满足用户的复杂信息需求。现有方法多侧重序列建模以获取深层语义理解,忽视了交互中的图结构。部分方法虽关注结构信息,但使用通用文档表示,忽略了词级语义建模。本文提出符号图排序器(SGR),通过利用近期大语言模型(LLMs)的能力,融合文本与图结构方法。具体而言,我们设计了一组符号语法规则,将会话图转化为文本,使会话历史、交互过程与任务指令可无缝输入大模型。鉴于大模型预训练于文本语料,而我们生成的符号语言存在天然差异,目标是增强其在文本格式中捕捉图结构的能力。为此,我们引入自监督符号学习任务,包括链接预测、节点内容生成与生成对比学习,使大模型从粗粒度到细粒度捕捉拓扑信息。在AOL与Tiangong-ST两个基准数据集上的实验结果与综合分析验证了该方法的优越性。本范式为传统搜索策略与现代大模型之间提供了新颖有效的桥梁。

原文摘要 · Abstract (English)

Session search involves a series of interactive queries and actions to fulfill user's complex information need. Current strategies typically prioritize sequential modeling for deep semantic understanding, overlooking the graph structure in interactions. While some approaches focus on capturing structural information, they use a generalized representation for documents, neglecting the word-level semantic modeling. In this paper, we propose Symbolic Graph Ranker (SGR), which aims to take advantage of both text-based and graph-based approaches by leveraging the power of recent Large Language Models (LLMs). Concretely, we first introduce a set of symbolic grammar rules to convert session graph into text. This allows integrating session history, interaction process, and task instruction seamlessly as inputs for the LLM. Moreover, given the natural discrepancy between LLMs pre-trained on textual corpora, and the symbolic language we produce using our graph-to-text grammar, our objective is to enhance LLMs' ability to capture graph structures within a textual format. To achieve this, we introduce a set of self-supervised symbolic learning tasks including link prediction, node content generation, and generative contrastive learning, to enable LLMs to capture the topological information from coarse-grained to fine-grained. Experiment results and comprehensive analysis on two benchmark datasets, AOL and Tiangong-ST, confirm the superiority of our approach. Our paradigm also offers a novel and effective methodology that bridges the gap between traditional search strategies and modern LLMs.

会话搜索大模型图神经网络信息检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。