arXiv:2411.06866cs.LGcs.AI2024-11中稿 · KDD被引 5

用图文对齐增强子图检索,提升常识问答性能

Subgraph Retrieval Enhanced by Graph-Text Alignment for Commonsense Question Answering

  • 将知识图谱转为子图向量库,用类BFS采样避免信息丢失
  • 通过双向对比学习实现图文对齐,提升子图检索与融合效果
  • 在5个数据集上验证有效,适合需要结构化知识推理的任务

常识问答需要机器基于常识进行推理。以往方法多采用提取-建模范式,先按预定义规则提取相关子图,再设计多种策略优化结构化知识的表示与融合。尽管有效,但仍面临两大挑战:规则提取可能遗漏关键节点,导致子图大小不可控;图与文本模态间存在错位,影响知识融合效果。为此,我们提出新框架SEPTA:首先将知识图谱转化为子图向量数据库,提出类BFS的子图采样策略,利用广度优先搜索与消息传递机制的类比避免信息损失;其次设计双向对比学习实现图文对齐,有效增强子图检索与知识融合;最后将所有检索信息用于预测模块进行推理。在五个数据集上的大量实验表明该框架具有有效性与鲁棒性。

原文摘要 · Abstract (English)

Commonsense question answering is a crucial task that requires machines to employ reasoning according to commonsense. Previous studies predominantly employ an extracting-and-modeling paradigm to harness the information in KG, which first extracts relevant subgraphs based on pre-defined rules and then proceeds to design various strategies aiming to improve the representations and fusion of the extracted structural knowledge. Despite their effectiveness, there are still two challenges. On one hand, subgraphs extracted by rule-based methods may have the potential to overlook critical nodes and result in uncontrollable subgraph size. On the other hand, the misalignment between graph and text modalities undermines the effectiveness of knowledge fusion, ultimately impacting the task performance. To deal with the problems above, we propose a novel framework: \textbf{S}ubgraph R\textbf{E}trieval Enhanced by Gra\textbf{P}h-\textbf{T}ext \textbf{A}lignment, named \textbf{SEPTA}. Firstly, we transform the knowledge graph into a database of subgraph vectors and propose a BFS-style subgraph sampling strategy to avoid information loss, leveraging the analogy between BFS and the message-passing mechanism. In addition, we propose a bidirectional contrastive learning approach for graph-text alignment, which effectively enhances both subgraph retrieval and knowledge fusion. Finally, all the retrieved information is combined for reasoning in the prediction module. Extensive experiments on five datasets demonstrate the effectiveness and robustness of our framework.

常识推理知识图谱图文对齐子图检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。