通过分离注意力与语义感知对比学习,提升知识图谱三元组分类准确率。
SASA: Semantic-Aware Contrastive Learning Framework with Separated Attention for Triple Classification
- 采用分离注意力机制分别编码实体与关系,增强语义交互
- 引入分层语义对比学习,使模型在局部和全局层面更优区分
- 在FB15k-237和YAGO3-10上分别提升5.9%和3.4%准确率
知识图谱常存在不可靠知识,限制其应用。三元组分类(TC)旨在判断知识图谱中三元组的有效性。近期基于文本的方法通过自然语言描述学习实体与关系表示,显著提升了TC模型的泛化能力并刷新性能基准。然而仍面临两大挑战:一是现有方法常忽略不同知识图谱组件间的有效语义交互;二是多数方法采用单一二分类训练目标,导致语义表征学习不足。为此,我们提出SASA框架,通过分离注意力机制与语义感知对比学习(CL),增强TC模型性能。具体地,先使用分离注意力机制将三元组编码为解耦的上下文表示,并以更有效的交互方式融合;再引入语义感知分层对比学习作为辅助训练目标,指导模型在局部与全局层面提升判别能力与语义学习。在两个基准数据集上的实验表明,SASA显著优于当前最优方法,在FB15k-237上准确率提升5.9%,在YAGO3-10上提升3.4%。
原文摘要 · Abstract (English)
Knowledge Graphs~(KGs) often suffer from unreliable knowledge, which restricts their utility. Triple Classification~(TC) aims to determine the validity of triples from KGs. Recently, text-based methods learn entity and relation representations from natural language descriptions, significantly improving the generalization capabilities of TC models and setting new benchmarks in performance. However, there are still two critical challenges. First, existing methods often ignore the effective semantic interaction among different KG components. Second, most approaches adopt single binary classification training objective, leading to insufficient semantic representation learning. To address these challenges, we propose \textbf{SASA}, a novel framework designed to enhance TC models via separated attention mechanism and semantic-aware contrastive learning~(CL). Specifically, we first propose separated attention mechanism to encode triples into decoupled contextual representations and then fuse them through a more effective interactive way. Then, we introduce semantic-aware hierarchical CL as auxiliary training objective to guide models in improving their discriminative capabilities and achieving sufficient semantic learning, considering both local level and global level CL. Experimental results across two benchmark datasets demonstrate that SASA significantly outperforms state-of-the-art methods. In terms of accuracy, we advance the state-of-the-art by +5.9\% on FB15k-237 and +3.4\% on YAGO3-10.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。