解决多模态知识图谱对齐中的双重噪声问题,提升实体匹配准确性。
Learning with Dual-level Noisy Correspondence for Multi-modal Entity Alignment
- 基于双层可靠性评估,区分并处理内部属性与跨图对应噪声。
- 在五个基准上显著优于7种先进方法,对齐准确率最高提升5.2%。
- 适合处理标注不完整或存在错误的真实世界多模态数据。
多模态实体对齐(MMEA)旨在识别异构多模态知识图谱(MMKGs)中等价的实体,每个实体由多种模态的属性描述。现有方法通常假设实体内和跨图对应关系均无误,但真实场景中依赖人工标注常导致错误。本文揭示并研究了一种现实且被忽视的问题——双层噪声对应(DNC),即实体内(实体-属性)与跨图(实体-实体、属性-属性)对应均存在偏差。为此提出鲁棒框架RULE:首先通过双面原则估计实体内与跨图对应关系的可靠性;利用该可靠性,在属性融合时减轻实体内噪声影响,并在消除跨图差异时防止对噪声数据过拟合;此外引入对应关系推理模块,挖掘跨图属性间的潜在关联,确保更精准的等价实体识别。在五个基准上的实验验证了其有效性,相比七种最先进方法有显著提升。代码已公开于GitHub。
原文摘要 · Abstract (English)
Multi-modal entity alignment (MMEA) aims to identify equivalent entities across heterogeneous multi-modal knowledge graphs (MMKGs), where each entity is described by attributes from various modalities. Existing methods typically assume that both intra-entity and inter-graph correspondences are faultless, which is often violated in real-world MMKGs due to the reliance on expert annotations. In this paper, we reveal and study a highly practical yet under-explored problem in MMEA, termed Dual-level Noisy Correspondence (DNC). DNC refers to misalignments in both intra-entity (entity-attribute) and inter-graph (entity-entity and attribute-attribute) correspondences. To address the DNC problem, we propose a robust MMEA framework termed RULE. RULE first estimates the reliability of both intra-entity and inter-graph correspondences via a dedicated two-fold principle. Leveraging the estimated reliabilities, RULE mitigates the negative impact of intra-entity noise during attribute fusion and prevents overfitting to noisy inter-graph correspondences during inter-graph discrepancy elimination. Beyond the training-time designs, RULE further incorporates a correspondence reasoning module that uncovers the underlying attribute-attribute connection across graphs, guaranteeing more accurate equivalent entity identification. Extensive experiments on five benchmarks verify the effectiveness of our method against the DNC compared with seven state-of-the-art methods.The code is available at \href{https://github.com/XLearning-SCU/RULE}{XLearning-SCU/RULE}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。