arXiv:2410.09127cs.LGcs.AI2024-10被引 3

通过跨年对比学习提升实体链接模型抗时间退化能力

CYCLE: Cross-Year Contrastive Learning in Entity-Linking

  • 用新增/删除关系作为正负样本,设计跨年对比学习机制
  • 相比2023年最优方法,1年时间差下提升13.90%,3年达17.79%
  • 特别适合连接度低的实体,对稀疏节点有强鲁棒性

知识图谱随新实体出现、定义修订和关系变化持续演化,导致实体链接模型产生时间退化现象,表现为性能随时间下降。为解决此问题,我们提出利用图关系聚合不同时期邻近实体的信息,增强对相似实体的时间区分能力,从而缓解时间退化。本文提出 extbf{CYCLE}: extbf{C}ross- extbf{Y}ear extbf{C}ontrastive extbf{L}earning for extbf{E}ntity-Linking。该模型采用新型图对比学习方法,将新添加的关系视为正样本,移除的关系视为负样本。实验表明,当时间差距为一年时,性能比2023年最优方法提升13.90%;时间差距扩大至三年时,提升达17.79%。进一步分析显示,该方法对低度实体尤为有效,因其连接稀疏,更易受时间退化影响,而本方法可显著增强其稳定性。代码与数据已公开于 https://github.com/pengyu-zhang/CYCLE-Cross-Year-Contrastive-Learning-in-Entity-Linking。

原文摘要 · Abstract (English)

Knowledge graphs constantly evolve with new entities emerging, existing definitions being revised, and entity relationships changing. These changes lead to temporal degradation in entity linking models, characterized as a decline in model performance over time. To address this issue, we propose leveraging graph relationships to aggregate information from neighboring entities across different time periods. This approach enhances the ability to distinguish similar entities over time, thereby minimizing the impact of temporal degradation. We introduce \textbf{CYCLE}: \textbf{C}ross-\textbf{Y}ear \textbf{C}ontrastive \textbf{L}earning for \textbf{E}ntity-Linking. This model employs a novel graph contrastive learning method to tackle temporal performance degradation in entity linking tasks. Our contrastive learning method treats newly added graph relationships as \textit{positive} samples and newly removed ones as \textit{negative} samples. This approach helps our model effectively prevent temporal degradation, achieving a 13.90\% performance improvement over the state-of-the-art from 2023 when the time gap is one year, and a 17.79\% improvement as the gap expands to three years. Further analysis shows that CYCLE is particularly robust for low-degree entities, which are less resistant to temporal degradation due to their sparse connectivity, making them particularly suitable for our method. The code and data are made available at \url{https://github.com/pengyu-zhang/CYCLE-Cross-Year-Contrastive-Learning-in-Entity-Linking}.

实体链接对比学习时间退化知识图谱

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。