针对文档级关系抽取数据稀疏和标注偏差问题,提出动态调整分类边距的鲁棒框架。
COMM:Concentrated Margin Maximization for Robust Document-Level Relation Extraction
- 基于实例感知推理动态提取实体对相关特征
- 通过集中式边距最大化提升模型在低质量数据上的性能,增益超10%
- 特别适合处理标注不全、正样本稀缺的真实场景
文档级关系抽取(DocRE)旨在识别跨多句文档中实体间的关系。由于其贴近真实应用场景,近年来受到广泛关注。以往研究主要集中在设计复杂的编码模型以捕捉实体对间的复杂模式,但更基础的挑战在于数据本身:DocRE的数据复杂性导致标注易出错,且正样本极度稀疏,这由正例数量有限和关系类型多样性共同造成。这些因素会引发优化偏差,加剧抽取难度。为此,我们提出一种名为COMM的鲁棒框架。COMM首先采用实例感知推理方法,动态捕捉文档中实体对的相关信息并提取关系特征;随后,考虑关系分布与样本难易度,动态调整预测得分与决策阈值之间的边距,即“集中式边距最大化”。该方法不仅增强了相关特征提取能力,还有效应对了数据带来的挑战。大量实验与分析表明,COMM具有高度通用性与有效性,尤其在低质量数据上表现突出,性能提升超过10%。
原文摘要 · Abstract (English)
Document-level relation extraction (DocRE) is the process of identifying and extracting relations between entities that span multiple sentences within a document. Due to its realistic settings, DocRE has garnered increasing research attention in recent years. Previous research has mostly focused on developing sophisticated encoding models to better capture the intricate patterns between entity pairs. While these advancements are undoubtedly crucial, an even more foundational challenge lies in the data itself. The complexity inherent in DocRE makes the labeling process prone to errors, compounded by the extreme sparsity of positive relation samples, which is driven by both the limited availability of positive instances and the broad diversity of positive relation types. These factors can lead to biased optimization processes, further complicating the task of accurate relation extraction. Recognizing these challenges, we have developed a robust framework called \textit{\textbf{COMM}} to better solve DocRE. \textit{\textbf{COMM}} operates by initially employing an instance-aware reasoning method to dynamically capture pertinent information of entity pairs within the document and extract relational features. Following this, \textit{\textbf{COMM}} takes into account the distribution of relations and the difficulty of samples to dynamically adjust the margins between prediction logits and the decision threshold, a process we call Concentrated Margin Maximization. In this way, \textit{\textbf{COMM}} not only enhances the extraction of relevant relational features but also boosts DocRE performance by addressing the specific challenges posed by the data. Extensive experiments and analysis demonstrate the versatility and effectiveness of \textit{\textbf{COMM}}, especially its robustness when trained on low-quality data (achieves \textgreater 10\% performance gains).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。