arXiv:2502.12614cs.CLcs.AI2025-02NAACL被引 3

提出标签丢弃机制,提升多关系抽取的准确率与泛化能力

Label Drop for Multi-Aspect Relation Modeling in Universal Information Extraction

  • 分层建模不同关系,降低决策混淆
  • 引入标签丢弃,有效抑制无关关系干扰
  • 在9个任务33个数据集上表现领先或持平

通用信息抽取(UIE)因其能有效缓解模型爆炸问题而备受关注。提取式UIE仅需小规模模型即可实现优异性能,应用广泛。现有方法多依赖任务指令,包括单目标与多目标指令。单目标指令仅支持单一关系抽取,难以建模关系间关联,限制复杂关系提取;多目标指令虽可并行抽取多种关系,但无关关系引入决策复杂度,影响准确率。为此,本文提出LDNet,融合多方面关系建模与标签丢弃机制。通过将不同关系分配至不同理解与决策层级,减少决策混淆;标签丢弃机制则有效缓解无关关系的影响。实验表明,LDNet在9项任务、33个数据集上,涵盖单模态与多模态、少样本与零样本场景,均优于或媲美当前最优系统。

原文摘要 · Abstract (English)

Universal Information Extraction (UIE) has garnered significant attention due to its ability to address model explosion problems effectively. Extractive UIE can achieve strong performance using a relatively small model, making it widely adopted. Extractive UIEs generally rely on task instructions for different tasks, including single-target instructions and multiple-target instructions. Single-target instruction UIE enables the extraction of only one type of relation at a time, limiting its ability to model correlations between relations and thus restricting its capability to extract complex relations. While multiple-target instruction UIE allows for the extraction of multiple relations simultaneously, the inclusion of irrelevant relations introduces decision complexity and impacts extraction accuracy. Therefore, for multi-relation extraction, we propose LDNet, which incorporates multi-aspect relation modeling and a label drop mechanism. By assigning different relations to different levels for understanding and decision-making, we reduce decision confusion. Additionally, the label drop mechanism effectively mitigates the impact of irrelevant relations. Experiments show that LDNet outperforms or achieves competitive performance with state-of-the-art systems on 9 tasks, 33 datasets, in both single-modal and multi-modal, few-shot and zero-shot settings.\footnote{https://github.com/Lu-Yang666/LDNet}

信息抽取多关系建模标签丢弃少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。