arXiv:2501.02196cs.CLcs.AI2025-01

提出对比提示调优方法,实现多关系抽取的精准建模

CPTuning: Contrastive Prompt Tuning for Generative Relation Extraction

  • 通过对比学习构建关系存在概率判断机制
  • 在四个数据集上显著超越现有方法,支持单/多关系场景
  • 适合需要高精度多关系抽取的研究与应用

生成式关系抽取常将任务重构为语言建模问题,并用预训练语言模型(PLM)进行微调。然而现有方法仅假设实体对间存在单一确定关系,忽略真实场景中可能存在的多个有效关系(即实体对重叠),限制了实际应用。为此,本文提出一种新的对比提示调优方法CPTuning,通过学习候选关系在上下文中的存在概率是否高于或低于阈值,来判断其有效性。CPTuning不仅学习关系模式,还将抽取任务转化为显式关系生成,并采用字典树(Trie)约束解码以确保生成结果的有效性。推理时自适应筛选高置信度候选关系,实现多关系抽取。在四个常用数据集上的实验表明,使用CPTuning微调的T5-large模型,在单关系和多关系抽取任务中均显著优于以往方法。

原文摘要 · Abstract (English)

Generative relation extraction (RE) commonly involves first reformulating RE as a linguistic modeling problem easily tackled with pre-trained language models (PLM) and then fine-tuning a PLM with supervised cross-entropy loss. Although having achieved promising performance, existing approaches assume only one deterministic relation between each pair of entities without considering real scenarios where multiple relations may be valid, i.e., entity pair overlap, causing their limited applications. To address this problem, we introduce a novel contrastive prompt tuning method for RE, CPTuning, which learns to associate a candidate relation between two in-context entities with a probability mass above or below a threshold, corresponding to whether the relation exists. Beyond learning schema, CPTuning also organizes RE as a verbalized relation generation task and uses Trie-constrained decoding to ensure a model generates valid relations. It adaptively picks out the generated candidate relations with a high estimated likelihood in inference, thereby achieving multi-relation extraction. We conduct extensive experiments on four widely used datasets to validate our method. Results show that T5-large fine-tuned with CPTuning significantly outperforms previous methods, regardless of single or multiple relations extraction.

关系抽取提示调优多关系生成式

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。