arXiv:2507.06895cs.CLcs.AI2025-07

无需微调,用对比学习和贝叶斯kNN实现高效低噪关系抽取。

SCoRE: Streamlined Corpus-based Relation Extraction using Multi-Label Contrastive Learning and Bayesian kNN

  • 融合对比学习与贝叶斯kNN进行多标签分类,无需微调。
  • 在五个基准上超越或持平主流方法,能耗降低显著。
  • 适合需快速部署、适配多种语料的工业级知识图谱构建场景。

为满足利用外部语料高效扩充知识图谱(KG)的需求,特别是在弱监督设置下,本文提出SCoRE——一种模块化、低成本的句子级关系抽取(RE)系统。该系统支持灵活切换预训练语言模型(PLM),无需微调,可无缝适应不同语料和知识图谱。通过结合监督对比学习与贝叶斯k近邻(kNN)分类器进行多标签分类,即使在远程监督语料中存在噪声标注的情况下,仍能保持稳健性能。为改进评估,提出两个新指标:相关结构距离(CSD),衡量学习到的关系模式与知识图谱结构的一致性;精度在前R位(P@R),评估其作为推荐系统的实用性。同时发布Wiki20d基准数据集,模拟真实世界中仅有知识图谱导出标注的RE条件。在五个基准上的实验表明,SCoRE性能达到或超过当前最优方法,且显著降低能耗。进一步分析显示,增加模型复杂度反而导致性能下降,凸显了SCoRE极简设计的优势。综合高效、模块化与可扩展性,SCoRE是真实应用场景下的理想选择。

原文摘要 · Abstract (English)

The growing demand for efficient knowledge graph (KG) enrichment leveraging external corpora has intensified interest in relation extraction (RE), particularly under low-supervision settings. To address the need for adaptable and noise-resilient RE solutions that integrate seamlessly with pre-trained large language models (PLMs), we introduce SCoRE, a modular and cost-effective sentence-level RE system. SCoRE enables easy PLM switching, requires no finetuning, and adapts smoothly to diverse corpora and KGs. By combining supervised contrastive learning with a Bayesian k-Nearest Neighbors (kNN) classifier for multi-label classification, it delivers robust performance despite the noisy annotations of distantly supervised corpora. To improve RE evaluation, we propose two novel metrics: Correlation Structure Distance (CSD), measuring the alignment between learned relational patterns and KG structures, and Precision at R (P@R), assessing utility as a recommender system. We also release Wiki20d, a benchmark dataset replicating real-world RE conditions where only KG-derived annotations are available. Experiments on five benchmarks show that SCoRE matches or surpasses state-of-the-art methods while significantly reducing energy consumption. Further analyses reveal that increasing model complexity, as seen in prior work, degrades performance, highlighting the advantages of SCoRE's minimal design. Combining efficiency, modularity, and scalability, SCoRE stands as an optimal choice for real-world RE applications.

关系抽取低监督知识图谱对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。