arXiv:2601.15037cs.CLcs.AI2026-01

通过自修复提示优化,让大模型更准地从文本中提取关系三元组。

Knowledge Restoration-driven Prompt Optimization: Unlocking LLM Potential for Open-Domain Relational Triplet Extraction

  • 用语义一致性反馈自动优化提示,无需人工标注。
  • 在三个基准上平均F1得分领先,提升三元组准确性。
  • 适合做开放域知识抽取的开发者和研究者使用。

开放域关系三元组抽取(ORTE)旨在无预定义关系模式下挖掘结构化知识。大型语言模型(LLMs)通过上下文学习推动了基于提示的抽取范式,但其在不同开放域上下文中的抽取行为难以适配。现有方法依赖固定的手动提示,而输入间语言表达和上下文结构差异大,导致无法支持的三元组产生,且缺乏真实标注使得缺陷难发现与修正。此外,自由形式的关系生成造成非标准关系表面形式,影响知识图谱一致性。为此,我们提出知识恢复驱动的提示优化(KRPO),一种无需标签的目标语料适应框架。KRPO将提取的三元组还原为文本陈述,并评估其与源输入的语义一致性,生成内在反馈以指导批量提示优化。同时引入记忆增强的关系归一化器,将自由形式关系对齐动态更新的模式记忆,提升关系一致性。在三个ORTE基准及多个LLM主干上实验表明,KRPO在各项设置中均取得最佳平均F1分数。

原文摘要 · Abstract (English)

Open-domain Relational Triplet Extraction (ORTE) aims to mine structured knowledge without predefined relation schemas. Large Language Models (LLMs) have advanced ORTE toward a prompt-driven paradigm through powerful in-context learning. However, adapting their extraction behavior to varying open-domain contexts remains challenging. Existing methods typically rely on manually crafted prompts that remain fixed across inputs, despite substantial variation in linguistic expressions and contextual structures. This mismatch may lead to unsupported triplets, while the absence of ground-truth annotations makes such deficiencies difficult to identify and correct. Moreover, free-form relation generation produces non-canonical relation surface forms, undermining knowledge graph consistency. To address these challenges, we propose Knowledge Restoration-driven Prompt Optimization (KRPO), a framework for label-free target-corpus adaptation. KRPO restores extracted triplets into textual statements and evaluates their semantic consistency with the source inputs, deriving intrinsic feedback without gold annotations. This feedback is transformed into natural-language optimization guidance for batch-wise prompt optimization and adaptation. KRPO further introduces a Memory-augmented Relation Canonicalizer that aligns free-form relations with a dynamically updated schema memory, improving relation consistency. Experiments on three ORTE benchmarks with multiple LLM backbones demonstrate strong overall performance, with KRPO achieving the best average F1 score across the evaluated settings.

知识抽取大模型提示优化关系三元组

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。