arXiv:2607.24312cs.CL2026-07

让大模型提取文档关系时保持逻辑一致,避免自相矛盾。

CONSISTRE: A Unified Consistency-Aware Framework for Document-Level Relation Extraction with Large Language Models

论文配图:CONSISTRE: A Unified Consistency-Aware Framework for Document-Level Relation Extraction with Large Language Models
图 1 · 摘自论文原文
  • 用提示工程与自我反思动态校正预测,不需微调
  • 小模型通过知识蒸馏和强化学习逼近大模型一致性
  • 适合想用免费模型实现可靠关系抽取的开发者

文档级关系抽取(DocRE)旨在从长文本中提取多实体间的关联,并保证预测三元组的一致性。尽管大语言模型(LLMs)在信息抽取中展现强大推理能力,但其对每个候选三元组独立生成预测,常违反传递性、对称性和函数唯一性等关系约束,导致输出矛盾不可靠。本文提出CONSISTRE,一种统一的一致性感知框架,包含两个互补路径:一是在推理时对黑盒LLM使用约束提示、基于约束的验证和迭代自我反思,无需任务微调即可优化输出;二是在训练时通过知识蒸馏与强化学习将强教师模型的推理轨迹注入较小开源模型,先经监督微调,再用复合奖励进行GRPO对齐,同时优化抽取性能与关系一致性。在DocRED数据集上的实验表明,两条路径均优于基线,推理路径使用现成黑盒模型即达竞争力F1,训练路径显著缩小7–8B开源模型与顶尖专有模型的差距,且推理成本仅为后者的几分之一。消融实验证实显式建模一致性可有效减少关系矛盾,提升两类部署范式下基于LLM的DocRE可靠性。

原文摘要 · Abstract (English)

Document-level relation extraction (DocRE) aims to extract relations among multiple entities across extended contexts while maintaining consistency across predicted triples. Although large language models (LLMs) show remarkable reasoning capabilities in information extraction, their predictions are typically generated independently for each candidate triple and may violate fundamental relational constraints such as transitivity, symmetry, and functional uniqueness, leading to contradictory and unreliable outputs. We propose CONSISTRE, a unified consistency-aware framework for DocRE that addresses this limitation through two complementary tracks. The first operates at inference time for black-box LLMs, combining constraint-aware prompting, constraint-based verification, and iterative self-reflection to refine predictions without task-specific fine-tuning. The second injects consistency knowledge into smaller open-source models via a knowledge distillation and reinforcement learning pipeline: reasoning traces from a powerful teacher are distilled into a student via supervised fine-tuning, followed by GRPO alignment using a composite reward that jointly optimizes extraction performance and relational consistency. Together, the two tracks cover both API-accessible and locally deployable scenarios under a unified consistency formulation. Experiments on DocRED show that both tracks outperform their baselines, with the inference-time track achieving competitive F1 using off-the-shelf black-box LLMs and the training-time track substantially narrowing the gap between 7--8B open-source models and state-of-the-art proprietary LLMs at a fraction of their inference cost. Ablation studies confirm that explicit consistency modeling mitigates relational contradictions and enhances the reliability of LLM-based DocRE across both deployment paradigms.

关系抽取大模型一致性知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。