arXiv:2604.07937cs.CL2026-04ACL被引 2

用分层分类和验证策略,让大模型更准地跨文档提取关系。

HCRE: LLM-based Hierarchical Classification for Cross-Document Relation Extraction with a Prediction-then-Verification Strategy

论文配图:HCRE: LLM-based Hierarchical Classification for Cross-Document Relation Extraction with a Prediction-then-Verification Strategy
图 1 · 摘自论文原文
  • 大模型分层预测关系,逐级缩小候选集
  • 提出预测-验证策略,降低错误传递风险
  • 适合需要高精度跨文档关系抽取的场景

跨文档关系抽取旨在识别位于不同文档中的头尾实体间的关系。现有方法多采用“小语言模型+分类器”范式,但小模型的语言理解能力有限,制约了性能提升。本文初步探究大语言模型在跨文档关系抽取中的表现,发现尽管参数量大,大模型并未持续优于现有小模型。进一步分析表明,其表现不佳主要源于预定义关系数量庞大带来的挑战。为此,本文提出基于大模型的分层分类框架HCRE,包含两个核心组件:1)用于关系预测的大模型;2)从预定义关系集中构建的分层关系树。该树使大模型可逐级推理目标关系,显著减少每步需考虑的关系选项数。然而,分层分类存在错误传播风险,为此提出“预测-验证”推理策略,在每级进行多视角验证以提升可靠性。大量实验表明,HCRE优于现有基线,验证了其有效性。

原文摘要 · Abstract (English)

Cross-document relation extraction (RE) aims to identify relations between the head and tail entities located in different documents. Existing approaches typically adopt the paradigm of ``\textit{Small Language Model (SLM) + Classifier}''. However, the limited language understanding ability of SLMs hinders further improvement of their performance. In this paper, we conduct a preliminary study to explore the performance of Large Language Models (LLMs) in cross-document RE. Despite their extensive parameters, our findings indicate that LLMs do not consistently surpass existing SLMs. Further analysis suggests that the underperformance is largely attributed to the challenges posed by the numerous predefined relations. To overcome this issue, we propose an LLM-based \underline{H}ierarchical \underline{C}lassification model for cross-document \underline{RE} (HCRE), which consists of two core components: 1) an LLM for relation prediction and 2) a \textit{hierarchical relation tree} derived from the predefined relation set. This tree enables the LLM to perform hierarchical classification, where the target relation is inferred level by level. Since the number of child nodes is much smaller than the size of the entire predefined relation set, the hierarchical relation tree significantly reduces the number of relation options that LLM needs to consider during inference. However, hierarchical classification introduces the risk of error propagation across levels. To mitigate this, we propose a \textit{prediction-then-verification} inference strategy that improves prediction reliability through multi-view verification at each level. Extensive experiments show that HCRE outperforms existing baselines, validating its effectiveness.

大模型关系抽取分层分类跨文档

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。