提出可解释的关系三元组抽取方法,让模型决策过程透明可追溯。
SMARTe: Slot-based Method for Accountable Relational Triple extraction
- 用槽注意力机制将信息聚合到独立槽中,实现内部机制可追踪。
- 在NYT和WebNLG数据集上达到顶尖性能,且不牺牲准确性。
- 适合关注模型可解释性的NLP研究者与工业落地应用。
关系三元组抽取(RTE)是自然语言处理的基础任务。然而,以往研究主要聚焦于提升模型性能,较少关注其内部机制的理解。许多现有方法依赖复杂预处理来诱导特定交互,导致系统不透明,且可能与理论基础不一致。为此,我们提出SMARTe:一种基于槽的可问责关系三元组抽取方法。SMARTe通过槽注意力机制引入内在可解释性,并将任务建模为集合预测问题。槽注意力将相关信息凝聚到不同槽中,确保每个预测均可明确追溯至对应的槽表示及其贡献的词元。在保持可解释性的同时,SMARTe实现了与当前最优模型相当的性能。在NYT和WebNLG数据集上的评估表明,加入可解释性并未损害性能。此外,我们通过注意力热图对SMARTe提供的解释进行了定性分析。最后,我们讨论了研究发现并提出了未来方向。代码已开源:https://github.com/Chen-XueWen/SMARTe。
原文摘要 · Abstract (English)
Relational Triple Extraction (RTE) is a fundamental task in Natural Language Processing (NLP). However, prior research has primarily focused on optimizing model performance, with limited efforts to understand the internal mechanisms driving these models. Many existing methods rely on complex preprocessing to induce specific interactions, often resulting in opaque systems that may not fully align with their theoretical foundations. To address these limitations, we propose SMARTe: a Slot-based Method for Accountable Relational Triple extraction. SMARTe introduces intrinsic interpretability through a slot attention mechanism and frames the task as a set prediction problem. Slot attention consolidates relevant information into distinct slots, ensuring all predictions can be explicitly traced to learned slot representations and the tokens contributing to each predicted relational triple. While emphasizing interpretability, SMARTe achieves performance comparable to state-of-the-art models. Evaluations on the NYT and WebNLG datasets demonstrate that adding interpretability does not compromise performance. Furthermore, we conducted qualitative assessments to showcase the explanations provided by SMARTe, using attention heatmaps that map to their respective tokens. We conclude with a discussion of our findings and propose directions for future research. Our code is available at https://github.com/Chen-XueWen/SMARTe.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。