arXiv:2410.00218cs.CLcs.DB2024-10中稿 · IDCC 2024

提升实体消歧透明度,追踪外部知识如何影响模型判断。

T-KAER: Transparency-enhanced Knowledge-Augmented Entity Resolution Framework

  • 通过三个透明性问题设计日志记录机制,追踪知识增强过程。
  • 在引文数据集上验证,可定位被增强的语义信息及其影响路径。
  • 适合关注模型可解释性与错误分析的研究者使用。

实体消歧(ER)是判断两个表示是否指向同一真实世界实体的关键步骤,在数据清洗与数据治理中至关重要。近期研究提出知识增强型实体消歧框架(KAER),通过引入外部知识改进预训练语言模型,但对所引入知识的识别、记录及其对预测贡献的理解仍缺乏关注。本文提出透明性增强的知识增强实体消歧框架(T-KAER),针对三个透明性问题展开:T-Q(1):匹配结果基于输入数据的实验流程是什么?T-Q(2):KAER在原始输入中增强了哪些语义信息?T-Q(3):增强后的输入中哪些语义信息影响了最终预测?T-KAER通过日志文件记录实体消歧全过程以提升透明性。在引文数据集上的实验表明,该框架支持从定量与定性角度进行错误分析,提供了关于‘何种’语义信息被增强以及‘为何’其影响预测差异的实证依据。

原文摘要 · Abstract (English)

Entity resolution (ER) is the process of determining whether two representations refer to the same real-world entity and plays a crucial role in data curation and data cleaning. Recent studies have introduced the KAER framework, aiming to improve pre-trained language models by augmenting external knowledge. However, identifying and documenting the external knowledge that is being augmented and understanding its contribution to the model's predictions have received little to no attention in the research community. This paper addresses this gap by introducing T-KAER, the Transparency-enhanced Knowledge-Augmented Entity Resolution framework. To enhance transparency, three Transparency-related Questions (T-Qs) have been proposed: T-Q(1): What is the experimental process for matching results based on data inputs? T-Q(2): Which semantic information does KAER augment in the raw data inputs? T-Q(3): Which semantic information of the augmented data inputs influences the predictions? To address the T-Qs, T-KAER is designed to improve transparency by documenting the entity resolution processes in log files. In experiments, a citation dataset is used to demonstrate the transparency components of T-KAER. This demonstration showcases how T-KAER facilitates error analysis from both quantitative and qualitative perspectives, providing evidence on "what" semantic information is augmented and "why" the augmented knowledge influences predictions differently.

实体消歧可解释性知识增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。