让大模型生成可解释的时间推理,通过图结构增强文本理解。
Towards Explainable Temporal Reasoning in Large Language Models: A Structure-Aware Generative Framework
- 用时间知识图谱融合结构信息,提升推理可解释性。
- 在多个时间粒度任务上超越现有方法,准确率显著提升。
- 适合研究可解释AI、时间推理或大模型应用的学者使用。
尽管大语言模型在时间推理方面展现出巨大潜力,但现有工作多聚焦于提升性能,忽视了结果背后的可解释推理过程。为填补这一空白,我们构建了一个涵盖多种时间粒度的综合性基准,系统评估大模型在可解释时间推理方面的能力。实验发现,仅依赖文本信息时,大模型难以生成令人信服的解释。为此,我们提出GETER——一种结构感知的生成框架,将图结构与文本信息结合以实现可解释的时间推理。具体而言,首先利用时间知识图谱构建时间编码器,捕捉查询的结构信息;然后引入结构-文本前缀适配器,将图结构特征映射至文本嵌入空间;最后,大模型通过融合软图标记与指令微调提示标记,生成解释性文本。实验表明,GETER不仅达到当前最佳性能,还展现出强大的泛化能力。数据集与代码已开源。
原文摘要 · Abstract (English)
While large language models (LLMs) show great potential in temporal reasoning, most existing work focuses heavily on enhancing performance, often neglecting the explainable reasoning processes underlying the results. To address this gap, we introduce a comprehensive benchmark covering a wide range of temporal granularities, designed to systematically evaluate LLMs' capabilities in explainable temporal reasoning. Furthermore, our findings reveal that LLMs struggle to deliver convincing explanations when relying solely on textual information. To address challenge, we propose GETER, a novel structure-aware generative framework that integrates Graph structures with text for Explainable TEmporal Reasoning. Specifically, we first leverage temporal knowledge graphs to develop a temporal encoder that captures structural information for the query. Subsequently, we introduce a structure-text prefix adapter to map graph structure features into the text embedding space. Finally, LLMs generate explanation text by seamlessly integrating the soft graph token with instruction-tuning prompt tokens. Experimental results indicate that GETER achieves state-of-the-art performance while also demonstrating its effectiveness as well as strong generalization capabilities. Our dataset and code are available at https://github.com/carryTatum/GETER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。