arXiv:2502.16484cs.CL2025-02被引 10

用知识图谱微调T5,提升复杂推理与背景理解能力

A Fine-Tuning Approach for T5 Using Knowledge Graphs to Address Complex Tasks

  • 通过引入外部知识图谱增强T5模型的推理和上下文理解
  • 在SQuAD1.1上推理准确率显著优于基线模型,复杂任务表现更优
  • 知识图谱规模越大效果越好,实体与关系嵌入至关重要

随着深度学习发展,大语言模型在自然语言处理任务中取得显著成果,但在复杂推理和背景知识理解方面仍存在局限。为此,本文提出一种基于知识图谱的T5模型微调方法,通过引入外部知识图谱提升模型的推理能力和上下文理解能力。实验采用SQuAD1.1数据集,结果表明,基于知识图谱的T5模型在推理准确率、上下文理解及复杂问题处理能力上均显著优于其他基线模型。同时,研究探索了不同规模知识图谱对模型性能的影响,发现随着知识图谱规模增大,模型性能逐步提升,尤其在复杂任务中,知识图谱显著增强了模型的推理能力。消融实验进一步验证了实体与关系嵌入的重要性,证明完整知识图谱对提升T5模型各项能力至关重要。本研究为增强大语言模型的推理与理解能力提供了有效方法,也为后续研究提供了新方向。

原文摘要 · Abstract (English)

With the development of deep learning technology, large language models have achieved remarkable results in many natural language processing tasks. However, these models still have certain limitations in handling complex reasoning tasks and understanding rich background knowledge. To solve this problem, this study proposed a T5 model fine-tuning method based on knowledge graphs, which enhances the model's reasoning ability and context understanding ability by introducing external knowledge graphs. We used the SQuAD1.1 dataset for experiments. The experimental results show that the T5 model based on knowledge graphs is significantly better than other baseline models in reasoning accuracy, context understanding, and the ability to handle complex problems. At the same time, we also explored the impact of knowledge graphs of different scales on model performance and found that as the scale of the knowledge graph increases, the performance of the model gradually improves. Especially when dealing with complex problems, the introduction of knowledge graphs greatly improves the reasoning ability of the T5 model. Ablation experiments further verify the importance of entity and relationship embedding in the model and prove that a complete knowledge graph is crucial to improving the various capabilities of the T5 model. In summary, this study provides an effective method to enhance the reasoning and understanding capabilities of large language models and provides new directions for future research.

知识图谱T5推理增强微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。