让大模型通过知识图谱自我进化,持续提升专业领域推理能力。
Way to Specialist: Closing Loop Between Specialized LLM and Evolving Domain Knowledge Graph
- 构建双向增强框架,让大模型与知识图谱相互促进。
- 在5个领域6个数据集上,最高性能提升11.3%。
- 适合需要持续更新专业知识的场景,如医疗、法律等。
大型语言模型(LLMs)在多个领域展现出卓越性能,但通用模型在需要专业知识的推理任务中仍表现不足。以往研究多依赖领域特定训练,需大量数据收集和参数微调。本文提出Way-to-Specialist(WTS)框架,融合检索增强生成与知识图谱(KG),在无需专门训练的情况下提升模型的专业能力。不同于仅使用通用或静态领域知识图谱的单向增强方式,WTS创新性地提出“LLM↔KG”双向增强范式,实现大模型与领域知识图谱(DKG)的协同进化。该框架包含两个紧密耦合组件:基于DKG增强的大模型,用于从知识图谱中检索相关知识以提升推理能力;以及由大模型辅助的领域知识图谱演化机制,通过处理任务生成新知识并更新图谱。该闭环使系统能随着不断回答领域问题而持续优化专业能力。我们在5个领域的6个数据集上验证了该方法,实验结果表明,WTS在4个专业领域超越现有最优水平,最大性能提升达11.3%。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated exceptional performance across a wide variety of domains. Nonetheless, generalist LLMs continue to fall short in reasoning tasks necessitating specialized knowledge. Prior investigations into specialized LLMs focused on domain-specific training, which entails substantial efforts in domain data acquisition and model parameter fine-tuning. To address these challenges, this paper proposes the Way-to-Specialist (WTS) framework, which synergizes retrieval-augmented generation with knowledge graphs (KGs) to enhance the specialized capability of LLMs in the absence of specialized training. In distinction to existing paradigms that merely utilize external knowledge from general KGs or static domain KGs to prompt LLM for enhanced domain-specific reasoning, WTS proposes an innovative "LLM$\circlearrowright$KG" paradigm, which achieves bidirectional enhancement between specialized LLM and domain knowledge graph (DKG). The proposed paradigm encompasses two closely coupled components: the DKG-Augmented LLM and the LLM-Assisted DKG Evolution. The former retrieves question-relevant domain knowledge from DKG and uses it to prompt LLM to enhance the reasoning capability for domain-specific tasks; the latter leverages LLM to generate new domain knowledge from processed tasks and use it to evolve DKG. WTS closes the loop between DKG-Augmented LLM and LLM-Assisted DKG Evolution, enabling continuous improvement in the domain specialization as it progressively answers and learns from domain-specific questions. We validate the performance of WTS on 6 datasets spanning 5 domains. The experimental results show that WTS surpasses the previous SOTA in 4 specialized domains and achieves a maximum performance improvement of 11.3%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。