用自然语言交互构建私有知识图谱,让大模型问答更准更可靠。
AGENTiGraph: An Interactive Knowledge Graph Platform for LLM-based Chatbots Utilizing Private Data
- 多智能体架构动态理解用户意图并实时更新知识图谱
- 在3500个测试用例中任务分类准确率达95.12%,执行成功率90.45%
- 适合需要高精度问答的法律、医疗等专业领域使用
大型语言模型在各类应用中展现出强大能力,但在复杂领域任务如问答时仍存在幻觉、推理能力有限和事实不一致等问题。尽管知识图谱有助于缓解这些问题,但将大模型与背景知识图谱集成的研究仍较有限,尤其在用户可访问性和知识图谱灵活性方面尚未充分探索。我们提出AGENTiGraph(基于任务交互与图形化表示的自适应生成引擎),一个通过自然语言实现知识管理的平台。该平台融合知识抽取、整合与实时可视化功能。AGENTiGraph采用多智能体架构,动态解析用户意图、管理任务并整合新知识,确保对不断变化的用户需求与数据环境具有适应性。实验结果表明,在包含3,500个测试用例的数据集上,其在知识图谱交互中表现优异,显著优于现有零样本基线方法,任务分类准确率达到95.12%,任务执行成功率为90.45%。用户研究进一步验证了其在真实场景中的有效性。为展示其通用性,我们将AGENTiGraph扩展至立法与医疗领域,构建了可回答复杂法律与医学问题的专业知识图谱。
原文摘要 · Abstract (English)
Large Language Models~(LLMs) have demonstrated capabilities across various applications but face challenges such as hallucination, limited reasoning abilities, and factual inconsistencies, especially when tackling complex, domain-specific tasks like question answering~(QA). While Knowledge Graphs~(KGs) have been shown to help mitigate these issues, research on the integration of LLMs with background KGs remains limited. In particular, user accessibility and the flexibility of the underlying KG have not been thoroughly explored. We introduce AGENTiGraph (Adaptive Generative ENgine for Task-based Interaction and Graphical Representation), a platform for knowledge management through natural language interaction. It integrates knowledge extraction, integration, and real-time visualization. AGENTiGraph employs a multi-agent architecture to dynamically interpret user intents, manage tasks, and integrate new knowledge, ensuring adaptability to evolving user requirements and data contexts. Our approach demonstrates superior performance in knowledge graph interactions, particularly for complex domain-specific tasks. Experimental results on a dataset of 3,500 test cases show AGENTiGraph significantly outperforms state-of-the-art zero-shot baselines, achieving 95.12\% accuracy in task classification and 90.45\% success rate in task execution. User studies corroborate its effectiveness in real-world scenarios. To showcase versatility, we extended AGENTiGraph to legislation and healthcare domains, constructing specialized KGs capable of answering complex queries in legal and medical contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。