arXiv:2510.06240cs.CLcs.AI2025-10被引 1

用知识图谱引导多智能体蒸馏,提升工业问答可靠性。

Knowledge Graph-Guided Multi-Agent Distillation for Reliable Industrial Question Answering with Datasets

  • 将蒸馏建模为马尔可夫决策过程,结合知识图谱增强状态表示。
  • 在工业数据集上准确率最高提升20.1%,比基线高出2.4至20.1个百分点。
  • 适合需要高可信度的工业场景,如设备故障诊断等安全关键任务。

工业问答系统需比通用对话模型具备更高安全性和可靠性,因设备故障诊断等高风险场景中的错误可能带来严重后果。尽管多智能体大模型提升了推理深度,但存在迭代失控、输出不可验证的问题,传统蒸馏方法也难以将协作推理能力迁移至轻量级可部署的学生模型。为此,我们提出知识图谱引导的多智能体系统蒸馏(KG-MASD)。该方法将蒸馏建模为马尔可夫决策过程,并引入知识图谱作为可验证的结构化先验,丰富状态表示并保障收敛性。通过融合协作推理与知识锚定,KG-MASD生成高置信度指令微调数据,联合将推理深度与可验证性蒸馏至适用于边缘部署的紧凑学生模型。在工业问答数据集上的实验表明,相较于基线,KG-MASD准确率提升2.4至20.1个百分点,显著增强系统可靠性,支持在安全关键工业场景中可信部署AI。代码与数据已公开于 https://github.com/erwinmsmith/KG-MAD/。

原文摘要 · Abstract (English)

Industrial question-answering (QA) systems require higher safety and reliability than general-purpose dialogue models, as errors in high-risk scenarios such as equipment fault diagnosis can have severe consequences. Although multi-agent large language models enhance reasoning depth, they suffer from uncontrolled iterations and unverifiable outputs, and conventional distillation methods struggle to transfer collaborative reasoning capabilities to lightweight, deployable student models. To address these challenges, we propose Knowledge Graph-guided Multi-Agent System Distillation (KG-MASD). Our approach formulates distillation as a Markov Decision Process and incorporates a knowledge graph as a verifiable structured prior to enrich state representation and ensure convergence. By integrating collaborative reasoning with knowledge grounding, KG-MASD generates high-confidence instruction-tuning data and jointly distills reasoning depth and verifiability into compact student models suitable for edge deployment. Experiments on an industrial QA dataset show that KG-MASD improves accuracy by 2.4 per cent to 20.1 per cent over baselines and significantly enhances reliability, enabling trustworthy AI deployment in safety-critical industrial scenarios. Code and data are available at https://github.com/erwinmsmith/KG-MAD/.

工业问答多智能体知识图谱模型蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。