用知识图谱生成专业领域对话,提升质量与覆盖
ProKG-Dial: Progressive Multi-Turn Dialogue Construction with Domain Knowledge Graphs
- 基于领域知识图谱分步构建对话,确保主题聚焦
- 在医疗图谱上生成对话,实体覆盖率超90%且语义连贯
- 适合需要高质量专业对话数据的研究者与开发者
当前大语言模型在通用自然语言任务中表现优异,但在专业场景中缺乏领域精确性。构建高质量的领域多轮对话数据集对开发专用对话系统至关重要。然而,现有方法如人工标注、模拟人类交互或基于角色的对话生成,普遍存在资源消耗大或对话质量与领域覆盖不足的问题。为此,我们提出 ProKG-Dial,一种基于领域知识图谱(KG)的渐进式多轮对话生成框架。该框架首先通过社区检测将知识图谱划分为语义一致的子图,再针对每个子图中的目标实体逐步生成一系列相关问答,确保内容相关性与覆盖度。随后采用严格过滤机制保证对话质量。我们在医疗知识图谱上验证该方法,评估生成对话的多样性、语义连贯性及实体覆盖率。此外,将基础大模型在此数据集上微调后,与多个基线对比。自动指标与人工评估均表明,ProKG-Dial 显著提升了对话质量和领域性能,证明其有效性和实用性。
原文摘要 · Abstract (English)
Current large language models (LLMs) excel at general NLP tasks but often lack domain specific precision in professional settings. Building a high quality domain specific multi turn dialogue dataset is essential for developing specialized conversational systems. However, existing methods such as manual annotation, simulated human LLM interactions, and role based LLM dialogues are resource intensive or suffer from limitations in dialogue quality and domain coverage. To address these challenges, we introduce ProKG Dial, a progressive framework for constructing knowledge intensive multi turn dialogue datasets using domain specific knowledge graphs (KGs). ProKG Dial leverages the structured nature of KGs to encode complex domain knowledge and relationships, providing a solid foundation for generating meaningful and coherent dialogues. Specifically, ProKG Dial begins by applying community detection to partition the KG into semantically cohesive subgraphs. For each subgraph, the framework incrementally generates a series of questions and answers centered around a target entity, ensuring relevance and coverage. A rigorous filtering step is employed to maintain high dialogue quality. We validate ProKG Dial on a medical knowledge graph by evaluating the generated dialogues in terms of diversity, semantic coherence, and entity coverage. Furthermore, we fine tune a base LLM on the resulting dataset and benchmark it against several baselines. Both automatic metrics and human evaluations demonstrate that ProKG Dial substantially improves dialogue quality and domain specific performance, highlighting its effectiveness and practical utility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。