用大模型生成高质量对话数据,解决低资源场景训练难题。
DiaSynth: Synthetic Dialogue Generation Framework for Low Resource Dialogue Applications
- 基于大模型和思维链推理,生成带角色设定的多样化对话。
- 合成数据使模型在对话摘要任务上提升16.47%,达真实数据90.48%性能。
- 适用于缺乏标注数据的领域,如医疗、客服等低资源对话系统开发。
领域特定对话数据稀缺制约了对话系统的发展。现有研究受限于通用或小众数据集,规模不足。为此,我们提出DiaSynth——一种合成对话生成框架,可跨多个领域生成高质量、上下文丰富的对话。不同于以往方法,DiaSynth利用大语言模型(LLMs)与思维链(CoT)推理,生成具有模拟人物设定和多样对话特征的动态对话。实验中,使用DialogSum和SAMSum的少量示例,通过不同规模的LLM生成合成数据。在合成数据上微调的预训练模型在对话摘要任务上比基线模型提升16.47%;与领域内真实数据相比,合成数据可达到其90.48%的性能分布。随着模型规模从3B增至8B,生成数据质量持续提升。结果验证了DiaSynth作为传统数据收集方式的可靠替代方案。代码与生成数据已开源,供后续研究使用。
原文摘要 · Abstract (English)
The scarcity of domain-specific dialogue datasets limits the development of dialogue systems across applications. Existing research is constrained by general or niche datasets that lack sufficient scale for training dialogue systems. To address this gap, we introduce DiaSynth - a synthetic dialogue generation framework capable of generating high-quality, contextually rich dialogues across a wide range of domains. Unlike existing frameworks, DiaSynth uses Large Language Models (LLMs) and Chain of Thought (CoT) reasoning to generate dynamic, domain-specific dialogues with simulated personas and diverse conversational features. We perform our experiments by generating synthetic data using different LLMs and few-shot examples from DialogSum and SAMSum. The pretrained language models fine-tuned on the synthetic data outperform the base models by 16.47% on dialogue summarization, while the comparison between models fine-tuned on in-domain data and synthetic data shows that the synthetic data is able to capture 90.48% of the performance distribution of the in-domain data on dialogue summarization. The quality of the data generated also increases as we increase the size of LLM from 3B to 8B. These results validate DiaSynth's potential as a robust alternative to traditional data collection methods. We open source the code and data generated for future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。