用隐马尔可夫+大模型生成连贯多轮对话,提升跨语言意图识别效果
From Intents to Conversations: Generating Intent-Driven Dialogues with Contrastive Learning for Multi-Turn Classification
- 结合真实电商对话提取意图转移模式,用大模型生成符合上下文的自然话语
- 在多轮意图分类任务中准确率达87.3%,跨语言场景下性能优于基线
- 适合做对话系统、意图识别研究者,尤其关注少标注数据场景
在对话式AI系统中,训练高效多轮意图分类模型的关键挑战在于大规模、领域特定、多语言对话数据集的构建。本文提出Chain-of-Intent框架,将隐马尔可夫模型(HMM)与大语言模型(LLM)结合,通过自对弈方式生成以意图驱动、具备上下文感知能力的对话。首先从真实电商聊天日志中提取领域特定的意图转移模式,指导回合级动态与意图序列建模;随后利用LLM参数化HMM的发射概率,生成与预测意图和对话上下文一致的自然语句。我们还提出MINT-CL多任务对比学习框架,用于多轮意图分类,显著提升性能同时降低对大规模标注数据的依赖。实验表明,该方法在对话生成质量与分类准确率上均优于现有基线,尤其在多语言场景表现突出。为促进后续研究,我们发布MINT-E——一个源自电商领域的综合性、多语言、意图感知的多轮对话语料库。
原文摘要 · Abstract (English)
In conversational AI systems, a critical challenge in training effective multi-turn intent classification models lies in the generation of large-scale, domain-specific, multilingual dialogue datasets. In this paper, we introduce Chain-of-Intent, a novel framework that integrates Hidden Markov Models (HMMs) with Large Language Models (LLMs) to generate intent-driven, context-aware dialogues through self-play. Our method first extracts domain-specific intent transition patterns from real-world e-commerce chat logs, which guide the modeling of turn-level dynamics and intent sequences. LLMs are then employed to parameterize the emission probabilities of HMMs, enabling the generation of natural, coherent utterances aligned with predicted intents and dialogue context. We also propose MINT-CL, a multi-task contrastive learning framework for multi-turn intent classification, which improves performance while reducing dependence on large-scale annotated datasets. Empirical results demonstrate that our approach outperforms competitive baselines in dialogue generation quality and classification accuracy, particularly in multilingual settings. To facilitate future research, we release MINT-E, a comprehensive, multilingual, intent-aware multi-turn dialogue corpus derived from the e-commerce domain\footnote{The reproduced source code and dataset are available at https://github.com/junhua/chain-of-intent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。