用大模型生成用户意图推理数据,提升对话预测准确性。
LLM-Driven Preference Data Synthesis for Proactive Prediction of the Next User Utterance in Human-Machine Dialogue
- 构建意图树并从探索与利用角度预测下一步对话路径
- 通过修改意图路径生成偏好与非偏好推理过程,增强数据多样性
- 在4个数据集上优于现有方法,适合对话系统研发者
主动预测人机对话中用户的下一句可提升交互效率与体验。现有商业API存在隐私问题,本地部署通用大模型又计算成本高。因此,训练小型专用大模型是可行方案。尽管用户模拟方法能预测用户下一句,但多仅模仿表达风格,未能推进对话。已有研究尝试通过偏好数据合成提升主动预测能力,但缺乏对导致用户下一句的意图推理过程的显式建模,也未定义和生成偏好与非偏好推理路径。为此,本文提出ProUtt:一种基于大模型的偏好数据合成方法,将对话历史转化为意图树,从探索与利用双视角预测未来可能路径,并通过扰动或修正意图树路径生成偏好与非偏好推理过程。在四个基准数据集上,经大模型评判与人工评估,ProUtt持续优于现有数据合成方法、用户模拟器及商业API。代码与合成数据集已开源,以促进后续研究。
原文摘要 · Abstract (English)
Proactively predicting a users next utterance in human-machine dialogue can streamline interaction and improve user experience. Existing commercial API-based solutions are subject to privacy concerns while deploying general-purpose LLMs locally remains computationally expensive. As such, training a compact, task-specific LLM provides a practical alternative. Although user simulator methods can predict a user's next utterance, they mainly imitate their speaking style rather than advancing the dialogue. Preference data synthesis has been investigated to generate data for proactive next utterance prediction and help align LLMs with user preferences. Yet existing methods lack the ability to explicitly model the intent reasoning that leads to the user's next utterance and to define and synthesize preference and non-preference reasoning processes for predicting the user's next utterance.To address these challenges, we propose ProUtt, an LLM-driven preference data synthesis method for proactive next utterance prediction. ProUtt converts dialogue history into an intent tree and explicitly models intent reasoning trajectories by predicting the next plausible path from both exploitation and exploration perspectives. It then constructs preference and non-preference reasoning processes by perturbing or revising intent tree paths at different future turns. Extensive evaluations using LLM-as-a-judge and human judgments demonstrate that ProUtt consistently outperforms existing data synthesis methods, user simulators, and commercial LLM APIs across four benchmark datasets. We release both the code and the synthesized datasets to facilitate future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。