用大模型生成旅游意图数据,让系统能主动理解游客隐含需求
A Data Synthesis Method Driven by Large Language Models for Proactive Mining of Implicit User Intentions in Tourism
- 构建用户与助手双代理模拟对话,基于中文旅游网站种子数据
- 生成带显式推理的合成数据集,使模型可主动挖掘隐含意图
- 适合做智能客服、旅游推荐系统的研发人员参考
在旅游领域,大语言模型常难以从游客模糊提问中挖掘隐含意图,且缺乏主动引导用户澄清需求的能力。核心瓶颈在于高质量训练数据稀缺,现有方法存在领域适配不足、初始询问细节分布不均、隐含意图模块上下文冗余、未显式建模游客情绪与意图价值等问题。为此,我们提出 SynPT(一种由大模型驱动的旅游隐含意图主动挖掘数据合成方法),通过构建用户代理与助手代理,基于中国旅游网站收集的种子数据模拟对话,生成包含显式推理过程的 SynPT-Dialog 数据集。该数据集用于微调通用大模型,使其具备主动挖掘隐含意图的能力。人类与大模型双重评估均验证 SynPT 的优越性。我们分析关键超参数并提供案例研究,展示方法在英文场景下的可迁移性。所有代码与数据公开。
原文摘要 · Abstract (English)
In the tourism domain, Large Language Models (LLMs) often struggle to mine implicit user intentions from tourists' ambiguous inquiries and lack the capacity to proactively guide users toward clarifying their needs. A critical bottleneck is the scarcity of high-quality training datasets that facilitate proactive questioning and implicit intention mining. While recent advances leverage LLM-driven data synthesis to generate such datasets and transfer specialized knowledge to downstream models, existing approaches suffer from several shortcomings: (1) lack of adaptation to the tourism domain, (2) skewed distributions of detail levels in initial inquiries, (3) contextual redundancy in the implicit intention mining module, and (4) lack of explicit thinking about tourists' emotions and intention values. Therefore, we propose SynPT (A Data Synthesis Method Driven by LLMs for Proactive Mining of Implicit User Intentions in the Tourism), which constructs an LLM-driven user agent and assistant agent to simulate dialogues based on seed data collected from Chinese tourism websites. This approach addresses the aforementioned limitations and generates SynPT-Dialog, a training dataset containing explicit reasoning. The dataset is utilized to fine-tune a general LLM, enabling it to proactively mine implicit user intentions. Experimental evaluations, conducted from both human and LLM perspectives, demonstrate the superiority of SynPT compared to existing methods. Furthermore, we analyze key hyperparameters and present case studies to illustrate the practical applicability of our method, including discussions on its adaptability to English-language scenarios. All code and data are publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。