让对话问题主动引导走向目标,提升问答系统引导力
PCQPR: Proactive Conversational Question Planning with Reflection
- 用大模型+蒙特卡洛树搜索规划未来对话,主动设计问题
- 能有效生成导向指定结论的问题对,优于传统方法
- 适合教育、客服等需引导式交互的场景
对话式问题生成(CQG)可提升教育、客服、娱乐等领域问答系统的互动性。但传统CQG仅关注当前上下文,缺乏前瞻性,难以引导对话达成预设目标。本文将CQG重新定义为以结论为导向的对话问题生成(CCQG),提出一种名为PCQPR的新方法——通过融合蒙特卡洛树搜索(MCTS)启发的规划算法与大语言模型(LLM)的分析能力,预测未来对话轮次并持续优化提问策略。该迭代自修正机制确保生成的问题在语境相关的基础上,具备战略导向性,能够有效推动对话向指定结果发展。大量实验表明,PCQPR显著超越现有方法,标志着对话问答系统向目标导向范式的转变。
原文摘要 · Abstract (English)
Conversational Question Generation (CQG) enhances the interactivity of conversational question-answering systems in fields such as education, customer service, and entertainment. However, traditional CQG, focusing primarily on the immediate context, lacks the conversational foresight necessary to guide conversations toward specified conclusions. This limitation significantly restricts their ability to achieve conclusion-oriented conversational outcomes. In this work, we redefine the CQG task as Conclusion-driven Conversational Question Generation (CCQG) by focusing on proactivity, not merely reacting to the unfolding conversation but actively steering it towards a conclusion-oriented question-answer pair. To address this, we propose a novel approach, called Proactive Conversational Question Planning with self-Refining (PCQPR). Concretely, by integrating a planning algorithm inspired by Monte Carlo Tree Search (MCTS) with the analytical capabilities of large language models (LLMs), PCQPR predicts future conversation turns and continuously refines its questioning strategies. This iterative self-refining mechanism ensures the generation of contextually relevant questions strategically devised to reach a specified outcome. Our extensive evaluations demonstrate that PCQPR significantly surpasses existing CQG methods, marking a paradigm shift towards conclusion-oriented conversational question-answering systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。