用强化学习选对话提示,让大模型更会问出隐藏信息
RPS: Information Elicitation with Reinforcement Prompt Selection

- 把提问过程建模为序列决策,用强化学习动态选提示词
- 在法律对话数据集上,比固定提示提升32%信息获取率
- 适合隐私敏感场景的智能助手、医疗咨询等交互系统
大型语言模型在对话生成和推理方面表现卓越,但在开放式对话中挖掘用户隐含但知晓的信息仍存在局限。在个人助理、教学系统及法律或临床支持等交互式AI应用中,用户常因隐私顾虑、不确定性或社交犹豫而隐瞒敏感信息,导致模型难以获取完整且相关的输入。本文定义了开放式对话中的信息挖掘问题,并提出强化提示选择(RPS)框架,将提示选择建模为序列决策问题。通过设计一个合成实验,验证了强化学习代理相比随机提问基线表现更优,展示了基于策略方法在自适应信息挖掘中的潜力。RPS在预设提示池中学习策略,通过对话自适应地引导用户披露隐蔽或表达不完整的知识。我们还构建了IELegal数据集,基于真实法律案件文档模拟对话式信息挖掘任务,用于发现与案件相关的关键事实。在该任务中,RPS优于静态提示基线,证明了自适应提示选择在提升大模型对话系统信息获取能力方面的有效性。
原文摘要 · Abstract (English)
Large language models (LLMs) have shown remarkable capabilities in dialogue generation and reasoning, yet their effectiveness in eliciting user-known but concealed information in open-ended conversations remains limited. In many interactive AI applications, such as personal assistants, tutoring systems, and legal or clinical support, users often withhold sensitive or uncertain information due to privacy concerns, ambiguity, or social hesitation. This makes it challenging for LLMs to gather complete and contextually relevant inputs. In this work, we define the problem of information elicitation in open-ended dialogue settings and propose Reinforcement Prompt Selection (RPS), a lightweight reinforcement learning framework that formulates prompt selection as a sequential decision-making problem. To analyze this problem in a controlled setting, we design a synthetic experiment, where a reinforcement learning agent outperforms a random query baseline, illustrating the potential of policy-based approaches for adaptive information elicitation. Building on this insight, RPS learns a policy over a pool of prompts to adaptively elicit concealed or incompletely expressed information from users through dialogue. We also introduce IELegal, a new benchmark dataset constructed from real legal case documents, which simulates dialogue-based information elicitation tasks aimed at uncovering case-relevant facts. In this setting, RPS outperforms static prompt baselines, demonstrating the effectiveness of adaptive prompt selection for eliciting critical information in LLM-driven dialogue systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。