arXiv:2504.04204cs.CLcs.AI2025-04ICML被引 8

让大模型主动提问,更准地猜出隐藏信息

Adaptive Elicitation of Latent Information Using Natural Language

  • 用元学习语言模型模拟未来回答,动态评估提问效果
  • 在20个问题游戏等任务中显著减少未知信息,提升预测准确率
  • 适合需要精准探查用户意图或知识状态的交互系统

在评估学生学习成果、疾病诊断或用户偏好等场景中,通过自然语言获取信息以降低对隐含实体的不确定性至关重要。尽管自然语言是强大媒介,但大语言模型(LLMs)及现有微调算法缺乏策略性信息收集机制。为此,我们提出一种自适应信息获取框架,主动减少对隐含实体的不确定性。由于难以对抽象隐含实体进行概率建模,该框架采用预测视角的不确定性量化,利用元学习语言模型模拟未来观测,实现复杂自然语言下的可扩展不确定性估计。通过自回归前向模拟,模型量化新问题如何降低认知不确定性,从而生成高信息量的后续提问策略。在20个问题游戏、动态意见调查和自适应学生评估实验中,该方法持续优于基线,在识别关键未知项和提升下游预测性能方面表现优异,展示了自然语言环境下战略信息获取的潜力。

原文摘要 · Abstract (English)

Eliciting information to reduce uncertainty about a latent entity is a critical task in many application domains, e.g., assessing individual student learning outcomes, diagnosing underlying diseases, or learning user preferences. Though natural language is a powerful medium for this purpose, large language models (LLMs) and existing fine-tuning algorithms lack mechanisms for strategically gathering information to refine their own understanding of the latent entity. To harness the generalization power and world knowledge of LLMs in developing effective information-gathering strategies, we propose an adaptive elicitation framework that actively reduces uncertainty on the latent entity. Since probabilistic modeling of an abstract latent entity is difficult, our framework adopts a predictive view of uncertainty, using a meta-learned language model to simulate future observations and enable scalable uncertainty quantification over complex natural language. Through autoregressive forward simulation, our model quantifies how new questions reduce epistemic uncertainty, enabling the development of sophisticated information-gathering strategies to choose the most informative next queries. In experiments on the 20 questions game, dynamic opinion polling, and adaptive student assessment, our method consistently outperforms baselines in identifying critical unknowns and improving downstream predictions, illustrating the promise of strategic information gathering in natural language settings.

信息获取大模型应用自适应问答

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。