通过苏格拉底式提问,让AI主动追问用户意图,提升指令理解效率。
Closing the Expression Gap in LLM Instructions via Socratic Questioning
- 用信息论设计奖励机制,让AI主动提问以减少意图不确定性。
- 在科学图表生成任务中,效果优于传统方法且对用户水平不敏感。
- 无需人工评分,适合各种背景用户,尤其适合复杂协作场景。
人机协作中的核心瓶颈是‘意图表达鸿沟’,即人类难以有效传达复杂的高维想法给AI,常导致低效的试错循环,且用户专业水平差异加剧此问题。本文将被动指令执行重构为苏格拉底式协作范式,提出名为Nous的智能体,通过主动探查信息来缓解对用户意图的不确定性。其核心机制基于信息论第一性原理,将对话中的信息增益定义为内在奖励信号,等价于结构化任务空间中香农熵的降低。该设计避免依赖昂贵的人工偏好标注或外部奖励模型。为验证框架,我们构建了自动化模拟流水线,生成大规模、基于偏好的科学图表生成数据集。全面实验(包括消融分析、主观与客观评估、跨用户专业水平测试)表明,Nous在效率和输出质量上达到领先水平,且对用户专业程度具有鲁棒性。本研究提供了系统性方法与新视角,应对复杂人机协作中的意图模糊问题。
原文摘要 · Abstract (English)
A fundamental bottleneck in human-AI collaboration is the ``intention expression gap," the difficulty for humans to effectively convey complex, high-dimensional thoughts to AI. This challenge often traps users in inefficient trial-and-error loops and is exacerbated by the diverse expertise levels of users. We reframe this problem from passive instruction following to a Socratic collaboration paradigm, proposing an agent that actively probes for information to resolve its uncertainty about user intent. we name the proposed agent Nous, trained to acquire proficiency in this inquiry policy. The core mechanism of Nous is a training framework grounded in the first principles of information theory. Within this framework, we define the information gain from dialogue as an intrinsic reward signal, which is fundamentally equivalent to the reduction of Shannon entropy over a structured task space. This reward design enables us to avoid reliance on costly human preference annotations or external reward models. To validate our framework, we develop an automated simulation pipeline to generate a large-scale, preference-based dataset for the challenging task of scientific diagram generation. Comprehensive experiments, including ablations, subjective and objective evaluations, and tests across user expertise levels, demonstrate the effectiveness of our proposed framework. Nous achieves leading efficiency and output quality, while remaining robust to varying user expertise. In conclusion, our research provides a systematic methodology and a new perspective for addressing the issue of ambiguous intentions in complex human-machine collaboration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。