让AI主动提问而非被动拒绝,提升人机协作解题能力
Beyond Passive Critical Thinking: Fostering Proactive Questioning to Enhance Human-AI Collaboration
- 提出主动批判性思维,让AI主动向用户索要缺失信息
- 在缺少关键变量的数学题上,小模型准确率从0.15%提升至73.98%
- 适合希望提升AI协作能力的研究者与开发者
批判性思维对构建稳健的AI系统至关重要,可避免其盲目接受错误数据或偏见推理。然而,以往研究多聚焦于被动批判性思维,即模型仅拒绝有问题的请求,而不采取建设性措施。本文提出主动批判性思维范式,使模型能主动向用户索取缺失或澄清信息以更好解决问题。为评估该能力,我们构建了GSM-MC和GSM-MCE两个新基准,基于GSM8K设计,用于测试在信息不全或存在误导条件下的数学推理能力。GSM-MC包含1,368道移除关键变量的数学题,要求模型识别并请求缺失信息;GSM-MCE进一步引入无关细节以检验抗干扰能力。在Qwen3与Llama系列模型上的实验表明,尽管这些模型在传统推理任务中表现优异(得益于大规模后训练与推理时扩展),但在主动批判性思维方面仍显不足,尤其小型模型更为明显。然而,我们证明强化学习(RL)可显著提升该能力:使用改进的强化学习算法,使Qwen3-1.7B在GSM-MC上的准确率从0.15%提升至73.98%。本工作旨在推动更具协作性的智能体,通过主动批判性思维实现更高效的人机问题解决。
原文摘要 · Abstract (English)
Critical thinking is essential for building robust AI systems, preventing them from blindly accepting flawed data or biased reasoning. However, prior work has primarily focused on passive critical thinking, where models simply reject problematic queries without taking constructive steps to address user requests. In this work, we introduce proactive critical thinking, a paradigm where models actively seek missing or clarifying information from users to resolve their queries better. To evaluate this capability, we present GSM-MC and GSM-MCE, two novel benchmarks based on GSM8K for assessing mathematical reasoning under incomplete or misleading conditions. GSM-MC contains 1,368 math problems with a key variable deliberately removed, requiring models to identify and request the missing information. GSM-MCE further increases the difficulty by introducing irrelevant details to test robustness against distractions. Experiments on Qwen3 and Llama series models show that, while these models excel in traditional reasoning tasks due to extensive post-training and inference-time scaling, they struggle with proactive critical thinking, especially smaller ones. However, we demonstrate that reinforcement learning (RL) can significantly improve this ability. Using our enhanced RL algorithm, we achieve substantial gains, boosting the Qwen3-1.7B's accuracy from 0.15% to 73.98% on GSM-MC. We hope this work advances models that collaborate more effectively with users in problem-solving through proactive critical thinking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。