arXiv:2508.13514cs.CLcs.AI2025-08ACL被引 13

让医疗大模型主动提问,减少误诊风险

ProMed: Shapley Information Gain Guided Reinforcement Learning for Proactive Medical LLMs

  • 用博弈论衡量问题价值,选最该问的问题
  • 在部分信息场景下平均性能提升6.29%
  • 适合需要主动问诊的临床决策系统

临床问诊中主动获取信息至关重要,但现有医疗大模型多为被动应答,易因信息不足导致误诊。为此,我们提出ProMed,一种基于强化学习的主动问诊框架,使大模型在决策前主动提出有临床价值的问题。核心是Shapley信息增益(SIG)奖励,通过Shapley值评估问题的上下文重要性,量化其新获取信息量。采用两阶段训练:(1) 使用蒙特卡洛树搜索构建高回报交互轨迹用于监督初始化;(2) 引入新型SIG引导奖励分布机制,优先优化高信息量问题。在部分信息医疗基准测试中,ProMed平均性能优于现有方法6.29%,相较被动模式提升54.45%,且对域外数据泛化能力强。代码已开源。

原文摘要 · Abstract (English)

Interactive medical questioning is essential in clinical consultations, where physicians must actively gather necessary patient information. Yet existing medical Large Language Models (LLMs) predominantly follow a reactive paradigm, risking diagnostic errors by answering before seeking sufficient details. To bridge this gap, we propose ProMed, a reinforcement learning framework that transitions LLMs toward a proactive paradigm, enabling them to ask clinically valuable questions before decision-making. Central to ProMed is the Shapley Information Gain (SIG) reward, which quantifies a question's clinical utility as the amount of newly acquired information, while considering its contextual importance via Shapley values. We integrate SIG into a two-stage training pipeline: (1) SIG-Guided Model Initialization uses Monte Carlo Tree Search to construct high-reward interaction trajectories for supervision, and (2) SIG-Augmented Policy Optimization, with a novel SIG-guided Reward Distribution Mechanism that prioritizes informative questions for fine-grained optimization. Experiments on partial-information medical benchmarks show that ProMed significantly outperforms state-of-the-art methods by 6.29% on average and delivers a 54.45% gain over the reactive paradigm, and generalizes robustly to out-of-domain cases. Our codes are available at https://github.com/hxxding/ProMed.

医疗AI主动问诊强化学习大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。