arXiv:2608.26147cs.CLcs.CV2026-08

解决医学大模型推理中‘答案正确但理由错误’的问题。

CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models

论文配图:CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models
图 1 · 摘自论文原文
  • 基于因果对齐机制筛选高质量推理路径,避免模型学错逻辑。
  • 在多个医疗数据集上显著降低错误推理率,训练更稳定。
  • 适合需要可解释医学推理的AI研究者和临床辅助系统开发者。

大型语言模型在医学推理中展现巨大潜力,但专家标注数据稀缺且成本高昂限制了其发展。尽管强化学习提供了一种可扩展的替代方案,但传统以结果为导向的方法在医学领域常因自回归信用分配失败和梯度方差爆炸而失效,导致模型陷入“答案正确但理由错误”的陷阱——无意中强化虚假相关性与数据捷径而非有效临床推理。为此,本文提出因果对齐推理探索(CARE)框架,其基于两个严格条件构建高质量训练轨迹:因果充分性,通过基于一致性的自我验证机制模拟$do$-calculus干预,有效去偏梯度;近端可学性,采用动态熵边界选择模型最近发展区内的经验,实现方差受限优化。这些严格过滤的经验通过双流目标函数进行优化,结合了在线群体相对探索与难度加权经验回放。在多种多模态和纯文本医疗基准上的大量实验表明,CARE持续优于其他强基线,显著减少正确但不一致的推理,并提升训练稳定性。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown strong potential for medical reasoning, yet the scarcity and cost of expert-annotated data constrain their progress. While reinforcement learning offers a scalable alternative, standard outcome-based methods in medicine often suffer from autoregressive credit assignment failure and gradient variance explosion. This leads to the "Right Answer, Wrong Reason" trap, where models inadvertently reinforce spurious correlations and dataset shortcuts rather than valid clinical deduction. In this work, we propose Causally-Aligned Reasoning Exploration (CARE), a theoretically grounded framework for intrinsic experience curation. CARE is built upon two rigorous conditions for high-quality training trajectories: Causal Sufficiency, which utilizes an agreement-based self-verification mechanism to mimic $do$-calculus interventions and effectively debias gradients; and Proximal Learnability, which employs dynamic entropy bounds to select experiences within the model's zone of proximal development for variance-bounded optimization. These rigorously filtered experiences are optimized via a dual-stream objective that combines on-policy group-relative exploration with difficulty-weighted experience replay. Extensive experiments on diverse medical multimodal and text-only benchmarks demonstrate that CARE consistently outperforms other strong competitors, substantially reducing correct-but-inconsistent reasoning and improving training stability.

医学推理因果学习大模型训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。