arXiv:2506.02126cs.CL2025-06被引 15

拆解大模型推理过程,发现医学推理需知识与逻辑双提升

Knowledge or Reasoning? A Close Look at How LLMs Think Across Domains

  • 将推理分解为知识使用与逻辑推演两部分,量化评估其质量
  • 微调降低推理质量38.9%,强化学习能剔除错误知识提升医学推理
  • 适合研究模型可解释性、医疗AI开发的学者与工程师参考

近年来,如OpenAI-o1/3和DeepSeek-R1等增强推理能力的大语言模型在复杂任务上表现显著提升。然而其内部推理过程的质量与透明度仍不明确。本文超越最终答案准确率,聚焦医学与数学领域的逐步推理,将思维轨迹细分为知识使用与推理质量两部分。提出一种精细评估框架:(1) 知识正确性(知识指数KI);(2) 推理质量(信息增益InfoGain)。研究经监督微调(SFT)和/或强化学习(RL)训练的R1蒸馏版与基础Qwen模型。发现:(1) R1蒸馏模型的通用推理能力无法有效迁移至医学领域;(2) SFT虽提升两领域准确率,但推理质量平均下降38.9%;医学领域中,知识不可或缺,故仍需SFT;(3) RL通过剔除推理路径中的错误或无关知识,同时提升医学推理准确率与知识正确性。

原文摘要 · Abstract (English)

Recent advances in reasoning-enhanced Large Language Models such as OpenAI-o1/3 and DeepSeek-R1 have significantly improved performance on complex tasks. However, the quality and transparency of their internal reasoning processes remain underexplored. This work moves beyond the final-answer accuracy and investigates step-by-step reasoning in the medical and mathematical domains by explicitly decomposing the thinking trajectories into two parts: knowledge and reasoning. Specifically, we introduce a fine-grained evaluation framework that judges: (1) the correctness of knowledge used (measured by Knowledge Index (KI)) and (2) the quality of reasoning (measured by Information Gain (InfoGain)). Using this framework, we study R1-distilled and base Qwen models trained with supervised fine-tuning (SFT) and/or reinforcement learning (RL) in the medical and math domains. Three intriguing findings emerge: (1) The general reasoning abilities in R1-distilled models do not transfer effectively to the medical domain through either SFT or RL. (2) SFT raises final-answer accuracy in both domains, but often at the cost of reasoning quality: InfoGain drops by 38.9% on average compared with untrained models; In the medical domain, however, SFT remains crucial because domain knowledge is indispensable. (3) RL enhances medical reasoning by pruning inaccurate or irrelevant knowledge from reasoning paths, thereby improving both reasoning accuracy and knowledge correctness.

大模型推理知识评估强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。