arXiv:2512.20074cs.AIcs.CL2025-12中稿 · LREC 2026被引 1

用两阶段训练让医学AI既准又会解释,还能少用人工标注。

Reason2Decide: Rationale-Driven Multi-Task Learning

  • 分两阶段训练:先学写理由,再联合学预测和理由,逐步过渡到自生成。
  • 在三组医疗数据上,预测准确率和解释一致性均优于现有方法。
  • 仅用大模型生成的理由预训练,40倍小的模型也能达到好效果。

尽管大型语言模型(LLM)广泛应用,临床决策支持系统仍面临挑战:既要高预测准确率,又要生成与预测一致的解释。现有方法存在暴露偏差,导致解释错位。我们提出Reason2Decide,一种两阶段训练框架,解决自理性中的关键问题,包括暴露偏差和任务分离。第一阶段,模型仅训练生成理由;第二阶段,联合训练标签预测与理由生成,并使用计划采样逐步从依赖真实标签过渡到模型自身预测。我们在三个医疗数据集上评估,包括一个专有分诊数据集和公开生物医学问答数据集。结果表明,无论模型大小,Reason2Decide在预测(F1)和理由保真度(BERTScore、BLEU、LLM作为裁判)方面均优于其他微调基线及部分零样本大模型。在分诊任务中,Reason2Decide对不同来源的理由(大模型生成、护士撰写、护士后处理)均具鲁棒性。实验显示,仅使用大模型生成的理由进行第一阶段训练时,Reason2Decide表现优于其他微调变体,表明大模型生成理由适用于预训练,降低对人工标注的依赖。值得注意的是,Reason2Decide以比当前基础模型小40倍的规模,实现了性能提升,使临床推理在资源受限场景下更具可部署性,同时提供可解释的决策支持。

原文摘要 · Abstract (English)

Despite the wide adoption of Large Language Models (LLM)s, clinical decision support systems face a critical challenge: achieving high predictive accuracy while generating explanations aligned with the predictions. Current approaches suffer from exposure bias leading to misaligned explanations. We propose Reason2Decide, a two-stage training framework that addresses key challenges in self-rationalization, including exposure bias and task separation. In Stage-1, our model is trained on rationale generation, while in Stage-2, we jointly train on label prediction and rationale generation, applying scheduled sampling to gradually transition from conditioning on gold labels to model predictions. We evaluate Reason2Decide on three medical datasets, including a proprietary triage dataset and public biomedical QA datasets. Across model sizes, Reason2Decide outperforms other fine-tuning baselines and some zero-shot LLMs in prediction (F1) and rationale fidelity (BERTScore, BLEU, LLM-as-a-Judge). In triage, Reason2Decide is rationale source-robust across LLM-generated, nurse-authored, and nurse-post-processed rationales. In our experiments, while using only LLM-generated rationales in Stage-1, Reason2Decide outperforms other fine-tuning variants. This indicates that LLM-generated rationales are suitable for pretraining models, reducing reliance on human annotations. Remarkably, Reason2Decide achieves these gains with models 40x smaller than contemporary foundation models, making clinical reasoning more accessible for resource-constrained deployments while still providing explainable decision support.

医学AI可解释性小模型两阶段训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。