让医学大模型通过自我反思提升诊断能力,无需外部检索或大量标注。
MedReflect: Teaching Medical LLMs to Self-Improve via Reflective Correction
- 设计反思链机制,让模型自动生成假设、提问、回答并优化决策。
- 仅用少量随机样本和轻量微调,就在多个医学基准上显著提升准确率。
- 适合追求低成本高效医疗AI的开发者与研究者使用。
医学问题求解需要专家知识与复杂推理。现有大语言模型方法依赖外部知识检索或标注数据集,存在检索开销高、标注成本大、性能受限等问题。本文提出MedReflect,一种通用框架,引导大模型模拟医生的反思式思维:生成初始假设、自我提问、自我解答并优化判断。该自验证、自反思机制释放了模型在医学任务中的潜在能力,无需外部检索或大量标注。实验表明,仅需少量随机采样的训练样本和轻量微调,该方法即可在多个医学基准上实现显著的准确率提升,大幅降低标注需求。结果证明,大模型可通过自我反思与自我改进,有效解决专业医学问题,减少对外部监督与特定任务数据的依赖。
原文摘要 · Abstract (English)
Medical problem-solving demands expert knowledge and intricate reasoning. Recent studies of large language models (LLMs) attempt to ease this complexity by introducing external knowledge verification through retrieval-augmented generation or by training on reasoning datasets. However, these approaches suffer from drawbacks such as retrieval overhead and high annotation costs, and they heavily rely on substituted external assistants to reach limited performance in medical field. In this paper, we introduce MedReflect, a generalizable framework designed to inspire LLMs with a physician-like reflective thinking mode. MedReflect generates a single-pass reflection chain that includes initial hypothesis generation, self-questioning, self-answering and decision refinement. This self-verified and self-reflective nature releases large language model's latent capability in medical problem-solving without external retrieval or heavy annotation. We demonstrate that MedReflect enables cost-efficient medical dataset construction. With only a minimal subset of randomly sampled training examples and lightweight fine-tuning, this approach achieves notable absolute accuracy improvements across a series of medical benchmarks while significantly cutting annotation requirements. Our results provide evidence that LLMs can learn to solve specialized medical problems via self-reflection and self-improvement, reducing reliance on external supervision and extensive task-specific fine-tuning data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。