arXiv:2602.20130cs.CLcs.AI2026-02被引 1

让大模型只在必要时推理,提升医疗问答效率

To Reason or Not to: Selective Chain-of-Thought in Medical Question Answering

  • 按需触发推理:先判断问题是否需思考,仅当需要时才生成理由
  • 效率提升13%-45%,耗能减少8%-47%,准确率损失≤4%
  • 适合临床部署,尤其对快速响应要求高的医疗AI系统

目标:通过避免无谓推理,提升大语言模型在医疗问答(MedQA)中的效率,同时保持准确性。方法:提出选择性思维链(Selective CoT),一种推理时策略,在生成理由前先预测问题是否需要推理。在四个生物医学问答基准(HeadQA、MedQA-USMLE、MedMCQA、PubMedQA)上评估了两个开源LLM(Llama-3.1-8B 和 Qwen-2.5-7B)。指标包括准确率、生成总词符数和推理时间。结果:Selective CoT将推理时间减少13%-45%,词符使用量降低8%-47%,准确率损失≤4%。在部分模型-任务组合中,其准确率更高且效率更优。相比固定长度的思维链,Selective CoT以显著更低的计算成本达到相当或更优的准确率。讨论:该方法通过仅在有益时调用显式推理,动态平衡推理深度与效率,减少回忆类问题的冗余,同时保留可解释性。结论:Selective CoT是一种简单、模型无关、成本低的医疗问答优化方法,使推理投入与问题复杂度匹配,提升基于LLM的临床系统实际部署能力。

原文摘要 · Abstract (English)

Objective: To improve the efficiency of medical question answering (MedQA) with large language models (LLMs) by avoiding unnecessary reasoning while maintaining accuracy. Methods: We propose Selective Chain-of-Thought (Selective CoT), an inference-time strategy that first predicts whether a question requires reasoning and generates a rationale only when needed. Two open-source LLMs (Llama-3.1-8B and Qwen-2.5-7B) were evaluated on four biomedical QA benchmarks-HeadQA, MedQA-USMLE, MedMCQA, and PubMedQA. Metrics included accuracy, total generated tokens, and inference time. Results: Selective CoT reduced inference time by 13-45% and token usage by 8-47% with minimal accuracy loss ($\leq$4\%). In some model-task pairs, it achieved both higher accuracy and greater efficiency than standard CoT. Compared with fixed-length CoT, Selective CoT reached similar or superior accuracy at substantially lower computational cost. Discussion: Selective CoT dynamically balances reasoning depth and efficiency by invoking explicit reasoning only when beneficial, reducing redundancy on recall-type questions while preserving interpretability. Conclusion: Selective CoT provides a simple, model-agnostic, and cost-effective approach for medical QA, aligning reasoning effort with question complexity to enhance real-world deployability of LLM-based clinical systems.

医疗问答思维链效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。