arXiv:2511.15974cs.AI2025-11

用知识与推理增强学习,让小模型低成本高效掌握抗菌治疗决策。

KRAL: Knowledge and Reasoning Augmented Learning for LLM-assisted Clinical Antimicrobial Therapy

  • 通过反向生成自动提炼大模型的知识和推理路径
  • 问答准确率提升1.8%~3.6%,推理能力提高27%以上
  • 适合医疗场景中需安全、低耗部署的临床辅助系统

临床抗菌治疗需动态整合病原体特征、宿主因素、药物药理特性及感染严重程度。此复杂性限制了大语言模型在高风险临床决策中的应用,主要因知识缺口、数据隐私、部署成本高及推理能力弱。为此,我们提出KRAL(知识与推理增强学习):一种低成本、可扩展、隐私保护的范式。它利用教师模型推理,通过答案到问题的逆向生成自动蒸馏知识与推理轨迹;采用启发式学习实现半监督数据增强,减少约80%的人工标注需求;并使用代理强化学习同步提升医学知识与推理能力,同时优化计算与内存效率。通过多样化教师模型进行分层评估降低测试成本,模块化接口设计便于系统更新。实验表明,KRAL显著优于传统检索增强生成(RAG)与监督微调(SFT)。在外部开源基准MEDQA上,知识问答准确率(Accuracy@1)较SFT提升1.8%,较RAG提升3.6%;在外部基准PUMCH Antimicrobial上,推理能力(Pass@1)较SFT提升27%,较RAG提升27.2%,训练成本仅为SFT的约20%。该方法有效提升本地LLM的临床诊断能力,支持复杂医疗决策支持系统的低成本、高安全性部署。

原文摘要 · Abstract (English)

Clinical antimicrobial therapy requires the dynamic integration of pathogen profiles,host factors, pharmacological properties of antimicrobials,and the severity of infection. This complexity imposes fundamental limitations on the applicability of Large Language Models (LLMs) in high-stakes clinical decision-making including knowledge gaps, data privacy concerns, high deployment costs, and limited reasoning capabilities. To address these challenges, we propose KRAL (Knowledge and Reasoning Augmented Learning), a low-cost, scalable, privacy-preserving paradigm that leverages teacher-model reasoning to automatically distill knowledge and reasoning trajectories via answer-to-question reverse generation, employs heuristic learning for semi-supervised data augmentation (reducing manual annotation requirements by approximately 80%), and utilizes agentic reinforcement learning to jointly enhance medical knowledge and reasoning while optimizing computational and memory efficiency. A hierarchical evaluation employing diverse teacher-model proxies reduces assessment costs, while modular interface design facilitates seamless system updates. Experimental results demonstrate that KRAL significantly outperforms traditional Retrieval-Augmented Generation (RAG) and Supervised Fine-Tuning (SFT) methods. It improves knowledge question-answering capability (Accuracy@1 on the external open-source benchmark MEDQA increased by 1.8% vs. SFT and 3.6% vs. RAG) and reasoning capability (Pass@1 on the external benchmark PUMCH Antimicrobial increased by 27% vs. SFT and 27.2% vs. RAG), achieved at about 20% of SFT's long-term training costs. This establishes KRAL as an effective solution for enhancing local LLMs' clinical diagnostic capabilities, enabling low-cost, high-safety deployment in complex medical decision support.

临床决策知识蒸馏强化学习抗菌治疗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。