让大模型按临床指南规则执行诊断推理,提升准确率与覆盖度。
GuideSkill: Evolving Executable LLM Agent Skills for Guideline-Grounded Clinical Reasoning

- 将指南条目转为可执行函数,输出诊断支持分值。
- 进化版提升诊断覆盖率达99.5%,相对直接推理增18.49%准确率。
- 无需更新主模型,适合医疗诊断场景的可解释推理应用。
临床实践指南(CPGs)包含诊断标准,但大模型通常仅检索或吸收指南文本,而非执行其规则。我们提出GuideSkill,一个外部推理层,将特定疾病的标准编译为返回序数诊断支持分数的可执行函数。GuideSkill-Zero基于指南初始化,GuideSkill-Evo则利用病例-诊断对优化已有技能并补充缺失诊断。推理时,大模型提出鉴别诊断,匹配相应技能并提取所需特征,融合执行得分进行排序。在四个基准和四种骨干模型上,GuideSkill-Zero平均比指南RAG提升13.45%的宏平均准确率;GuideSkill-Evo在每种骨干上均达最优,相比直接推理相对提升18.49%,且黄金标签技能覆盖率从56.5%升至99.5%。在Qwen3.5-9B上,其性能超越最强参数微调基线11.16%而无需更新主模型。专家评估表明,GuideSkill生成的规则具临床合理性与广泛接受性,证明其初始与演化的规则可靠且实用。结果支持可执行技能作为模型无关机制,结合指南流程与病例模式。
原文摘要 · Abstract (English)
Clinical practice guidelines (CPGs) encode diagnostic criteria, but LLM systems typically retrieve guideline text or absorb it through training rather than execute its rules. We introduce GuideSkill, an external reasoning layer that compiles disease-specific criteria into executable functions returning ordinal diagnostic-support scores. GuideSkill-Zero is initialized from guidelines, while GuideSkill-Evo uses case--diagnosis pairs to refine covered skills and add missing diagnoses. At inference, an LLM proposes a differential diagnosis, grounds the features required by each matched skill, and fuses its ranking with the executed skill scores. Across four benchmarks and four backbones, GuideSkill-Zero improves macro-average accuracy over guideline RAG by 13.45% on average. GuideSkill-Evo achieves the highest macro-average for every backbone, improves over direct inference by 18.49% relatively, and increases gold-label skill coverage from 56.5% to 99.5%. On Qwen3.5-9B, it also exceeds the strongest parameter-update baseline by 11.16% without updating the backbone. Expert evaluation further indicates that GuideSkill produces clinically sound and broadly acceptable skills, suggesting that its initialized and evolved rules are reliable and practically meaningful. These results support executable skills as a model-agnostic mechanism for combining guideline-derived procedures with case-derived diagnostic patterns.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。