arXiv:2606.21689cs.CLcs.AI2026-06

用小模型零样本提取肌萎缩侧索硬化临床术语,效果优于规则但需结合人工校验。

Clinical Term Extraction using Open-Source Small Language Models

论文配图:Clinical Term Extraction using Open-Source Small Language Models
图 1 · 摘自论文原文
  • 基于提示工程的开源小模型直接检测17类临床术语,无需训练数据。
  • Qwen3-4B-Instruct-2507在微平均F1上表现最佳,但整体仍低于正则表达式基线。
  • 不同模型各有优劣,适合构建混合提取流程而非替代现有规则系统。

肌萎缩侧索硬化(ALS)患者临床记录中的非结构化信息限制了后续分析,需将其提取为结构化数据。本文评估了26个开源小型语言模型(SLM),通过少样本提示在无任务特定训练数据的情况下识别患者文档中与ALS相关的17类临床术语,涵盖功能评分、呼吸指标、药物及其它临床与非临床属性。原始数据来自JSON编码的出院摘要,经标准化后使用具有结构化输出的提示模板处理。采用整体、标签级和人工验证的多标签分类指标进行比较。人工验证显示,正则表达式基线在微平均F1和汉明损失上优于所有单一SLM或TF-IDF基线;其中,Qwen3-4B-Instruct-2507是表现最优的SLM;模型排名随指标和标签类别变化:TF-IDF基线召回率高但精度低,部分SLM精度高但召回率低,Hammer2.1-7b在ALSFRS-R子评分检测中表现突出。结果支持采用针对性的混合提取工作流,而非完全替代现有规则方法。

原文摘要 · Abstract (English)

Clinical information for amyotrophic lateral sclerosis (ALS) care documented in unstructured clinical notes limits downstream analysis without extraction into structured formats. Open-source small language models with few-shot prompting for detecting the presence of ALS-relevant clinical terms in patient documentation were evaluated without task-specific training data. The detection task targeted 17 categories spanning functional scores, respiratory measures, medications, and related clinical and non-clinical attributes. Clinical note content was normalized from JSON-encoded discharge summaries and processed with a prompt template having structured JSON outputs. We compared 26 open-source models using aggregate, label-level, and manual-validation multilabel classification metrics. Manual validation showed that a regex rule baseline had higher overall micro-F1 and lower Hamming loss than any single SLM or TF-IDF baseline, while Qwen3-4B-Instruct-2507 was the highest-performing SLM by micro-F1. Model rankings varied by metric and label category, with the TF-IDF baseline showing high recall but low precision, some SLMs showing higher precision but lower recall, and Hammer2.1-7b showing strong performance for ALSFRS-R subscore detection. These findings support targeted hybrid extraction workflows rather than replacement of existing rule-based methods.

临床信息抽取小模型少样本学习医疗文本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。