临床决策提取中,叙事风格文本易被漏掉,影响系统准确率。
Linguistic Blind Spots in Clinical Decision Extraction
- 按决策类型分析语言特征,发现建议类文本更含叙事、停用词多。
- 精确匹配下召回率仅48%,含模糊表达的文本召回低至24%。
- 建议使用宽松匹配评估,适配医疗系统对边界容错的需求。
从临床记录中提取医疗决策是临床辅助与患者摘要的关键步骤。本文基于DICTUM分类体系标注的MedDec出院记录,分析七种语言指标与决策类型的关系,并评估标准Transformer模型在跨度级提取中的表现。结果发现:药物相关和问题定义类决策语义密集、简洁;而建议与预防类决策更具叙事性,停用词、代词比例更高,且频繁出现模糊、否定表达。在验证集上,精确匹配召回率为48%,不同语言特征分组间差异显著:停用词比例最高组召回率降至24%,含模糊或否定表达的跨度更难被识别。采用宽松重叠匹配后召回率达71%,表明多数错误源于边界不一致而非完全遗漏。因此,建议下游系统采用边界容错策略,尤其针对叙事型决策。
原文摘要 · Abstract (English)
Extracting medical decisions from clinical notes is a key step for clinical decision support and patient-facing care summaries. We study how the linguistic characteristics of clinical decisions vary across decision categories and whether these differences explain extraction failures. Using MedDec discharge summaries annotated with decision categories from the Decision Identification and Classification Taxonomy for Use in Medicine (DICTUM), we compute seven linguistic indices for each decision span and analyze span-level extraction recall of a standard transformer model. We find clear category-specific signatures: drug-related and problem-defining decisions are entity-dense and telegraphic, whereas advice and precaution decisions contain more narrative, with higher stopword and pronoun proportions and more frequent hedging and negation cues. On the validation split, exact-match recall is 48%, with large gaps across linguistic strata: recall drops from 58% to 24% from the lowest to highest stopword-proportion bins, and spans containing hedging or negation cues are less likely to be recovered. Under a relaxed overlap-based match criterion, recall increases to 71%, indicating that many errors are span boundary disagreements rather than complete misses. Overall, narrative-style spans--common in advice and precaution decisions--are a consistent blind spot under exact matching, suggesting that downstream systems should incorporate boundary-tolerant evaluation and extraction strategies for clinical decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。