arXiv:2410.15051cs.CLcs.LG2024-10被引 2

用弱监督NLP自动识别病历中的诊断,省下上千小时标注时间。

Automatic identification of diagnosis from hospital discharge letters via weakly supervised Natural Language Processing

论文配图:Automatic identification of diagnosis from hospital discharge letters via weakly supervised Natural Language Processing
图 1 · 摘自论文原文
  • 通过提取句子、生成语义嵌入、两级聚类生成弱标签,无需逐篇人工标注。
  • 在3.3万份意大利儿童病历中,诊断识别准确率达F1 78.14%,接近有监督模型。
  • 适合医疗数据量大但标注资源有限的研究者,尤其适用于流行病学分析。

从医院出院记录中识别患者诊断对大规模队列选择和流行病学研究至关重要,但传统监督方法需大量人工标注,难以应用于大规模文本数据。本文提出一种弱监督自然语言处理(NLP)流程,用于分类意大利出院记录,无需文档级人工标注。该方法提取与诊断相关的句子,使用在意大利医学文献上进一步预训练的Transformer模型生成语义嵌入,并通过两级聚类生成弱标签,再用于训练文档级分类器。在一项针对支气管炎的研究中,基于2017至2020年间意大利威尼托地区44家急诊室或医院的33,176份儿童出院记录进行评估,最佳弱监督模型达到AUROC 77.68%(±4.30%)、AUPRC 73.13%(±4.93%)、F1-score 78.14%(±4.89%),优于无监督基线,接近全监督模型表现,同时节省超过1,500小时的人工标注工作。在另一较小规模的支气管炎数据集(3,188份记录,2020–2025年)上的二次验证中,最优弱监督模型获得AUPRC 76.72%(±5.02%)。结果表明,弱监督NLP方法在可扩展的临床诊断识别中具有潜力。

原文摘要 · Abstract (English)

Identifying patient diagnoses from hospital discharge letters is essential for large-scale cohort selection and epidemiological research, but traditional supervised approaches require extensive manual annotation, which is often impractical for large textual datasets. We present a weakly supervised Natural Language Processing (NLP) pipeline for classifying Italian discharge letters without document-level manual annotation. The method extracts diagnosis-related sentences, generates semantic embeddings using a transformer model further pre-trained on Italian medical documents, and applies a two-level clustering procedure to derive weak labels that are then used to train a document-level classifier. The approach was evaluated in a case study on bronchiolitis using 33,176 discharge letters of children admitted to 44 emergency rooms or hospitals in the Veneto Region, Italy, between 2017 and 2020. The best weakly supervised model achieved an AUROC of 77.68% ($\pm4.30\%$), an AUPRC of 73.13% ($\pm4.93\%$), and an F1-score of 78.14% ($\pm4.89\%$) against manually annotated data. Performance surpassed unsupervised baselines and approached fully supervised models, while reducing the need for manual annotation by more than 1,500 hours for a dataset of this size. Similar model rankings were observed in a secondary validation on a smaller bronchitis dataset (3,188 discharge letters, 2020-2025), where the best weakly supervised model achieved an AUPRC of 76.72% ($\pm 5.02\%$). These results suggest the potential of weakly supervised NLP methods for scalable disease identification from clinical discharge letters.

弱监督医疗NLP诊断识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。