arXiv:2412.02868cs.AI2024-12被引 2

用轻量模型+预处理提升医疗文本提取精度,兼顾隐私与效率

PrecLLM: A Privacy-Preserving Framework for Efficient Clinical Annotation Extraction from Unstructured EHRs using Small-Scale LLMs

  • 结合正则与检索生成预处理,强化小模型对病历文本的解析能力
  • 在头颈癌和MIMIC-IV数据上,敏感性、特异性与F1值显著提升
  • 适合无高算力、严隐私要求的医疗机构本地部署

大规模语言模型在自然语言处理中表现出色,但在临床环境中受限于严格隐私法规和处理海量非结构化电子病历(EHR)的高昂计算成本。本研究提出一种资源高效的预处理技术,可嵌入现有LLM流程,特别适用于性能较弱的小型模型,构建适配本地部署的紧凑型框架(PrecLLM),适用于隐私要求严苛且缺乏高性能GPU的计算环境。预处理包含正则表达式(regex)与检索增强生成(RAG),用于从非结构化临床笔记中提取并突出关键信息,预过滤长文本显著提升了小型LLM在EHR任务中的表现。评估基于两个独立队列:来自EPIC系统的局部私有头颈癌(HNC)队列,以及公开的MIMIC-IV数据集。在MIMIC-IV上,还对比了PrecLLM与微调后的大型模型。结果表明,PrecLLM显著提升了原始小型模型的敏感性、特异性与F1分数,适用于隐私敏感且资源受限的应用场景。本研究为本地化、安全、高效的医疗应用提供了优化的LLM性能方案,并为临床领域模型部署提供了实用指导,解决了隐私、计算可行性与临床适用性的挑战。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated remarkable proficiency in automated text annotation within natural language processing. However, their deployment in clinical settings is severely constrained by strict privacy regulations and the prohibitive computational cost of processing voluminous unstructured Electronic Health Records (EHRs). In this study, we developed a resource-efficient preprocessing technique that can be adopted in existing LLM procedures. This approach is particularly useful for smaller LLMs, which are often more accuracy-challenged, and forms a compact LLM framework optimized for local deployment in computational environments with stringent privacy requirements and restricted access to high-performance GPUs (PrecLLM). The preprocessing step includes both regular expressions (regex) and Retrieval-Augmented Generation (RAG) to extract and highlight key information from unstructured clinical notes. Pre-filtering long and unstructured texts enhanced the performance of smaller LLMs on EHR-related tasks. Evaluation was performed on two distinct cohorts: a locally curated private EHR dataset from the EPIC system for a Head and Neck Cancer (HNC) cohort, and the publicly available EHR dataset (MIMIC-IV). Using MIMIC-IV, we further compared PrecLLM against fine-tuned LLMs. Results demonstrated that PrecLLM substantially enhanced the performance of the original smaller LLMs in terms of sensitivity, specificity, and F1 scores, making it well-suited for privacy-sensitive and resource-constrained applications. This study offers optimized LLM performance for local, secure, and efficient healthcare applications, and provides practical guidance for clinical LLM deployment while addressing challenges related to privacy, computational feasibility, and clinical applicability.

医疗AI小模型隐私保护临床文本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。