用轻量模型本地化去除病历中的个人隐私信息,高效且安全。
Local Obfuscation by GLINER for Impartial Context Aware Lineage: Development and evaluation of PII Removal system
- 基于微调的GLiNER模型,本地部署实现精准识别
- 微平均F1达0.980,95%文档完全清洗干净
- 适合资源有限环境,无需依赖云端大模型
从电子健康记录(EHR)的临床笔记中移除个人身份信息(PII)对研究和AI发展至关重要。尽管大语言模型(LLMs)功能强大,但其高计算成本及API服务带来的数据隐私风险限制了其在低资源环境中的应用。为此,我们开发了LOGICAL(基于GLiNER的本地混淆以实现无偏上下文感知谱系),一个基于微调的通用轻量级命名实体识别(GLiNER)模型的高效、可本地部署的PII移除系统。使用来自精神病医院EHR系统的1515份临床文档,定义了9类需移除的PII。采用modern-gliner-bi-large-v1.0模型,在2849个文本实例上进行微调,并在376个测试实例上评估,采用字符级精确率、召回率和F1分数。与Microsoft Azure NER、Microsoft Presidio以及零样本提示Gemini-Pro-2.5和Llama-3.3-70B-Instruct对比,微调后的GLiNER模型表现更优,整体微平均F1得分为0.980,显著高于Gemini-Pro-2.5的0.845。LOGICAL成功完全净化95%的文档,优于次优方案的64%。该模型可在标准笔记本电脑上运行,无需专用GPU。然而,2%的实体级假阴性率表明所有系统仍需人工审核。微调的专用Transformer模型如GLiNER,为临床笔记的PII移除提供了准确、高效且安全的解决方案。这种“源头去标识化”方法是资源密集型大模型的实用替代方案,有助于在保障数据隐私的前提下,推动研究与AI开发。
原文摘要 · Abstract (English)
Removing Personally Identifiable Information (PII) from clinical notes in Electronic Health Records (EHRs) is essential for research and AI development. While Large Language Models (LLMs) are powerful, their high computational costs and the data privacy risks of API-based services limit their use, especially in low-resource settings. To address this, we developed LOGICAL (Local Obfuscation by GLINER for Impartial Context-Aware Lineage), an efficient, locally deployable PII removal system built on a fine-tuned Generalist and Lightweight Named Entity Recognition (GLiNER) model. We used 1515 clinical documents from a psychiatric hospital's EHR system. We defined nine PII categories for removal. A modern-gliner-bi-large-v1.0 model was fine-tuned on 2849 text instances and evaluated on a test set of 376 instances using character-level precision, recall, and F1-score. We compared its performance against Microsoft Azure NER, Microsoft Presidio, and zero-shot prompting with Gemini-Pro-2.5 and Llama-3.3-70B-Instruct. The fine-tuned GLiNER model achieved superior performance, with an overall micro-average F1-score of 0.980, significantly outperforming Gemini-Pro-2.5 (F1-score: 0.845). LOGICAL correctly sanitised 95% of documents completely, compared to 64% for the next-best solution. The model operated efficiently on a standard laptop without a dedicated GPU. However, a 2% entity-level false negative rate underscores the need for human-in-the-loop validation across all tested systems. Fine-tuned, specialised transformer models like GLiNER offer an accurate, computationally efficient, and secure solution for PII removal from clinical notes. This "sanitisation at the source" approach is a practical alternative to resource-intensive LLMs, enabling the creation of de-identified datasets for research and AI development while preserving data privacy, particularly in resource-constrained environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。