arXiv:2606.03399cs.CLcs.CR2026-06

只加密敏感词元,实现医疗大模型的隐私保护与实用兼顾。

Selective Token-Level Cryptographic Redaction for Privacy-Preserving Clinical Deployment of Large Language Models

论文配图:Selective Token-Level Cryptographic Redaction for Privacy-Preserving Clinical Deployment of Large Language Models
图 1 · 摘自论文原文
  • 仅对敏感词元加密,保留上下文以维持模型效果
  • 在分类和问答任务中性能接近明文,显著优于全加密方案
  • 客户端运行、无需修改下游模型,适合临床部署

尽管大语言模型在临床应用中日益普及,但现有流程需将原始敏感健康信息发送至远程服务器处理,加剧了隐私泄露风险。直接加密整个数据集会带来巨大的计算、对齐和通信开销,难以大规模落地。为兼顾隐私与可用性,我们提出医疗加密与选择性词元擦除框架HERALD:仅加密敏感词元,保留上下文以保障下游模型性能。HERALD结合医学命名实体识别(NER)与词性(POS)驱动策略筛选候选词元,进行定向词干化以稳定表面形式,并将每个受保护词元替换为带明确分隔符的确定性密文。值得注意的是,HERALD具有模型无关性,完全在客户端运行,确保敏感内容在存储、传输和处理全程加密,且无需修改下游模型。我们在公开数据集上的分类与医疗问答(MQA)任务中评估了HERALD。实验表明,全加密基线性能严重下降,而HERALD始终恢复至接近明文水平的性能,提供了一种全新的实用化部署路径。

原文摘要 · Abstract (English)

While large language models (LLMs) are increasingly used for clinical applications, many existing pipelines require sending raw sensitive health information to remote servers for processing, which heightens the risk of privacy leakage. A natural approach to mitigate this risk is to encrypt the data before transmission. However, straightforward solutions such as encrypting the entire dataset introduce prohibitive computational, alignment, and communication overheads, rendering large-scale practical deployment infeasible. To preserve privacy while maintaining usability, we present Healthcare Encryption & Redaction via Adaptive Linguistic Decomposition (HERALD), a token-level cryptographic redaction framework designed to achieve this balance by encrypting only sensitive tokens while preserving the surrounding context for downstream model utility. HERALD combines medical named-entity recognizer (NER) with part-of-speech (POS) driven policies to select candidate tokens, performs targeted lemmatization to stabilize surface forms, and substitutes each protected token with a deterministic ciphertext wrapped in explicit delimiters. Notably, HERALD is model-agnostic and operates entirely on the client side, ensuring that sensitive content remains encrypted throughout storage, transmission, and processing without requiring changes to downstream models. We evaluated HERALD on both classification and medical question answering (MQA) tasks on public datasets. Across different tasks, experiments illustrate that fully secured baselines suffer significant utility loss, whereas HERALD consistently recovers performance close to plaintext. Overall, HERALD provides a novel utilization pipeline.

隐私保护医疗AI加密LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。