arXiv:2603.06950q-bio.GNcs.AI2026-03被引 1

DNA嵌入可被逆向还原,揭示基因组模型隐私漏洞

How Private Are DNA Embeddings? Inverting Foundation Model Representations of Genomic Sequences

  • 用零样本嵌入+解码器逆向重建基因序列
  • 单标记嵌入几乎完美复原,长序列平均相似度超90%
  • 建议在EaaS服务中加强隐私保护设计

DNA基础模型已成为生物信息学和医疗应用中的变革性工具。在海量基因组数据上训练后,这些模型生成的嵌入向量能捕捉复杂的基因组信息,并通过嵌入即服务(EaaS)框架共享以支持下游任务,理论上可保护原始序列隐私。然而,随着该实践普及,其安全性受到质疑。本研究评估了三类DNA基础模型(DNABERT-2、Evo 2、Nucleotide Transformer v2)对模型逆向攻击的脆弱性。结果表明:单标记嵌入可实现近乎完美的序列重建;均值池化嵌入在长序列下重建质量下降,但仍显著优于随机基线。其中Evo 2与NTv2对短序列尤为脆弱,重建相似度>90%;而DNABERT-2因采用BPE分词具有更强抗逆向能力。嵌入相似性与序列相似性的相关性是重建成功的关键预测因子。研究强调,在广泛部署至EaaS前,亟需构建隐私友好的基因组基础模型。训练代码、模型权重及评估流程已开源:https://github.com/not-a-feature/DNA-Embedding-Inversion。

原文摘要 · Abstract (English)

DNA foundation models have become transformative tools in bioinformatics and healthcare applications. Trained on vast genomic datasets, these models can be used to generate sequence embeddings, dense vector representations that capture complex genomic information. These embeddings are increasingly being shared via Embeddings-as-a-Service (EaaS) frameworks to facilitate downstream tasks, while supposedly protecting the privacy of the underlying raw sequences. However, as this practice becomes more prevalent, the security of these representations is being called into question. This study evaluates the resilience of DNA foundation models to model inversion attacks, whereby adversaries attempt to reconstruct sensitive training data from model outputs. In our study, the model's output for reconstructing the DNA sequence is a zero-shot embedding, which is then fed to a decoder. We evaluated the privacy of three DNA foundation models: DNABERT-2, Evo 2, and Nucleotide Transformer v2 (NTv2). Our results show that per-token embeddings allow near-perfect sequence reconstruction across all models. For mean-pooled embeddings, reconstruction quality degrades as sequence length increases, though it remains substantially above random baselines. Evo 2 and NTv2 prove to be most vulnerable, especially for shorter sequences with reconstruction similarities > 90%, while DNABERT-2's BPE tokenization provides the greatest resilience. We found that the correlation between embedding similarity and sequence similarity was a key predictor of reconstruction success. Our findings emphasize the urgent need for privacy-aware design in genomic foundation models prior to their widespread deployment in EaaS settings. Training code, model weights and evaluation pipeline are released on: https://github.com/not-a-feature/DNA-Embedding-Inversion.

基因组隐私安全嵌入逆向基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。