arXiv:2603.07567cs.CRcs.LG2026-03中稿 · PoPETs 2026被引 2

在真实场景下重评LiRA攻击,发现其隐私泄露能力被严重夸大。

Revisiting the LiRA Membership Inference Attack Under Realistic Assumptions

  • 用抗过拟合和迁移学习模拟生产模型,降低模型过自信
  • 在影子数据上校准阈值,且使用偏斜的成员先验(π≤10%)
  • 攻击结果稳定性差,低误报率下样本可复现性弱

会员推理攻击(MIAs)已成为评估机器学习模型隐私泄露的标准工具。其中,似然比攻击(LiRA)在拥有足够影子模型时被视为最先进方法。然而,以往评估常高估其效果:攻击过自信模型、在目标数据上校准阈值、假设成员先验平衡,或忽略攻击可复现性。本文在更现实的协议下重新评估LiRA:(i)使用抗过拟合(AOF)和迁移学习(TL)训练模型,减少过自信;(ii)用影子模型和数据校准决策阈值而非目标数据;(iii)在影子基阈值和偏斜成员先验(π≤10%)下测量正预测值(PPV);(iv)量化不同种子和训练变化下的逐样本攻击可复现性。结果发现,AOF显著削弱LiRA,TL进一步降低攻击效果同时提升模型准确率。在影子基阈值和偏斜先验下,LiRA的PPV大幅下降,尤其在使用AOF或AOF+TL时。此外,极低误报率下的阈值脆弱集在不同运行间可复现性差,而似然比排序更稳定。这些结果表明,LiRA及类似较弱的MIAs在真实条件下效果远低于先前估计,可靠隐私审计需采用反映实际训练实践、可行攻击假设和可复现性考量的评估协议。代码已开源:https://github.com/najeebjebreel/lira_analysis。

原文摘要 · Abstract (English)

Membership inference attacks (MIAs) have become the standard tool for evaluating privacy leakage in machine learning (ML). Among them, the Likelihood-Ratio Attack (LiRA) is widely regarded as the state of the art when sufficient shadow models are available. However, prior evaluations have often overstated the effectiveness of LiRA by attacking models overconfident on their training samples, calibrating thresholds on target data, assuming balanced membership priors, and/or overlooking attack reproducibility. We re-evaluate LiRA under a realistic protocol that (i) trains models using anti-overfitting (AOF) and transfer learning (TL), when applicable, to reduce overconfidence as in production models; (ii) calibrates decision thresholds using shadow models and data rather than target data; (iii) measures positive predictive value (PPV, or precision) under shadow-based thresholds and skewed membership priors (pi <= 10%); and (iv) quantifies per-sample membership reproducibility across different seeds and training variations. We find that AOF significantly weakens LiRA, while TL further reduces attack effectiveness while improving model accuracy. Under shadow-based thresholds and skewed priors, LiRA's PPV often drops substantially, especially under AOF or AOF+TL. We also find that thresholded vulnerable sets at extremely low FPR show poor reproducibility across runs, while likelihood-ratio rankings are more stable. These results suggest that LiRA, and likely weaker MIAs, are less effective than previously suggested under realistic conditions, and that reliable privacy auditing requires evaluation protocols that reflect practical training practices, feasible attacker assumptions, and reproducibility considerations. Code is available at https://github.com/najeebjebreel/lira_analysis.

隐私攻击会员推理模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。