统一了三种隐私攻击方法,提出更稳定的贝叶斯改进版。
Exponential-Family Membership Inference: From LiRA and RMIA to BaVarIA
- 将LiRA、RMIA和BASE统一为指数族似然比框架,按复杂度形成谱系。
- 在12个测试场景下,新方法在低预算和离线场景中平均优于LiRA。
- 采用贝叶斯先验替代阈值切换,无需调参,适合资源受限的实战场景。
会员推断攻击(MIAs)已成为评估机器学习模型隐私性的标准工具。主流攻击方法——LiRA(Carlini等,2022)和RMIA(Zarifzadeh等,2024)——看似使用不同评分策略,而近期提出的BASE(Lassila等,2025)被证明与RMIA等价,使实践者难以选择。我们发现三者均属于单一指数族对数似然比框架,仅在分布假设和每数据点估计参数数量上不同。该统一揭示了一个层次结构(BASE1-4),将RMIA和LiRA作为复杂度谱系的两端,并给出实用准则:攻击复杂度应匹配可用的影子模型预算。在此框架下,我们识别出小影子模型预算下的方差估计是主要瓶颈,提出BaVarIA,一种基于共轭正态-逆伽马先验的贝叶斯方差推断攻击,取代阈值式参数切换。BaVarIA生成学生分布预测(BaVarIA-t)或方差稳定化的高斯分布(BaVarIA-n),实现无需每数据集调参的稳定性能。在12个测试平台和7种影子模型预算下,BaVarIA可直接替换LiRA,表现持平或更优,尤其在低预算和离线场景中优势显著:离线时,贝叶斯先验取代了LiRA的启发式策略,在12个测试平台中有10个表现更优。
原文摘要 · Abstract (English)
Membership inference attacks (MIAs) are becoming standard tools for auditing the privacy of machine learning models. The leading attacks -- LiRA (Carlini et al., 2022) and RMIA (Zarifzadeh et al., 2024) -- appear to use distinct scoring strategies, while the recently proposed BASE (Lassila et al., 2025) was shown to be equivalent to RMIA, making it difficult for practitioners to choose among them. We show that all three are instances of a single exponential-family log-likelihood ratio framework, differing only in their distributional assumptions and the number of parameters estimated per data point. This unification reveals a hierarchy (BASE1-4) that connects RMIA and LiRA as endpoints of a spectrum of increasing model complexity, and yields a practical rule -- match the attack's complexity to the available shadow-model budget. Within this framework, we identify variance estimation as a primary bottleneck at small shadow-model budgets and propose BaVarIA, a Bayesian variance inference attack that replaces threshold-based parameter switching with conjugate normal-inverse-gamma priors. BaVarIA yields a Student-t predictive (BaVarIA-t) or a Gaussian with stabilized variance (BaVarIA-n), providing stable performance without per-dataset hyperparameter tuning. Across 12 testbeds and 7 shadow-model budgets, BaVarIA is a drop-in replacement for LiRA that matches or, on average, improves upon it. The gains are largest in the practically important low-shadow-model and offline regimes: offline, the Bayesian prior replaces LiRA's heuristic and outperforms it on 10 of 12 testbeds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。