arXiv:2502.09396cs.LGcs.CR2025-02被引 1

提出分层方法,快速识别树模型隐私漏洞,省去大量昂贵测试。

A hierarchical approach for assessing the vulnerability of tree-based classification models to membership inference attack

  • 先验分析超参数风险,训练前筛选高危配置
  • 后验检查模型结构,低成本识别高风险模型
  • 不依赖训练即可预测风险,适合关注隐私的开发者

机器学习模型可能泄露训练数据的敏感信息,易受成员推理攻击(MIA)影响。现有评估方法多需耗费大量计算资源,如训练多个影子模型。本文提出两种互补的高效方法:训练前基于超参数选择的风险分析,以及训练后基于模型结构的检查。尽管无法保证模型绝对安全,但可显著减少需进行昂贵MIA评估的模型数量。实验表明,不同超参数组合的风险排序在多种数据集上保持一致,可建立简单可解释的规则,提前识别高风险配置;此外,无需训练即可通过轻量级结构指标判断模型隐私风险。结果还显示,模型准确率与隐私风险无相关性,提示可在性能和隐私间协同优化。

原文摘要 · Abstract (English)

Machine learning models can inadvertently expose confidential properties of their training data, making them vulnerable to membership inference attacks (MIA). While numerous evaluation methods exist, many require computationally expensive processes, such as training multiple shadow models. This article presents two new complementary approaches for efficiently identifying vulnerable tree-based models: an ante-hoc analysis of hyperparameter choices and a post-hoc examination of trained model structure. While these new methods cannot certify whether a model is safe from MIA, they provide practitioners with a means to significantly reduce the number of models that need to undergo expensive MIA assessment through a hierarchical filtering approach. More specifically, it is shown that the rank order of disclosure risk for different hyperparameter combinations remains consistent across datasets, enabling the development of simple, human-interpretable rules for identifying relatively high-risk models before training. While this ante-hoc analysis cannot determine absolute safety since this also depends on the specific dataset, it allows the elimination of unnecessarily risky configurations during hyperparameter tuning. Additionally, computationally inexpensive structural metrics serve as indicators of MIA vulnerability, providing a second filtering stage to identify risky models after training but before conducting expensive attacks. Empirical results show that hyperparameter-based risk prediction rules can achieve high accuracy in predicting the most at risk combinations of hyperparameters across different tree-based model types, while requiring no model training. Moreover, target model accuracy is not seen to correlate with privacy risk, suggesting opportunities to optimise model configurations for both performance and privacy.

隐私保护树模型成员推理攻击高效评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。