arXiv:2602.18900cs.CRcs.CV2026-02中稿 · ICML

混合隐私技术组合可能严重破坏模型性能,需系统评估其协同效应。

PrivacyBench: Privacy Isn't Free in Hybrid Privacy-Preserving Vision Systems

  • 构建PrivacyBench框架,自动配置并测试多种隐私技术组合
  • 联邦学习+差分隐私导致准确率从98%暴跌至13%,计算开销大幅上升
  • 适合医疗影像等资源受限场景的隐私系统设计者使用

在医疗影像到自动驾驶等敏感深度学习应用中,隐私保护机器学习部署日益需要结合多种技术。然而,从业者缺乏系统性指导来评估这些混合配置的协同与非加性交互,常依赖孤立技术分析,忽略关键系统级影响。我们提出PrivacyBench,一个基准测试框架,揭示了隐私技术组合中的显著失败及其严重部署后果。通过对ResNet18和ViT模型在医学数据集上的系统评估,发现联邦学习(FL)+差分隐私(DP)组合出现严重收敛失败,准确率从98%降至13%,同时计算成本和能耗显著增加。相比之下,FL+安全多方计算(SMPC)保持接近基线性能,仅带来适度开销。该框架通过自动化YAML配置、资源监控与可复现实验协议,首次提供对隐私-效用-成本权衡的系统评估。PrivacyBench使从业者能在部署前识别有害技术交互,推动隐私保护计算机视觉从临时评估转向有原则的系统设计。研究结果表明,隐私技术不可随意组合,为资源受限环境下的稳健部署提供关键指导。

原文摘要 · Abstract (English)

Privacy preserving machine learning deployments in sensitive deep learning applications; from medical imaging to autonomous systems; increasingly require combining multiple techniques. Yet, practitioners lack systematic guidance to assess the synergistic and non-additive interactions of these hybrid configurations, relying instead on isolated technique analysis that misses critical system level interactions. We introduce PrivacyBench, a benchmarking framework that reveals striking failures in privacy technique combinations with severe deployment implications. Through systematic evaluation across ResNet18 and ViT models on medical datasets, we uncover that FL + DP combinations exhibit severe convergence failure, with accuracy dropping from 98% to 13% while compute costs and energy consumption substantially increase. In contrast, FL + SMPC maintains near-baseline performance with modest overhead. Our framework provides the first systematic platform for evaluating privacy-utility-cost trade-offs through automated YAML configuration, resource monitoring, and reproducible experimental protocols. PrivacyBench enables practitioners to identify problematic technique interactions before deployment, moving privacy-preserving computer vision from ad-hoc evaluation toward principled systems design. These findings demonstrate that privacy techniques cannot be composed arbitrarily and provide critical guidance for robust deployment in resource-constrained environments.

隐私保护联邦学习差分隐私系统评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。