arXiv:2605.03069cs.CRcs.LG2026-05

提出可保护隐私的分布式数据发布框架,让设备在不传原始数据情况下安全共享有用信息。

Distributed Deep Variational Approach for Privacy-preserving Data Release

论文配图:Distributed Deep Variational Approach for Privacy-preserving Data Release
图 1 · 摘自论文原文
  • 用变分自编码器学习随机编码,将数据转为低维去敏表示。
  • 在多个数据集上保持接近无约束模型的性能,同时使攻击者识别敏感信息的准确率接近随机。
  • 适用于医疗、物联网等高隐私场景,支持联邦学习架构下的本地训练与安全聚合。

联邦学习(FL)使分布式节点可在不交换原始数据的情况下共同训练模型,但在医疗传感器、物联网设备和可穿戴设备等隐私敏感场景中,仅保留数据本地仍不充分:梯度、模型更新及发布的表示本身可能泄露敏感属性。我们提出「高斯隐私保护器」(GPP),一种针对连续高维输入的数据发布框架,通过学习一个随机编码器将原始数据映射为低维去敏表示。编码器在敏感属性与输出表示之间的互信息上优化变分下界,同时通过交叉熵项保留指定的效用属性,由拉格朗日乘子β控制两者权衡。我们将GPP扩展至联邦设置,各客户端独立训练本地编码器,敏感标签始终保留在客户端,聚合器仅接收去敏表示,实现实例级隐私保护,额外提供标准“原始数据不外泄”的保障。在MNIST(数字和作为效用,奇偶性为敏感属性)、CelebA(微笑与性别)、HAPT-Recognition(动作与主体身份)三个基准上评估,GPP在所有任务中均达到接近无约束自编码器基线的性能(误差约1个百分点),同时使攻击者的受试者工作特征曲线(AUC)降至接近随机猜测水平。

原文摘要 · Abstract (English)

Federated learning (FL) lets distributed nodes train a shared model without exchanging their raw data, but in privacy-sensitive deployments medical sensors, IoT devices, wearables the protection offered by keeping data local is incomplete: gradients, model updates, and the released representations themselves can leak sensitive attributes. We propose the \emph{Gaussian Privacy Protector} (GPP), a data-release framework for continuous, high-dimensional inputs that learns a stochastic encoder mapping raw data to a low-dimensional sanitized representation. The encoder is trained against a variational lower bound on the mutual information between the released representation and a designated sensitive attribute, while a separate cross-entropy term preserves a designated utility attribute, with a Lagrange multiplier $β$ controlling the trade-off. We then extend GPP to the federated setting, in which each client trains a local encoder, sensitive labels never leave the client, and the aggregator receives only sanitized representations giving instance-level privacy protection in addition to the standard ``raw data stays local'' guarantee of FL. We evaluate GPP on MNIST (digit-sum utility, parity sensitive), CelebA (smiling vs.\ gender), and HAPT-Recognition (activity vs.\ subject identity). Across all three benchmarks, GPP attains utility within roughly one percentage point of an unconstrained autoencoder baseline while reducing the adversary's AUC to near random guessing.

隐私保护联邦学习数据发布变分推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。