随机裁剪可免费提升图像隐私保护效果
Amplified Patch-Level Differential Privacy for Free via Random Cropping
- 利用图像裁剪的随机性,使敏感区域更难被模型捕获
- 实测在多个分割模型上提升隐私-效用平衡
- 无需改架构或训练流程,适合图像隐私场景
随机裁剪是计算机视觉中常见的数据增强方法,但其在差分隐私训练中的内在随机性尚未被探索。当图像中的敏感内容(如人脸或车牌)空间位置固定时,随机裁剪可能概率性地将其排除在模型输入之外。这为基于随机梯度下降的差分隐私训练引入了第三种随机性,除梯度噪声和小批量采样外。我们通过引入针对视觉数据的像素块级邻近关系,推导出结合随机裁剪的差分隐私随机梯度下降(DP-SGD)的紧致隐私边界。分析量化了像素块的包含概率,并表明其与小批量采样的组合降低了有效采样率。实验验证了在多个分割架构和数据集上,像素块级放大效应能改善隐私-效用权衡。结果表明,将隐私会计与领域结构及现有随机源对齐,可在不增加成本的情况下获得更强的隐私保障。
原文摘要 · Abstract (English)
Random cropping is one of the most common data augmentation techniques in computer vision, yet the role of its inherent randomness in training differentially private machine learning models has thus far gone unexplored. We observe that when sensitive content in an image is spatially localized, such as a face or license plate, random cropping can probabilistically exclude that content from the model's input. This introduces a third source of stochasticity in differentially private training with stochastic gradient descent, in addition to gradient noise and minibatch sampling. This additional randomness amplifies differential privacy without requiring changes to model architecture or training procedure. We formalize this effect by introducing a patch-level neighboring relation for vision data and deriving tight privacy bounds for differentially private stochastic gradient descent (DP-SGD) when combined with random cropping. Our analysis quantifies the patch inclusion probability and shows how it composes with minibatch sampling to yield a lower effective sampling rate. Empirically, we validate that patch-level amplification improves the privacy-utility trade-off across multiple segmentation architectures and datasets. Our results demonstrate that aligning privacy accounting with domain structure and additional existing sources of randomness can yield stronger guarantees at no additional cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。