arXiv:2605.30600cs.LGcs.IT2026-05

提出快速混合机制,让隐私保护回归更快更准。

The Fast Mixing Mechanism for Differential Privacy

  • 用快速变换设计新隐私压缩方法,兼顾效率与精度。
  • 在理想条件下,隐私保障接近高斯方法,且速度更快。
  • 首个实现快速隐私线性回归的算法,适合大规模数据场景。

随机投影是压缩大规模优化问题的核心工具,能高效保持精度。基于结构化矩阵(如哈达玛矩阵)的投影可显著降低计算成本。在差分隐私(DP)领域,高斯投影已用于解决DP线性回归,但通常未提升运行效率。本文提出一种基于快速变换的新型DP投影机制,在特定条件下达到经典快速投影的运行速度。我们证明该机制具备目前最优的隐私保证,在有利情况下其隐私性能与高斯投影仅差常数因子。结合近期基于投影的DP线性回归方法,我们构建了一种新算法,兼具强效用与高效运行。首次实现了快速的DP普通最小二乘法,提供了完整的隐私与准确率保证。

原文摘要 · Abstract (English)

Randomized sketching is a central tool for compressing large-scale optimization problems while preserving accuracy. In particular, sketches that are based on structured matrices, such as the Hadamard matrix, can be applied efficiently and often yield solutions that approximate those of the original problem at much lower computational cost. In differential privacy (DP), Gaussian sketching has been used to solve DP linear regression, beginning with \citet{sheffet2017differentially, sheffet2019old} and later refined by \citet{lev2025gaussianmix, lev2026near}. However, although these methods achieve strong utility guarantees, they usually do not improve runtime over classical DP approaches. In this work, we introduce a new DP sketching mechanism based on fast transforms, which, in certain cases, matches the runtime of classical fast sketching methods. We prove state-of-the-art privacy guarantees for this mechanism and show that, in favorable regimes, they match those of the Gaussian sketch up to a constant factor. As an application, we combine this mechanism with recent sketch-based methods for DP linear regression to obtain a new algorithm with strong utility and improved runtime. We establish privacy and accuracy guarantees for this algorithm, yielding, to the best of our knowledge, the first fast method for DP ordinary least squares.

差分隐私快速算法线性回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。