提出频域防御机制,防止3D高斯点云被恶意攻击导致资源耗尽。
Spectral Defense Against Resource-Targeting Attack in 3D Gaussian Splatting
- 在频域设计过滤器,识别并剔除高频异常的高斯点
- 通过2D频谱正则化抑制噪声模式,提升场景保真度
- 有效抵御攻击,提速超4倍,内存降低3.66倍
3D高斯点云(3DGS)虽能实现高质量渲染,但其高斯表示暴露了新型攻击面——资源靶向攻击。该攻击通过污染训练图像,过度诱导高斯点增长,导致资源耗尽。现有基于平滑、阈值和剪枝的效率方法多作用于可见结构,忽视隐性扰动对数据频域行为的扭曲。中毒输入引入异常高频放大,误导3DGS将噪声误判为细节结构,引发高斯点不稳定增长与场景质量下降。为此,本文提出双域频谱防御机制:首先在3D频域设计滤波器,选择性剔除高频异常的高斯点;其次在渲染结果上引入2D频谱正则化,区分自然各向同性频率,惩罚各向异性角能量以约束噪声模式。实验表明,该防御在攻击下可抑制过增长达5.92倍,内存减少3.66倍,速度提升4.34倍,同时保持高精度与鲁棒性。
原文摘要 · Abstract (English)
Recent advances in 3D Gaussian Splatting (3DGS) deliver high-quality rendering, yet the Gaussian representation exposes a new attack surface, the resource-targeting attack. This attack poisons training images, excessively inducing Gaussian growth to cause resource exhaustion. Although efficiency-oriented methods such as smoothing, thresholding, and pruning have been explored, these spatial-domain strategies operate on visible structures but overlook how stealthy perturbations distort the underlying spectral behaviors of training data. As a result, poisoned inputs introduce abnormal high-frequency amplifications that mislead 3DGS into interpreting noisy patterns as detailed structures, ultimately causing unstable Gaussian overgrowth and degraded scene fidelity. To address this, we propose \textbf{Spectral Defense} in Gaussian and image fields. We first design a 3D frequency filter to selectively prune Gaussians exhibiting abnormally high frequencies. Since natural scenes also contain legitimate high-frequency structures, directly suppressing high frequencies is insufficient, and we further develop a 2D spectral regularization on renderings, distinguishing naturally isotropic frequencies while penalizing anisotropic angular energy to constrain noisy patterns. Experiments show that our defense builds robust, accurate, and secure 3DGS, suppressing overgrowth by up to $5.92\times$, reducing memory by up to $3.66\times$, and improving speed by up to $4.34\times$ under attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。