首个针对3D点云的模型逆向攻击,可恢复原始场景数据。
ConcreTizer: Model Inversion Attack via Occupancy Classification and Dispersion Control for 3D Point Cloud Restoration
- 通过体素占用分类与分散控制,逆向重建点云特征。
- 在KITTI和Waymo数据集上成功还原真实3D场景。
- 揭示3D数据隐私漏洞,适合安全研究者关注。
自动驾驶中3D点云数据的广泛应用引发严重隐私担忧,因其可能泄露敏感信息。尽管2D数据的模型逆向攻击已广泛研究,但3D点云领域的相关工作仍基本空白。本文首次深入探讨针对3D点云场景的模型逆向攻击。分析发现,3D点云固有的稀疏性及体素化后空/非空体素的模糊性,加之非空体素在特征提取层间的分散,构成主要挑战。为此,我们提出ConcreTizer,一种专为基于体素的3D点云设计的高效逆向攻击方法。该方法引入体素占用分类以区分空/非空体素,并采用分散控制监督机制缓解非空体素分布分散问题。在KITTI与Waymo等主流3D特征提取器与基准数据集上的大量实验表明,ConcreTizer能从被破坏的3D特征数据中精确恢复出原始3D点云场景。研究结果凸显3D数据在逆向攻击下的脆弱性,亟需建立有效防御策略。
原文摘要 · Abstract (English)
The growing use of 3D point cloud data in autonomous vehicles (AVs) has raised serious privacy concerns, particularly due to the sensitive information that can be extracted from 3D data. While model inversion attacks have been widely studied in the context of 2D data, their application to 3D point clouds remains largely unexplored. To fill this gap, we present the first in-depth study of model inversion attacks aimed at restoring 3D point cloud scenes. Our analysis reveals the unique challenges, the inherent sparsity of 3D point clouds and the ambiguity between empty and non-empty voxels after voxelization, which are further exacerbated by the dispersion of non-empty voxels across feature extractor layers. To address these challenges, we introduce ConcreTizer, a simple yet effective model inversion attack designed specifically for voxel-based 3D point cloud data. ConcreTizer incorporates Voxel Occupancy Classification to distinguish between empty and non-empty voxels and Dispersion-Controlled Supervision to mitigate non-empty voxel dispersion. Extensive experiments on widely used 3D feature extractors and benchmark datasets, such as KITTI and Waymo, demonstrate that ConcreTizer concretely restores the original 3D point cloud scene from disrupted 3D feature data. Our findings highlight both the vulnerability of 3D data to inversion attacks and the urgent need for robust defense strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。