提出高效隐私保护框架,让3D点云加密后仍可识别
Computation-Efficient and Recognition-Friendly 3D Point Cloud Privacy Protection
- 用流模型将点云转到隐空间,再用角度相似性损失模糊几何结构
- 模型体积从767MB减至120MB,分类分割性能几乎不变
- 适合自动驾驶、机器人等需保护点云隐私的场景
3D点云广泛应用于自动驾驶、机器人、CAD建模等领域,但其隐私泄露问题尚未得到充分研究。与依赖纹理和二维结构的2D图像不同,3D点云无纹理,仅依赖三维几何结构。本文定义了3D点云隐私问题,提出名为PointFlowGMM的高效隐私保护框架,可在不接触原始数据的前提下支持下游分类与分割任务。通过基于流的生成模型,点云被投影至具有高斯混合分布的隐空间;设计新型角度相似性损失以模糊原始几何结构,同时将模型尺寸从767MB压缩至120MB,且识别性能未下降。隐空间中的点云经随机正交旋转进一步保护原始结构,类别间关系得以保留,确保加密后的点云仍可用于识别任务。在多个数据集上的实验表明,加密点云的识别效果与原始点云相当。
原文摘要 · Abstract (English)
3D point cloud has been widely used in applications such as self-driving cars, robotics, CAD models, etc. To the best of our knowledge, these applications raised the issue of privacy leakage in 3D point clouds, which has not been studied well. Different from the 2D image privacy, which is related to texture and 2D geometric structure, the 3D point cloud is texture-less and only relevant to 3D geometric structure. In this work, we defined the 3D point cloud privacy problem and proposed an efficient privacy-preserving framework named PointFlowGMM that can support downstream classification and segmentation tasks without seeing the original data. Using a flow-based generative model, the point cloud is projected into a latent Gaussian mixture distributed subspace. We further designed a novel angular similarity loss to obfuscate the original geometric structure and reduce the model size from 767MB to 120MB without a decrease in recognition performance. The projected point cloud in the latent space is orthogonally rotated randomly to further protect the original geometric structure, the class-to-class relationship is preserved after rotation, thus, the protected point cloud can support the recognition task. We evaluated our model on multiple datasets and achieved comparable recognition results on encrypted point clouds compared to the original point clouds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。