用3D球面云保护地图隐私,防止几何恢复攻击。
Depth-Guided Privacy-Preserving Visual Localization Using 3D Sphere Clouds

- 将点云映射为过地图中心的3D线,形成球面云结构。
- 在公开RGB-D数据集上实现与主流方法相当的定位精度。
- 结合深度传感器解决尺度模糊问题,适合移动端部署。
能够从稀疏3D点云中还原高保真场景细节的深度神经网络引发了涉及私有地图的视觉定位中的重大隐私担忧。将地图点提升为随机方向的3D线是常见的隐私保护方法,但此类线易受基于密度的攻击,通过分析线邻域统计信息可恢复点云几何。为此,本文提出一种新的隐私保护场景表示——球面云(sphere cloud),将所有点映射为穿过地图中心的3D线,其形态类似单位球面上的点。由于线在地图中心最密集,该结构会误导密度攻击算法误判点云集中在中心,从而有效抵消攻击。然而,该方法面临新挑战:一是可能被直接从云结构中恢复图像,二是相机位姿估计存在未解决的平移尺度问题。为此,本文提出一种简单有效的云构建策略以抵御新攻击,并设计一种高效定位框架,利用设备端时间飞行(ToF)传感器获取的绝对深度图引导平移尺度。在公开的RGB-D数据集上的实验表明,球面云在保持良好隐私保护能力和定位效率的同时,相比其他基于深度的定位方法,对位姿估计精度的牺牲较小。
原文摘要 · Abstract (English)
The emergence of deep neural networks capable of revealing high-fidelity scene details from sparse 3D point clouds has raised significant privacy concerns in visual localization involving private maps. Lifting map points to randomly oriented 3D lines is a well-known approach for obstructing undesired recovery of the scene images, but these lines are vulnerable to a density-based attack that can recover the point cloud geometry by observing the neighborhood statistics of lines. With the aim of nullifying this attack, we present a new privacy-preserving scene representation called \emph{sphere cloud}, which is constructed by lifting all points to 3D lines crossing the centroid of the map, resembling points on the unit sphere. Since lines are most dense at the map centroid, the sphere cloud mislead the density-based attack algorithm to incorrectly yield points at the centroid, effectively neutralizing the attack. Nevertheless, this advantage comes at the cost of i) a new type of attack that may directly recover images from this cloud representation and ii) unresolved translation scale for camera pose estimation. To address these issues, we introduce a simple yet effective cloud construction strategy to thwart new attack and propose an efficient localization framework to guide the translation scale by utilizing absolute depth maps acquired from on-device time-of-flight (ToF) sensors. Experimental results on public RGB-D datasets demonstrate sphere cloud achieves competitive privacy-preserving ability and localization runtime while not excessively compensating the pose estimation accuracy compared to other depth-guided localization methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。