arXiv:2508.18971cs.CV2025-08被引 3

用分割监督训练的NeRF可保护隐私,同时保持定位精度。

Can we make NeRF-based visual localization privacy-preserving?

  • 用分割标签代替图像训练NeRF,避免存储精细细节
  • 在多个数据集上定位精度达当前最优,误差低于1.5°
  • 适合需要保护场景隐私的云化定位服务

视觉定位(VL)旨在估计已知场景中相机的位姿。传统方法通过点云或图像显式表示场景,而近期流行的基于NeRF的方法则隐式地用神经网络权重编码场景。尽管NeRF能生成高质量新视角图像,但其几何表示会无意中包含精细场景信息,部署于云端定位服务时可能引发隐私泄露风险。本文提出一种评估NeRF隐私保护能力的新协议,发现仅使用光度损失训练的NeRF即使移除颜色预测头,仍会保留细粒度细节,易受隐私攻击。为此,我们提出ppNeSF(隐私保护神经分割场),采用自监督学习的分割标签进行训练,使表示足够粗糙以隐藏可识别信息,同时保持三维判别性。实验表明,ppNeSF在多个基准数据集上实现最先进的定位精度,平均角度误差低于1.5°。

原文摘要 · Abstract (English)

Visual localization (VL) is the task of estimating the camera pose in a known scene. VL methods, a.o., can be distinguished based on how they represent the scene, e.g., explicitly through a (sparse) point cloud or a collection of images or implicitly through the weights of a neural network. Recently, NeRF-based methods have become popular for VL. While NeRFs offer high-quality novel view synthesis, they inadvertently encode fine scene details, raising privacy concerns when deployed in cloud-based localization services as sensitive information could be recovered. In this paper, we tackle this challenge on two ends. We first propose a new protocol to assess privacy-preservation of NeRF-based representations. We show that NeRFs trained with photometric losses store fine-grained details in their geometry representations, making them vulnerable to privacy attacks, even if the head that predicts colors is removed. Second, we propose ppNeSF (Privacy-Preserving Neural Segmentation Field), a NeRF variant trained with segmentation supervision instead of RGB images. These segmentation labels are learned in a self-supervised manner, ensuring they are coarse enough to obscure identifiable scene details while remaining discriminativeness in 3D. The segmentation space of ppNeSF can be used for accurate visual localization, yielding state-of-the-art results.

NeRF隐私保护视觉定位自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。