发现3D场景删物后仍留语义痕迹,提出新基准测试隐私泄露风险
Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splatting
- 构建评估框架,量化3D高斯点云中移除物体后的残留语义线索
- 实测显示即使几何消失,基础模型仍能推断被删物体,恢复率超70%
- 发布真实场景数据集Remove360,支持全场景物体移除的隐私验证
物体从3D场景中消失后,仍可能通过隐性线索被检测到。即使视觉上已移除,现代视觉模型仍可能推断其原始存在。本文提出新型基准与评估框架,量化3D高斯点云中物体移除后的语义残留。我们在多样化的室内外场景中进行实验,发现当前方法虽移除了可见几何,但常保留语义信息。尤其值得注意的是,即便经过修补填充,基础模型仍可频繁检测到残留线索。我们还发布了Remove360,一个包含预移除与后移除RGB图像及物体级掩码的真实世界数据集。不同于以往仅关注孤立物体的数据集,Remove360包含复杂杂乱场景,支持全场景移除评估。借助真实后移除图像,我们可直接判断语义是否存在,以及下游模型是否仍能推断被移除内容。结果揭示几何移除与语义擦除之间存在持续差距,暴露现有3D编辑流程的关键缺陷,强调需发展消除可恢复线索的隐私感知移除方法。数据集与评估代码已公开。
原文摘要 · Abstract (English)
An object can disappear from a 3D scene, yet still be detectable. Even after visual removal, modern vision models may infer what was originally present. In this work, we introduce a novel benchmark and evaluation framework to quantify semantic residuals, the unintended cues left behind after object removal in 3D Gaussian Splatting. We conduct experiments across a diverse set of indoor and outdoor scenes, showing that current methods often preserve semantic information despite the absence of visual geometry. Notably, even when removal is followed by inpainting, residual cues frequently remain detectable by foundation models. We also present Remove360, a real-world dataset of pre- and post-removal RGB captures with object-level masks. Unlike prior datasets focused on isolated object instances, Remove360 contains complex, cluttered scenes that enable evaluation of object removal in full-scene settings. By leveraging the ground-truth post-removal images, we directly assess whether semantic presence is eliminated and whether downstream models can still infer what was removed. Our results reveal a consistent gap between geometric removal and semantic erasure, exposing critical limitations in existing 3D editing pipelines and highlighting the need for privacy-aware removal methods that eliminate recoverable cues, not only visible geometry. Dataset and evaluation code are publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。