保护自动驾驶协作感知中的隐私,防止图像被还原。
Privacy-Concealing Cooperative Perception for BEV Scene Segmentation
- 用隐藏网络遮蔽共享的鸟瞰图特征中的视觉线索。
- 重建图像质量显著下降,分割精度损失小于1.5%。
- 适合关注自动驾驶数据隐私的科研与工程人员。
自动驾驶的协同感知系统通过车辆间共享感知信息以突破单车感知范围限制。然而,这种共享会带来隐私泄露风险,敏感视觉内容可能从共享数据中被重建。本文提出一种面向鸟瞰图(BEV)语义分割的隐私保护协作(PCC)框架。基于常见的BEV特征,设计隐藏网络以阻止图像重建网络从共享特征中恢复原始图像。采用对抗学习机制训练:隐藏网络旨在掩盖特征中的视觉信息,而重建网络则试图还原这些信息。为保持分割性能,感知网络与隐藏网络端到端联合优化。实验表明,该框架能有效降低重建图像质量,对分割性能影响极小,实现车辆间协作的隐私保护。源代码将在发表后公开。
原文摘要 · Abstract (English)
Cooperative perception systems for autonomous driving aim to overcome the limited perception range of a single vehicle by communicating with adjacent agents to share sensing information. While this improves perception performance, these systems also face a significant privacy-leakage issue, as sensitive visual content can potentially be reconstructed from the shared data. In this paper, we propose a novel Privacy-Concealing Cooperation (PCC) framework for Bird's Eye View (BEV) semantic segmentation. Based on commonly shared BEV features, we design a hiding network to prevent an image reconstruction network from recovering the input images from the shared features. An adversarial learning mechanism is employed to train the network, where the hiding network works to conceal the visual clues in the BEV features while the reconstruction network attempts to uncover these clues. To maintain segmentation performance, the perception network is integrated with the hiding network and optimized end-to-end. The experimental results demonstrate that the proposed PCC framework effectively degrades the quality of the reconstructed images with minimal impact on segmentation performance, providing privacy protection for cooperating vehicles. The source code will be made publicly available upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。