用同态加密实现多方感知数据融合,保护隐私且实时可行。
Sarus: Privacy-Preserving Multi-Vendor Perception Fusion via Homomorphic Encryption

- 将检测结果转为高斯矩向量加密传输,服务器在密文域直接聚合。
- 实测显示计算开销仅增常数倍,融合后场景覆盖显著提升。
- 适合需跨厂商共享感知数据的自动驾驶系统部署。
协同感知通过整合多源检测输出提升自动驾驶车辆的环境感知能力,通常在多厂商部署中由共享融合服务完成。然而,推理时共享输出会暴露私有模型行为和敏感环境信息,带来重大隐私与安全风险。本文提出Sarus框架,基于同态加密实现多方感知融合的隐私保护,无需暴露各供应商的原始检测结果。各厂商将检测结果编码为共享空间网格上的紧凑高斯矩向量,并发送加密数据至融合服务器,服务器在加密域直接聚合,再解密重建最终检测结果,采用类别级二值合并。我们分析了计算复杂度:供应商端构建负载为线性,服务端融合为 $O(BV)$($B$ 为占用网格数,$V$ 为供应商数),后处理为 $O(B + igsum_{c ext{∈} ext{C}} B_c^2)$,其中 $ ext{C}$ 为物体类别集,$B_c$ 为类别 $c$ 的占用网格数。实验表明实际中计算呈线性增长,同态加密仅引入固定倍数开销,解密主导后处理成本。在KITTI数据集上,使用相机(YOLOv8)与激光雷达(PointPillars、PV-RCNN)检测器验证,Sarus有效融合互补检测,在单模态退化的远距离场景下显著提升整体覆盖范围。结果表明,当结合统计压缩与空间稀疏性时,隐私保护的多厂商感知融合可实现实时部署。
原文摘要 · Abstract (English)
Cooperative perception enables autonomous vehicles (AVs) to improve situational awareness by aggregating detection outputs from multiple agents and sensing platforms, often via a shared fusion service in multi-vendor deployments. However, sharing such outputs at inference time exposes proprietary model behavior and sensitive environmental information, creating significant privacy and security concerns. In this paper, we present Sarus, a privacy-preserving framework for multi-vendor perception fusion via homomorphic encryption (HE), enabling aggregation without revealing individual vendor outputs. Each vendor encodes detections as compact Gaussian moment vectors over a shared spatial lattice and transmits encrypted payloads to a fusion server, which aggregates them directly in the encrypted domain. The fused result is then decrypted and reconstructed into final detections through class-wise bin merging. We analyze the computational complexity, showing linear scaling for vendor payload construction and $O(BV)$ server-side fusion with the number of occupied bins $B$ and vendors $V$, while postprocessing scales as $O(B + \sum_{c\in \mathcal{C}} B_c^2)$, where $\mathcal{C}$ denotes the set of object classes and $B_c$ is the number of occupied bins for class $c$. Experiments demonstrate linear scaling in practice with only a bounded constant-factor overhead from HE, with decryption dominating postprocessing cost. Experiments on the KITTI dataset using camera (YOLOv8) and LiDAR (PointPillars, PV-RCNN) detectors show that Sarus improves scene-level coverage by effectively aggregating complementary detections, particularly in distance-dependent regimes where individual modalities degrade. These results indicate that privacy-preserving multi-vendor perception fusion is feasible for real-time deployment when statistical compression and spatial sparsity are jointly exploited.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。