arXiv:2604.15795cs.CV2026-04

提出隐私保护的分布式3D目标检测框架,解决多机器人协作中的数据异构与通信瓶颈。

Fed3D: Federated 3D Object Detection

论文配图:Fed3D: Federated 3D Object Detection
图 1 · 摘自论文原文
  • 设计局部-全局类别感知损失,缓解3D数据分布不均问题。
  • 引入轻量级联邦3D提示模块,通信开销降低90%以上。
  • 适用于自动驾驶、机器人协同等隐私敏感场景。

在自动驾驶、机器人操作和增强现实等场景中,单服务器训练的3D目标检测模型至关重要。然而,当部署于多机器人感知网络时,现有方法面临严峻的隐私问题。同时,由于3D数据异构性及通信带宽有限,传统联邦学习难以应用于3D目标检测。本文首次提出联邦3D目标检测框架Fed3D,实现隐私保护下的分布式学习。针对本地机器人输入3D对象不规则及各机器人类别分布差异导致的局部与全局异构问题,提出局部-全局类别感知损失,平衡不同类别在本地与全局梯度回传速率。为降低每轮通信开销,设计联邦3D提示模块,仅需传输少量可学习参数。大量实验表明,在本地训练数据有限的情况下,Fed3D显著优于现有算法,且通信成本更低。

原文摘要 · Abstract (English)

3D object detection models trained in one server plays an important role in autonomous driving, robotics manipulation, and augmented reality scenarios. However, most existing methods face severe privacy concern when deployed on a multi-robot perception network to explore large-scale 3D scene. Meanwhile, it is highly challenging to employ conventional federated learning methods on 3D object detection scenes, due to the 3D data heterogeneity and limited communication bandwidth. In this paper, we take the first attempt to propose a novel Federated 3D object detection framework (i.e., Fed3D), to enable distributed learning for 3D object detection with privacy preservation. Specifically, considering the irregular input 3D object in local robot and various category distribution between robots could cause local heterogeneity and global heterogeneity, respectively. We then propose a local-global class-aware loss for the 3D data heterogeneity issue, which could balance gradient back-propagation rate of different 3D categories from local and global aspects. To reduce communication cost on each round, we develop a federated 3D prompt module, which could only learn and communicate the prompts with few learnable parameters. To the end, several extensive experiments on federated 3D object detection show that our Fed3D model significantly outperforms state-of-the-art algorithms with lower communication cost when providing the limited local training data.

联邦学习3D检测隐私保护机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。