提出混合协作机制,让多智能体3D检测通信量减少2000倍以上且性能更优。
Communication-Efficient Multi-Agent 3D Detection via Hybrid Collaboration
- 融合感知输出与原始观测,自适应选择关键信息
- 通信量降低2006倍以上,仍优于现有方法的检测精度
- 支持不同模型配置,适配多种实际通信场景
协同3D检测通过共享互补信息显著提升检测性能,但带来性能与通信带宽的权衡。为此,我们提出一种新型混合协作机制,自适应融合两类通信消息:紧凑的感知输出和信息更丰富的原始观测。该方法聚焦两点:一是整合两类消息的互补信息,二是优先选择每类中最重要的数据。通过自适应选取关键消息集,确保最优感知信息与强适应性,有效满足多样通信需求。基于此,我们构建了 exttt{HyComm} 系统,具备两大优势:一是支持可调节的压缩率以应对不同通信要求,二是采用标准化消息格式,不依赖具体检测模型,实现跨模型配置的灵活性。在真实数据集 DAIR-V2X 与仿真数据集 OPV2V 上的实验表明,无论代理使用相同或不同检测模型,HyComm 均持续优于现有方法,在保持更低通信量的同时实现更优的性能-带宽权衡。其通信量比 Where2comm 降低超过 2,006×,且在 DAIR-V2X 上的 AP50 更高。相关代码将公开。
原文摘要 · Abstract (English)
Collaborative 3D detection can substantially boost detection performance by allowing agents to exchange complementary information. It inherently results in a fundamental trade-off between detection performance and communication bandwidth. To tackle this bottleneck issue, we propose a novel hybrid collaboration that adaptively integrates two types of communication messages: perceptual outputs, which are compact, and raw observations, which offer richer information. This approach focuses on two key aspects: i) integrating complementary information from two message types and ii) prioritizing the most critical data within each type. By adaptively selecting the most critical set of messages, it ensures optimal perceptual information and adaptability, effectively meeting the demands of diverse communication scenarios.Building on this hybrid collaboration, we present \texttt{HyComm}, a communication-efficient LiDAR-based collaborative 3D detection system. \texttt{HyComm} boasts two main benefits: i) it facilitates adaptable compression rates for messages, addressing various communication requirements, and ii) it uses standardized data formats for messages. This ensures they are independent of specific detection models, fostering adaptability across different agent configurations. To evaluate HyComm, we conduct experiments on both real-world and simulation datasets: DAIR-V2X and OPV2V. HyComm consistently outperforms previous methods and achieves a superior performance-bandwidth trade-off regardless of whether agents use the same or varied detection models. It achieves a lower communication volume of more than 2,006$\times$ and still outperforms Where2comm on DAIR-V2X in terms of AP50. The related code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。