提出新型协作感知框架,兼顾通信效率与感知精度。
CoSDH: Communication-Efficient Collaborative Perception via Supply-Demand Awareness and Intermediate-Late Hybridization
- 基于供需关系优化协作区域选择,减少无效通信。
- 引入中间-后期混合协作模式,低带宽下仍保持高精度。
- 在真实带宽下表现优异,适合自动驾驶系统部署。
多智能体协作感知通过融合多个智能体信息提升感知能力,是解决自动驾驶中单车感知能力弱的关键方案。然而现有方法在通信效率与感知精度间面临权衡困境。为此,本文提出一种基于供需感知与中间-后期混合化的通信高效协作感知框架(CoSDH)。通过建模智能体间的供需关系,精细化筛选协作区域,在降低通信开销的同时保持高精度。创新性地引入中间-后期混合协作机制,使后期协作能补偿低带宽下的性能下降。在多个数据集(含仿真与真实场景)上的大量实验表明,CoSDH 在检测精度上达到当前最优水平,并实现了最佳的带宽权衡,在真实通信条件下展现出卓越的检测精度,验证了其有效性和实际应用价值。代码将开源于 https://github.com/Xu2729/CoSDH。
原文摘要 · Abstract (English)
Multi-agent collaborative perception enhances perceptual capabilities by utilizing information from multiple agents and is considered a fundamental solution to the problem of weak single-vehicle perception in autonomous driving. However, existing collaborative perception methods face a dilemma between communication efficiency and perception accuracy. To address this issue, we propose a novel communication-efficient collaborative perception framework based on supply-demand awareness and intermediate-late hybridization, dubbed as \mymethodname. By modeling the supply-demand relationship between agents, the framework refines the selection of collaboration regions, reducing unnecessary communication cost while maintaining accuracy. In addition, we innovatively introduce the intermediate-late hybrid collaboration mode, where late-stage collaboration compensates for the performance degradation in collaborative perception under low communication bandwidth. Extensive experiments on multiple datasets, including both simulated and real-world scenarios, demonstrate that \mymethodname~ achieves state-of-the-art detection accuracy and optimal bandwidth trade-offs, delivering superior detection precision under real communication bandwidths, thus proving its effectiveness and practical applicability. The code will be released at https://github.com/Xu2729/CoSDH.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。