利用先验知识提升多智能体协作感知的精度与效率
Fast2comm:Collaborative perception combined with prior knowledge
- 用先验信息生成高区分度置信特征,精准识别前景
- 仅共享最相关先验特征,降低噪声与带宽消耗
- 训练与推理时解耦融合策略,动态适配带宽
协作感知可通过智能体间共享互补信息显著提升感知精度,但实际应用中面临感知性能与带宽限制的平衡难题,以及定位误差的影响。为此,我们提出 Fast2comm——一种基于先验知识的协作感知框架。首先,提出先验监督的置信特征生成方法,通过生成高区分度特征有效区分前景与背景;其次,设计基于真实框(GT Bounding Box)的空间先验特征选择策略,仅保留最具信息量的先验特征进行共享,从而减少背景噪声,提升带宽效率,并增强对定位误差的鲁棒性;第三,将模型训练与测试阶段的特征融合策略解耦,实现动态带宽自适应。我们在真实世界与模拟数据集上进行了广泛实验,结果表明所提方法在性能上具有显著优势,验证了各模块的有效性。代码已公开于 https://github.com/Zhangzhengbin-TJ/Fast2comm。
原文摘要 · Abstract (English)
Collaborative perception has the potential to significantly enhance perceptual accuracy through the sharing of complementary information among agents. However, real-world collaborative perception faces persistent challenges, particularly in balancing perception performance and bandwidth limitations, as well as coping with localization errors. To address these challenges, we propose Fast2comm, a prior knowledge-based collaborative perception framework. Specifically, (1)we propose a prior-supervised confidence feature generation method, that effectively distinguishes foreground from background by producing highly discriminative confidence features; (2)we propose GT Bounding Box-based spatial prior feature selection strategy to ensure that only the most informative prior-knowledge features are selected and shared, thereby minimizing background noise and optimizing bandwidth efficiency while enhancing adaptability to localization inaccuracies; (3)we decouple the feature fusion strategies between model training and testing phases, enabling dynamic bandwidth adaptation. To comprehensively validate our framework, we conduct extensive experiments on both real-world and simulated datasets. The results demonstrate the superior performance of our model and highlight the necessity of the proposed methods. Our code is available at https://github.com/Zhangzhengbin-TJ/Fast2comm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。