用激光雷达补全提升协同感知效率,低带宽下仍保持高精度
CoLC: Communication-Efficient Collaborative Perception with LiDAR Completion
- 通过重点传输关键点+端侧补全重建,降低通信开销
- 在稀疏传输下实现接近全量数据的感知精度,实测性能超现有方法
- 适合异构模型、带宽受限的自动驾驶协同系统
协同感知使自主智能体共享互补信息以克服感知局限。尽管早期融合具有更强的感知互补性且对模型异构性天然鲁棒,但其高昂的通信成本限制了实际部署,导致多数工作转向中间或晚期融合。为此,我们提出一种通信高效的早期协同感知框架——CoLC,结合激光雷达补全以在稀疏传输下恢复场景完整性。CoLC包含三项互补设计:首先,各邻近代理采用前景感知点采样(FAPS),仅传输在带宽约束下保留关键结构与上下文线索的信息点;其次,主代理利用增强型早期融合(CEEF)从接收的稀疏输入中重建密集柱状特征,并自适应地与自身观测融合,从而恢复空间完整性;最后,密集引导双对齐(DGDA)策略在训练过程中强制增强后的稀疏柱状特征与密集柱状特征在语义和几何上的一致性,确保特征学习的一致性和鲁棒性。在模拟与真实数据集上的实验表明,CoLC在感知-通信权衡上表现优异,且在异构模型设置下仍具鲁棒性。代码已开源:https://github.com/CatOneTwo/CoLC。
原文摘要 · Abstract (English)
Collaborative perception empowers autonomous agents to share complementary information and overcome perception limitations. While early fusion offers more perceptual complementarity and is inherently robust to model heterogeneity, its high communication cost has limited its practical deployment, prompting most existing works to favor intermediate or late fusion. To address this, we propose a communication-efficient early Collaborative perception framework that incorporates LiDAR Completion to restore scene completeness under sparse transmission, dubbed as CoLC. Specifically, the CoLC integrates three complementary designs. First, each neighbor agent applies Foreground-Aware Point Sampling (FAPS) to selectively transmit informative points that retain essential structural and contextual cues under bandwidth constraints. The ego agent then employs Completion-Enhanced Early Fusion (CEEF) to reconstruct dense pillars from the received sparse inputs and adaptively fuse them with its own observations, thereby restoring spatial completeness. Finally, the Dense-Guided Dual Alignment (DGDA) strategy enforces semantic and geometric consistency between the enhanced and dense pillars during training, ensuring consistent and robust feature learning. Experiments on both simulated and real-world datasets demonstrate that CoLC achieves superior perception-communication trade-offs and remains robust under heterogeneous model settings. The code is available at https://github.com/CatOneTwo/CoLC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。