用多车协作知识蒸馏,让单车感知性能提升8.64%且零通信开销。
C2E: Boosting Ego-Only 3D Object Detection via Multi-Teacher Contrastive Knowledge Distillation

- 通过多教师对比蒸馏,将协作感知知识迁移到单车系统。
- 在多个数据集上实现最高8.64%的3D mAP提升,无通信成本。
- 适合追求高精度单车感知的自动驾驶研发团队使用。
基于激光雷达的3D目标检测对自动驾驶至关重要。传统单车感知(Eo-Perception)受限于视角和遮挡,在复杂室外环境中表现受限。近年来多智能体协同感知(Co-Perception)表现优异,但通信开销大、位姿误差累积阻碍其应用。为此,本文提出一种新的C2E(Co-Perception to Eo-Perception)范式,采用多对一(M2S)对比知识蒸馏框架。设计多层级特征增强模块以提升特征稳定性,引入辅助点云重建与多教师对比蒸馏机制,缓解点云与特征分布间的领域差距。实验表明,该框架在V2XSet、V2V4Real和DAIR-V2X数据集上与当前先进模型(如CoSDH)结合时,可实现最高8.64%的3D mAP提升,且无需额外通信开销。
原文摘要 · Abstract (English)
LiDAR-based 3D object detection is essential for autonomous driving systems. However, traditional Ego-only Perception (Eo-Perception) suffers from limited perspective and occlusions in a complex outdoor environment, leading to performance bottlenecks. Recently, research on multi-agent Collaborative Perception (Co-Perception) has demonstrated excellent performance, but high communication costs and accumulated pose error hinder its application. To address this, we explore a novel C2E (Co-Perception to Eo-Perception) paradigm through the Multi-to-Single (M2S) agent contrastive knowledge distillation framework. Our M2S framework first designs Multi-Level Feature Enhancement module to provide more stable features, and introduces Auxiliary Point Cloud Reconstruction and Multi-Teacher Contrastive Distillation mechanisms to mitigate domain gaps in point cloud and feature distributions within the C2E paradigm. Benefiting from this, our M2S can retain the excellent performance of collaborative perception while effectively avoiding the drawbacks, such as communication delays and positioning errors. Extensive experiments on the V2XSet, V2V4Real and DAIR-V2X datasets show the effectiveness and generalizability of our M2S framework when combined with the state-of-the-art CoSDH model and other excellent 3D detectors. Our M2S framework can deliver up to a 8.64% improvement in 3D mAP performance without introducing any communication costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。