提出DSRC模型,提升车辆协同感知在真实干扰下的鲁棒性
DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptions
- 通过语义引导的稀疏到稠密蒸馏学习密度无关表征
- 在真实与模拟数据集上均超越当前最优方法
- 适合自动驾驶中复杂环境下的多车协同感知
作为车联网(V2X)的潜在应用,多智能体协同感知在3D目标检测中已取得显著进展。尽管这些方法在标准基准上表现优异,但在复杂真实环境中的鲁棒性仍需验证。为此,我们提出了首个针对真实环境中常见退化情况的协同感知鲁棒性综合评估基准。同时,我们提出DSRC——一种增强鲁棒性的协同感知方法,旨在学习对密度不敏感且语义感知的协同表征。DSRC包含两项关键设计:i) 语义引导的稀疏到稠密蒸馏框架,利用真实边界框构建多视角稠密物体,以有效学习密度无关且语义感知的协同表征;ii) 特征到点云重建方法,以更好融合跨智能体的关键协同表征。我们在真实世界和模拟数据集上进行了广泛实验,结果表明,该方法在干净和受污染条件下均优于现有最先进方法。代码已公开于https://github.com/Terry9a/DSRC。
原文摘要 · Abstract (English)
As a potential application of Vehicle-to-Everything (V2X) communication, multi-agent collaborative perception has achieved significant success in 3D object detection. While these methods have demonstrated impressive results on standard benchmarks, the robustness of such approaches in the face of complex real-world environments requires additional verification. To bridge this gap, we introduce the first comprehensive benchmark designed to evaluate the robustness of collaborative perception methods in the presence of natural corruptions typical of real-world environments. Furthermore, we propose DSRC, a robustness-enhanced collaborative perception method aiming to learn Density-insensitive and Semantic-aware collaborative Representation against Corruptions. DSRC consists of two key designs: i) a semantic-guided sparse-to-dense distillation framework, which constructs multi-view dense objects painted by ground truth bounding boxes to effectively learn density-insensitive and semantic-aware collaborative representation; ii) a feature-to-point cloud reconstruction approach to better fuse critical collaborative representation across agents. To thoroughly evaluate DSRC, we conduct extensive experiments on real-world and simulated datasets. The results demonstrate that our method outperforms SOTA collaborative perception methods in both clean and corrupted conditions. Code is available at https://github.com/Terry9a/DSRC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。