解决车载协同感知的域泛化问题,提升模型跨场景适应能力。
V2X-DG: Domain Generalization for Vehicle-to-Everything Cooperative Perception
- 提出协作混合增强方法,模拟未见协同场景提升泛化性。
- 在四个公开数据集上实现跨域检测性能显著提升。
- 适合自动驾驶系统在复杂真实场景中部署时参考。
基于激光雷达的车-万物(V2X)协同感知已证明能有效提升自动驾驶的安全性与效率。然而,当前算法多在相同数据集上训练与测试,其跨域泛化能力尚未充分探索。本文首次针对基于激光雷达的V2X协同感知(V2X-DG)中的域泛化问题展开研究,涵盖四个主流开源数据集:OPV2V、V2XSet、V2V4Real 和 DAIR-V2X。目标是在仅使用源域数据训练的前提下,保持模型在源域及多个未见域上的高性能。为此,提出协作混合增强泛化方法(CMAG),通过模拟未见协同场景来增强模型泛化能力,设计紧凑以应对协同感知中的域差异。同时引入协作特征一致性(CFC)正则化约束,对齐由CMAG生成的融合特征与源域原始融合特征间的中间表示,促进鲁棒泛化特征学习。大量实验表明,该方法在跨域测试中取得显著性能提升,同时在源域上仍保持强表现。
原文摘要 · Abstract (English)
LiDAR-based Vehicle-to-Everything (V2X) cooperative perception has demonstrated its impact on the safety and effectiveness of autonomous driving. Since current cooperative perception algorithms are trained and tested on the same dataset, the generalization ability of cooperative perception systems remains underexplored. This paper is the first work to study the Domain Generalization problem of LiDAR-based V2X cooperative perception (V2X-DG) for 3D detection based on four widely-used open source datasets: OPV2V, V2XSet, V2V4Real and DAIR-V2X. Our research seeks to sustain high performance not only within the source domain but also across other unseen domains, achieved solely through training on source domain. To this end, we propose Cooperative Mixup Augmentation based Generalization (CMAG) to improve the model generalization capability by simulating the unseen cooperation, which is designed compactly for the domain gaps in cooperative perception. Furthermore, we propose a constraint for the regularization of the robust generalized feature representation learning: Cooperation Feature Consistency (CFC), which aligns the intermediately fused features of the generalized cooperation by CMAG and the early fused features of the original cooperation in source domain. Extensive experiments demonstrate that our approach achieves significant performance gains when generalizing to other unseen datasets while it also maintains strong performance on the source dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。