车辆协作感知无需联合训练,推理时自适应对齐异构模型
You Share Beliefs, I Adapt: Progressive Heterogeneous Collaborative Perception
- 推理时动态自训练适配器,实现无监督域适应
- 仅用少量无标签数据,性能媲美全量训练的顶尖方法
- 适合真实场景中多品牌车辆即时协作,免去预存模型
协同感知通过共享信息使车辆突破个体感知局限,实现更远距离探测和遮挡物后感知。现实中,不同车辆因厂商差异导致模型异构。现有方法需对适配器或整个网络进行微调以弥合域差距,但需在推理前与协作车辆联合训练或预先存储所有可能合作方的模型,不适用于真实场景。为此,我们提出一种新思路:能否在推理阶段直接解决此问题?为此,我们引入渐进式异构协同感知(PHCP),将问题建模为少样本无监督域适应。与以往工作不同,PHCP在推理过程中通过自训练动态对齐特征,无需标注数据和联合训练。在OPV2V数据集上的大量实验表明,PHCP在多种异构场景下表现优异,仅使用少量无标签数据即可达到与全量数据训练的先进方法相当的性能。
原文摘要 · Abstract (English)
Collaborative perception enables vehicles to overcome individual perception limitations by sharing information, allowing them to see further and through occlusions. In real-world scenarios, models on different vehicles are often heterogeneous due to manufacturer variations. Existing methods for heterogeneous collaborative perception address this challenge by fine-tuning adapters or the entire network to bridge the domain gap. However, these methods are impractical in real-world applications, as each new collaborator must undergo joint training with the ego vehicle on a dataset before inference, or the ego vehicle stores models for all potential collaborators in advance. Therefore, we pose a new question: Can we tackle this challenge directly during inference, eliminating the need for joint training? To answer this, we introduce Progressive Heterogeneous Collaborative Perception (PHCP), a novel framework that formulates the problem as few-shot unsupervised domain adaptation. Unlike previous work, PHCP dynamically aligns features by self-training an adapter during inference, eliminating the need for labeled data and joint training. Extensive experiments on the OPV2V dataset demonstrate that PHCP achieves strong performance across diverse heterogeneous scenarios. Notably, PHCP achieves performance comparable to SOTA methods trained on the entire dataset while using only a small amount of unlabeled data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。