arXiv:2511.10211cs.CV2025-11被引 4

提出高效协同感知框架HeatV2X,解决多车异构信息融合与可扩展性难题。

HeatV2X: Scalable Heterogeneous Collaborative Perception via Efficient Alignment and Interaction

  • 基于异构图注意力构建基础模型,支持多模态感知数据对齐
  • 通过局部微调与全局协作双策略,实现低开销高性能融合
  • 适用于大规模车联网场景,尤其适合资源受限的边缘设备

车联网协同感知通过信息共享突破单车感知边界。但随着参与节点增多,现有方法面临两大挑战:一是参与节点具有天然的多模态异构特性,二是系统需具备可扩展性以支持新节点接入。前者要求有效跨节点特征对齐以缓解异构性损失,后者使全参数训练不可行,凸显可扩展适配的重要性。为此,我们提出异构协同感知框架HeatV2X。首先基于异构图注意力训练一个高性能基础代理;随后设计局部异构微调与全局协同微调机制,实现异构节点间的高效对齐与交互。前者利用异构感知适配器提取模态特异性差异,后者采用多认知适配器增强跨节点协作并充分挖掘融合潜力。该设计在极低训练成本下显著提升协同性能。我们在OPV2V-H和DAIR-V2X数据集上评估,结果表明该方法在显著降低训练开销的同时,优于现有最先进方法。

原文摘要 · Abstract (English)

Vehicle-to-Everything (V2X) collaborative perception extends sensing beyond single vehicle limits through transmission. However, as more agents participate, existing frameworks face two key challenges: (1) the participating agents are inherently multi-modal and heterogeneous, and (2) the collaborative framework must be scalable to accommodate new agents. The former requires effective cross-agent feature alignment to mitigate heterogeneity loss, while the latter renders full-parameter training impractical, highlighting the importance of scalable adaptation. To address these issues, we propose Heterogeneous Adaptation (HeatV2X), a scalable collaborative framework. We first train a high-performance agent based on heterogeneous graph attention as the foundation for collaborative learning. Then, we design Local Heterogeneous Fine-Tuning and Global Collaborative Fine-Tuning to achieve effective alignment and interaction among heterogeneous agents. The former efficiently extracts modality-specific differences using Hetero-Aware Adapters, while the latter employs the Multi-Cognitive Adapter to enhance cross-agent collaboration and fully exploit the fusion potential. These designs enable substantial performance improvement of the collaborative framework with minimal training cost. We evaluate our approach on the OPV2V-H and DAIR-V2X datasets. Experimental results demonstrate that our method achieves superior perception performance with significantly reduced training overhead, outperforming existing state-of-the-art approaches. Our implementation will be released soon.

车联网协同感知异构融合轻量适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。