arXiv:2507.18237cs.CV2025-07ICCV

解决协作感知中特征因域差异和时序错位导致质量下降的问题

DATA: Domain-And-Time Alignment for High-Quality Feature Fusion in Collaborative Perception

  • 提出域与时间对齐网络,分步缓解硬件差异与传输延迟影响
  • 在三个数据集上达到当前最优性能,支持严重通信延迟场景
  • 适合研究自动驾驶协作感知、多车信息融合的工程师与学者

特征级融合在协作感知(CP)中展现出良好的性能与通信带宽平衡潜力,但其效果高度依赖输入特征质量。高质特征获取面临硬件多样性与部署环境带来的域差距,以及传输延迟引发的时间错位,这些因素在协同网络中产生累积劣化效应。本文提出域与时间对齐(DATA)网络,系统性地对齐特征并最大化其语义表征以用于融合。具体地,提出一致性保持的域对齐模块(CDAM),通过近邻区域分层下采样与可观测性约束判别器减少域差距;进一步设计渐进式时序对齐模块(PTAM),基于多尺度运动建模与两阶段补偿处理传输延迟。在此基础上,构建实例聚焦特征聚合模块(IFAM)增强语义表示。大量实验表明,DATA在三个典型数据集上达到当前最优性能,且在严重通信延迟与位姿误差下仍具鲁棒性。

原文摘要 · Abstract (English)

Feature-level fusion shows promise in collaborative perception (CP) through balanced performance and communication bandwidth trade-off. However, its effectiveness critically relies on input feature quality. The acquisition of high-quality features faces domain gaps from hardware diversity and deployment conditions, alongside temporal misalignment from transmission delays. These challenges degrade feature quality with cumulative effects throughout the collaborative network. In this paper, we present the Domain-And-Time Alignment (DATA) network, designed to systematically align features while maximizing their semantic representations for fusion. Specifically, we propose a Consistency-preserving Domain Alignment Module (CDAM) that reduces domain gaps through proximal-region hierarchical downsampling and observability-constrained discriminator. We further propose a Progressive Temporal Alignment Module (PTAM) to handle transmission delays via multi-scale motion modeling and two-stage compensation. Building upon the aligned features, an Instance-focused Feature Aggregation Module (IFAM) is developed to enhance semantic representations. Extensive experiments demonstrate that DATA achieves state-of-the-art performance on three typical datasets, maintaining robustness with severe communication delays and pose errors. The code will be released at https://github.com/ChengchangTian/DATA.

协作感知特征融合时序对齐域对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。