提出动态信任模块,让多车感知在时间不同步时仍能稳定融合。
CoDynTrust: Robust Asynchronous Collaborative Perception via Dynamic Feature Trust Modulus
- 用不确定性建模生成动态信任权重,自动筛选有效信息。
- 跨数据集测试显示,异步场景下检测性能显著优于现有方法。
- 适合自动驾驶多车协同感知系统,尤其对通信延迟敏感的场景。
协同感知通过融合多智能体信息可扩展感知范围,提升性能。然而,真实环境中通信延迟、时钟偏差或采样配置差异导致的时间异步,会引发信息错配。若不妥善处理,协作性能下降,甚至引发安全事故。为此,本文提出CoDynTrust,一种基于不确定性编码的异步融合感知框架,具备对时间异步引发的信息错配的鲁棒性。CoDynTrust通过建模随机性与认知不确定性,为每个感兴趣区域生成动态特征信任模量(DFTM),并选择性抑制或保留单车特征,从而缓解信息错配。进一步设计多尺度融合模块处理经DFTM处理的多尺度特征图。相比其他考虑异步协同感知的工作,CoDynTrust能有效应对多种低质量信息,并支持不确定性向下游规划与控制任务传播。实验表明,CoDynTrust在多个数据集上显著降低时间异步带来的性能退化,即使在异步条件下仍达到顶尖检测性能。代码已开源:https://github.com/CrazyShout/CoDynTrust。
原文摘要 · Abstract (English)
Collaborative perception, fusing information from multiple agents, can extend perception range so as to improve perception performance. However, temporal asynchrony in real-world environments, caused by communication delays, clock misalignment, or sampling configuration differences, can lead to information mismatches. If this is not well handled, then the collaborative performance is patchy, and what's worse safety accidents may occur. To tackle this challenge, we propose CoDynTrust, an uncertainty-encoded asynchronous fusion perception framework that is robust to the information mismatches caused by temporal asynchrony. CoDynTrust generates dynamic feature trust modulus (DFTM) for each region of interest by modeling aleatoric and epistemic uncertainty as well as selectively suppressing or retaining single-vehicle features, thereby mitigating information mismatches. We then design a multi-scale fusion module to handle multi-scale feature maps processed by DFTM. Compared to existing works that also consider asynchronous collaborative perception, CoDynTrust combats various low-quality information in temporally asynchronous scenarios and allows uncertainty to be propagated to downstream tasks such as planning and control. Experimental results demonstrate that CoDynTrust significantly reduces performance degradation caused by temporal asynchrony across multiple datasets, achieving state-of-the-art detection performance even with temporal asynchrony. The code is available at https://github.com/CrazyShout/CoDynTrust.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。