arXiv:2603.01688cs.CV2026-03中稿 · CVPR被引 1

用扩散模型提升恶劣环境下多智能体协作感知的鲁棒性

CoopDiff: A Diffusion-Guided Approach for Cooperation under Corruptions

  • 通过教师-学生架构,用扩散去噪生成干净特征作为监督信号
  • 在六类退化场景下,对所有干扰类型均优于现有方法,误差降低
  • 适合需要高鲁棒性的自动驾驶多车协同系统应用

协作感知使智能体共享信息以扩大覆盖范围并改善场景理解。然而,在真实场景中,多样且不可预测的退化会削弱其鲁棒性和泛化能力。为此,我们提出 CoopDiff,一种基于扩散模型的协作感知框架,通过去噪机制缓解退化影响。CoopDiff 采用教师-学生范式:质量感知教师在体素级进行早期融合,结合兴趣质量加权与语义引导,利用扩散去噪器生成干净的监督特征;双分支扩散学生首先在编码阶段分离自车与协作流,以重建教师的干净目标;随后,自车引导的跨注意力机制在退化条件下自适应融合自车与协作特征,实现平衡解码。我们在两个构建的多退化基准数据集 OPV2Vn 和 DAIR-V2Xn 上进行评估,每个包含六种退化类型,涵盖环境与传感器级失真。得益于扩散模型固有的去噪特性,CoopDiff 在所有退化类型下均持续优于现有方法,并降低相对退化误差。此外,该方法可调精度与推理效率的平衡。

原文摘要 · Abstract (English)

Cooperative perception lets agents share information to expand coverage and improve scene understanding. However, in real-world scenarios, diverse and unpredictable corruptions undermine its robustness and generalization. To address these challenges, we introduce CoopDiff, a diffusion-based cooperative perception framework that mitigates corruptions via a denoising mechanism. CoopDiff adopts a teacher-student paradigm: the Quality-Aware Teacher performs voxel-level early fusion with Quality of Interest weighting and semantic guidance, then produces clean supervision features via a diffusion denoiser. The Dual-Branch Diffusion Student first separates ego and cooperative streams in encoding to reconstruct the teacher's clean targets. And then, an Ego-Guided Cross-Attention mechanism facilitates balanced decoding under degradation by adaptively integrating ego and cooperative features. We evaluate CoopDiff on two constructed multi-degradation benchmarks, OPV2Vn and DAIR-V2Xn, each incorporating six corruption types, including environmental and sensor-level distortions. Benefiting from the inherent denoising properties of diffusion, CoopDiff consistently outperforms prior methods across all degradation types and lowers the relative corruption error. Furthermore, it offers a tunable balance between precision and inference efficiency.

协作感知扩散模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。