arXiv:2603.27995cs.CV2026-03

统一适配夜间、雨天、雾天的多视角3D检测框架,提升自动驾驶视觉感知鲁棒性。

UniDA3D: A Unified Domain-Adaptive Framework for Multi-View 3D Object Detection

  • 将多种恶劣天气统一建模为域适应问题,通过查询引导的特征对齐机制减少域间差异。
  • 在合成的nuScenes-Night/Rain/Haze数据集上,mAP和NDS指标显著优于现有方法。
  • 单次训练即可支持多场景自适应,适合需要全天候感知的自动驾驶系统部署。

纯摄像头的3D目标检测对自动驾驶至关重要,具有成本优势。多视角3D检测在性能与成本间取得良好平衡,但现有方法在夜间、雨天、雾天等复杂环境下性能显著下降,主要因其训练数据多来自理想条件。为此,本文提出UniDA3D,一个统一的域自适应多视角3D检测框架,以实现多样恶劣环境下的鲁棒感知。将夜间、雨天、雾天统一视为多目标域适应问题,引入新颖的查询引导域差异缓解(QDDM)模块,通过查询中心的对抗与对比学习,在批次和全局层面实现源域与目标域特征对齐。同时,设计域自适应师生训练流程,采用指数移动平均教师和动态更新的高质量伪标签,增强一致性学习并抑制未标注目标域中的背景噪声。相比以往需为每种条件单独训练的方法,UniDA3D通过一次统一训练覆盖多个域,实现全天候3D感知。在基于nuScenes生成的合成多视角3D基准(nuScenes-Night、nuScenes-Rain、nuScenes-Haze)上,UniDA3D在极端条件下持续优于当前最优的纯摄像头多视角3D检测器,大幅提升了mAP和NDS指标,同时保持实时推理效率。

原文摘要 · Abstract (English)

Camera-only 3D object detection is critical for autonomous driving, offering a cost-effective alternative to LiDAR based methods. In particular, multi-view 3D object detection has emerged as a promising direction due to its balanced trade-off between performance and cost. However, existing methods often suffer significant performance degradation under complex environmental conditions such as nighttime, fog, and rain, primarily due to their reliance on training data collected mostly in ideal conditions. To address this challenge, we propose UniDA3D, a unified domain-adaptive multi-view 3D object detector designed for robust perception under diverse adverse conditions. UniDA3D formulates nighttime, rainy, and foggy scenes as a unified multi target domain adaptation problem and leverages a novel query guided domain discrepancy mitigation (QDDM) module to align object features between source and target domains at both batch and global levels via query-centric adversarial and contrastive learning. Furthermore, we introduce a domain-adaptive teacher student training pipeline with an exponential-moving-average teacher and dynamically updated high-quality pseudo labels to enhance consistency learning and suppress background noise in unlabeled target domains. In contrast to prior approaches that require separate training for each condition, UniDA3D performs a single unified training process across multiple domains, enabling robust all-weather 3D perception. On a synthesized multi-view 3D benchmark constructed by generating nighttime, rainy, and foggy counterparts from nuScenes (nuScenes-Night, nuScenes-Rain, and nuScenes-Haze), UniDA3D consistently outperforms state of-the-art camera-only multi-view 3D detectors under extreme conditions, achieving substantial gains in mAP and NDS while maintaining real-time inference efficiency.

3D检测域自适应自动驾驶多视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。