arXiv:2510.24688cs.CV2025-10被引 4

基于多基础设施相机的3D物体检测新框架,提升复杂环境下的感知鲁棒性。

MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detection

  • 采用图增强融合模块,结合相机几何关系与视觉特征生成鸟瞰图特征。
  • 在合成数据集M2I和真实数据集RoScenes上均达顶尖性能,极端天气下仍稳定。
  • 适合智能交通系统中多视角、异构相机部署场景的实时3D检测任务。

基于基础设施的感知在智能交通系统中至关重要,可提供全局态势感知并支持协同自主。然而,现有基于摄像头的检测模型在该场景下表现不佳,主要受限于多视角基础设施布置、多样化的相机配置、退化的视觉输入及复杂的道路布局。本文提出MIC-BEV,一种基于Transformer的鸟瞰图(BEV)感知框架,用于基础设施支持的多相机3D物体检测。MIC-BEV灵活支持任意数量、异构内参与外参的摄像头,并在传感器退化条件下表现出强鲁棒性。其提出的图增强融合模块通过利用相机与鸟瞰图单元间的几何关系及潜在视觉线索,将多视图图像特征融合至鸟瞰空间。为支持训练与评估,我们构建了M2I——一个包含多样化相机配置、道路布局与环境条件的合成数据集。在M2I与真实数据集RoScenes上的大量实验表明,MIC-BEV在3D物体检测任务中达到当前最优性能,并在极端天气与传感器退化条件下保持稳定。结果验证了其在真实世界部署的潜力。代码与数据集已开源:https://github.com/HandsomeYun/MIC-BEV。

原文摘要 · Abstract (English)

Infrastructure-based perception plays a crucial role in intelligent transportation systems, offering global situational awareness and enabling cooperative autonomy. However, existing camera-based detection models often underperform in such scenarios due to challenges such as multi-view infrastructure setup, diverse camera configurations, degraded visual inputs, and various road layouts. We introduce MIC-BEV, a Transformer-based bird's-eye-view (BEV) perception framework for infrastructure-based multi-camera 3D object detection. MIC-BEV flexibly supports a variable number of cameras with heterogeneous intrinsic and extrinsic parameters and demonstrates strong robustness under sensor degradation. The proposed graph-enhanced fusion module in MIC-BEV integrates multi-view image features into the BEV space by exploiting geometric relationships between cameras and BEV cells alongside latent visual cues. To support training and evaluation, we introduce M2I, a synthetic dataset for infrastructure-based object detection, featuring diverse camera configurations, road layouts, and environmental conditions. Extensive experiments on both M2I and the real-world dataset RoScenes demonstrate that MIC-BEV achieves state-of-the-art performance in 3D object detection. It also remains robust under challenging conditions, including extreme weather and sensor degradation. These results highlight the potential of MIC-BEV for real-world deployment. The dataset and source code are available at: https://github.com/HandsomeYun/MIC-BEV.

3D检测多相机鸟瞰图智能交通

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。