arXiv:2603.27059cs.CV2026-03中稿 · CVPR被引 4

让单目3D检测模型自适应相机参数,提升跨设备泛化能力。

Towards Intrinsic-Aware Monocular 3D Object Detection

  • 用语言模型生成相机参数的语义嵌入,动态调整检测特征。
  • 在KITTI、Waymo等数据集上达到新最优,跨数据集训练提升4.46%。
  • 适合需要多相机适配的自动驾驶与机器人视觉场景。

单目3D目标检测旨在从单张RGB图像中推断物体在三维空间中的位置和尺寸。尽管近期取得进展,现有方法仍高度依赖相机内参,难以在不同设置间泛化,因为内参决定了三维场景在图像平面上的投影方式。本文提出MonoIA,一种统一的内在感知框架,通过语言引导的表征建模并适应内参变化。核心洞察是:内参变化不仅是数值差异,更是影响表观尺度、视角和空间几何的感知转换。为此,MonoIA利用大语言模型和视觉-语言模型生成编码相机参数视觉与几何意义的嵌入。这些嵌入通过层级整合进检测网络的内参自适应模块,使模型能根据特定相机配置调节特征表示,保持跨内参的一致3D检测效果。这将内参建模从数值条件转向语义表征,实现跨相机的鲁棒统一感知。大量实验表明,MonoIA在标准基准(如KITTI、Waymo、nuScenes)上达到新最优性能(例如,KITTI排行榜提升+1.18%),并在多数据集训练下进一步提升(例如,KITTI验证集提升+4.46%)。

原文摘要 · Abstract (English)

Monocular 3D object detection (Mono3D) aims to infer object locations and dimensions in 3D space from a single RGB image. Despite recent progress, existing methods remain highly sensitive to camera intrinsics and struggle to generalize across diverse settings, since intrinsics govern how 3D scenes are projected onto the image plane. We propose MonoIA, a unified intrinsic-aware framework that models and adapts to intrinsic variation through a language-grounded representation. The key insight is that intrinsic variation is not a numeric difference but a perceptual transformation that alters apparent scale, perspective, and spatial geometry. To capture this effect, MonoIA employs large language models and vision-language models to generate intrinsic embeddings that encode the visual and geometric implications of camera parameters. These embeddings are hierarchically integrated into the detection network via an Intrinsic Adaptation Module, allowing the model to modulate its feature representations according to camera-specific configurations and maintain consistent 3D detection across intrinsics. This shifts intrinsic modeling from numeric conditioning to semantic representation, enabling robust and unified perception across cameras. Extensive experiments show that MonoIA achieves new state-of-the-art results on standard benchmarks including KITTI, Waymo, and nuScenes (e.g., +1.18% on the KITTI leaderboard), and further improves performance under multi-dataset training (e.g., +4.46% on KITTI Val).

3D检测单目视觉相机内参语义表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。