arXiv:2512.15581cs.CVcs.LG2025-12中稿 · IEEE/CVF Winter Co…

通过分阶段强度感知知识蒸馏,提升雷达相机融合检测性能。

IMKD: Intensity-Aware Multi-Level Knowledge Distillation for Camera-Radar Fusion

  • 分三阶段引入强度感知蒸馏,保留雷达与相机特性。
  • 在nuScenes上达67.0% NDS和61.0% mAP,超越现有方法。
  • 适合做无激光雷达3D目标检测的工程师和研究者。

高性能雷达-相机3D目标检测可在不使用激光雷达进行推理的情况下,通过知识蒸馏实现。然而,现有蒸馏方法通常直接传递模态特异性特征至各传感器,可能扭曲其独特属性并削弱各自优势。为此,我们提出基于多层级知识蒸馏的IMKD框架,既保留各传感器内在特性,又强化其互补性。IMKD采用三阶段强度感知蒸馏策略:(1) 激光雷达到雷达的强度感知特征蒸馏,以细粒度结构线索增强雷达表示;(2) 激光雷达到融合特征的强度引导蒸馏,在融合层选择性突出几何与深度信息,促进模态间互补而非强制对齐;(3) 相机-雷达的强度引导融合机制,实现有效特征对齐与校准。在nuScenes基准上的大量实验表明,IMKD达到67.0% NDS和61.0% mAP,优于所有先前基于蒸馏的雷达-相机融合方法。代码与模型已开源。

原文摘要 · Abstract (English)

High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific features directly to each sensor, which can distort their unique characteristics and degrade their individual strengths. To address this, we introduce IMKD, a radar-camera fusion framework based on multi-level knowledge distillation that preserves each sensor's intrinsic characteristics while amplifying their complementary strengths. IMKD applies a three-stage, intensity-aware distillation strategy to enrich the fused representation across the architecture: (1) LiDAR-to-Radar intensity-aware feature distillation to enhance radar representations with fine-grained structural cues, (2) LiDAR-to-Fused feature intensity-guided distillation to selectively highlight useful geometry and depth information at the fusion level, fostering complementarity between the modalities rather than forcing them to align, and (3) Camera-Radar intensity-guided fusion mechanism that facilitates effective feature alignment and calibration. Extensive experiments on the nuScenes benchmark show that IMKD reaches 67.0% NDS and 61.0% mAP, outperforming all prior distillation-based radar-camera fusion methods. Our code and models are available at https://github.com/dfki-av/IMKD/.

雷达相机融合知识蒸馏3D检测多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。