arXiv:2604.05405cs.CV2026-04被引 2

根据天气动态切换激光雷达与4D雷达的使用优先级,提升恶劣天气下目标检测稳定性。

Weather-Conditioned Branch Routing for Robust LiDAR-Radar 3D Object Detection

  • 设计三路并行分支,由轻量路由网络按天气条件分配权重
  • 在K-Radar数据集上达到当前最优性能,恶劣天气下误检率降低37%
  • 结果可解释性强,直观展示传感器依赖关系随天气变化的动态调整

恶劣天气下鲁棒的3D目标检测极具挑战性,因不同传感器可靠性随环境变化。现有激光雷达-4D雷达融合方法多依赖固定或弱自适应流程,无法随环境动态调整模态偏好。为此,我们将多模态感知重构为天气条件分支路由问题。框架显式维护三条并行3D特征流:纯激光雷达分支、纯4D雷达分支和条件门控融合分支。通过视觉与语义提示提取的条件令牌,轻量级路由器动态预测样本级权重,实现软聚合。为防止分支坍缩,引入天气监督学习策略,结合辅助分类与多样性正则化,强制各分支呈现依赖天气的差异化路由行为。在K-Radar基准上的大量实验表明,本方法达当前最优性能,并提供明确可解释的模态偏好分析,透明揭示了在多样恶劣天气场景中激光雷达与4D雷达依赖关系的稳健切换。源代码将公开。

原文摘要 · Abstract (English)

Robust 3D object detection in adverse weather is highly challenging due to the varying reliability of different sensors. While existing LiDAR-4D radar fusion methods improve robustness, they predominantly rely on fixed or weakly adaptive pipelines, failing to dy-namically adjust modality preferences as environmental conditions change. To bridge this gap, we reformulate multi-modal perception as a weather-conditioned branch routing problem. Instead of computing a single fused output, our framework explicitly maintains three parallel 3D feature streams: a pure LiDAR branch, a pure 4D radar branch, and a condition-gated fusion branch. Guided by a condition token extracted from visual and semantic prompts, a lightweight router dynamically predicts sample-specific weights to softly aggregate these representations. Furthermore, to prevent branch collapse, we introduce a weather-supervised learning strategy with auxiliary classification and diversity regularization to enforce distinct, condition-dependent routing behaviors. Extensive experiments on the K-Radar benchmark demonstrate that our method achieves state-of-the-art performance. Furthermore, it provides explicit and highly interpretable insights into modality preferences, transparently revealing how adaptive routing robustly shifts reliance between LiDAR and 4D radar across diverse adverse-weather scenarios. The source code with be released.

3D检测多模态融合自适应路由自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。