提出可自适应应对传感器失效的鸟瞰图感知框架,显著提升系统鲁棒性。
Can BEV Perception Gracefully Degrade under Sensor Failures?

- 通过信任门路由与故障安全融合块动态评估模态可靠性
- 在激光雷达完全失效时仍保持34.7%的平均精度,远超基准线
- 轻量级设计适合部署,适用于追求高可靠性的自动驾驶系统
尽管多模态鸟瞰图感知在自动驾驶中表现卓越,但现有系统对传感器损坏极为脆弱,融合机制一旦缺失或污染模态便导致性能骤降。根源在于传统融合方式静态整合多模态特征。本文提出Grace-BEV,一种轻量且即插即用的主动可靠性感知框架。它利用对齐的鸟瞰空间,通过信任门路由显式评估各模态可信度,并借助故障安全融合模块动态重校准特征融合。此外,提出三阶段训练策略结合模态丢弃,防止模态主导,促进可靠输入下的均衡学习。在nuScenes-R和nuScenes-C上的大量实验表明,该方法在多种损坏场景下保持稳健性能。尤其在激光雷达灾难性失效下,标准基线mAP降至0.0%,而Grace-BEV恢复至34.7% mAP。同时,干净数据下准确率提升最高达1.4%,实现鲁棒性与效率的优良权衡。
原文摘要 · Abstract (English)
Despite the remarkable success of multi-modal bird's-eye view (BEV) perception in autonomous driving, current systems exhibit a critical vulnerability: existing fusion mechanisms are highly brittle to sensor corruptions, often causing catastrophic performance degradation. This vulnerability largely stems from the fact that standard fusion frameworks typically integrate multi-modal representations in a static manner, leading to a precipitous performance collapse under missing or corrupted modalities. In contrast, we show that graceful degradation is achievable through active modality reliability assessment. To this end, we present Grace-BEV, a lightweight and plug-and-play framework that enforces active reliability awareness during multi-modal fusion. Instead of relying on computationally expensive cross-modal interactions, Grace-BEV leverages the aligned BEV space to explicitly assess modality trustworthiness via a TrustGate Router and dynamically recalibrate feature integration using the FailSafe Fusion Block. Furthermore, we devise a Three-Phase Training strategy with Modality Dropout to prevent modality dominance and encourage balanced cross-modal learning under unreliable inputs. Extensive experiments on nuScenes-R and nuScenes-C show that Grace-BEV maintains robust performance across diverse corruption settings. Notably, under catastrophic LiDAR failures where standard baselines collapse to 0.0% mean Average Precision (mAP), Grace-BEV restores performance to as high as 34.7% mAP. Moreover, it improves clean accuracy by up to 1.4%, achieving a strong trade-off between robustness and efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。