arXiv:2603.09529cs.CV2026-03被引 1

让鸟瞰感知更抗干扰,修复传感器损坏和攻击导致的异常

RESBev: Making BEV Perception More Robust

  • 将鲁棒性建模为潜在语义预测问题,利用时序关联学习干净特征
  • 在nuScenes上仅用少量微调,显著提升对自然干扰和对抗攻击的鲁棒性
  • 可插拔集成现有方法,无需改动主干网络,适合实际部署

鸟瞰图(BEV)感知已成为自动驾驶系统的核心,提供结构化的本体中心表示,对下游规划与控制至关重要。然而,真实场景中传感器退化和对抗攻击会导致严重感知异常,威胁系统安全。为此,我们提出一种稳健且可即插即用的BEV感知方法RESBev,可轻松应用于现有BEV感知模型以增强其对多种扰动的鲁棒性。具体而言,我们将感知鲁棒性重新定义为潜在语义预测问题,构建潜在世界模型,提取连续BEV观测中的时空相关性,学习底层的BEV状态转移,从而预测干净的BEV特征以重建受损观测。该框架在Lift-Splat-Shoot流水线的语义特征层运行,实现跨自然扰动与对抗攻击的泛化恢复,且无需修改底层主干网络。在nuScenes数据集上的大量实验表明,仅通过少样本微调,RESBev显著提升了现有BEV感知模型对外部扰动和对抗攻击的鲁棒性。

原文摘要 · Abstract (English)

Bird's-eye-view (BEV) perception has emerged as a cornerstone of autonomous driving systems, providing a structured, ego-centric representation critical for downstream planning and control. However, real-world deployment faces challenges from sensor degradation and adversarial attacks, which can cause severe perceptual anomalies and ultimately compromise the safety of autonomous driving systems. To address this, we propose a resilient and plug-and-play BEV perception method, RESBev, which can be easily applied to existing BEV perception methods to enhance their robustness to diverse disturbances. Specifically, we reframe perception robustness as a latent semantic prediction problem. A latent world model is constructed to extract spatiotemporal correlations across sequential BEV observations, thereby learning the underlying BEV state transitions to predict clean BEV features for reconstructing corrupted observations. The proposed framework operates at the semantic feature level of the Lift-Splat-Shoot pipeline, enabling recovery that generalizes across both natural disturbances and adversarial attacks without modifying the underlying backbone. Extensive experiments on the nuScenes dataset demonstrate that, with few-shot fine-tuning, RESBev significantly improves the robustness of existing BEV perception models against various external disturbances and adversarial attacks.

BEV感知鲁棒性自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。