无需标注数据,提升自动驾驶注意力预测的鲁棒性与准确性。
Towards Robust Unsupervised Attention Prediction in Autonomous Driving
- 通过多模型差异分析与驾驶知识嵌入,自动生成高质量伪标签。
- 在三种数据集上达到或超越监督方法性能,抗干扰能力提升超50%。
- 适合关注自动驾驶视觉感知鲁棒性的研究人员与工程师。
为提升自动驾驶系统的行车安全,准确预测注意力区域至关重要,但受限于大规模注意力标注成本高,以及自动驾驶场景与自然图像之间的域差异。复杂交通环境进一步加剧挑战,包括恶劣天气下的摄像头退化、噪声干扰及长尾分布带来的中心偏差。为此,我们提出一种鲁棒的无监督注意力预测方法:不确定性挖掘分支通过分析多个预训练模型在自然场景中的共性与差异来优化预测;知识嵌入模块引入驾驶知识,自适应增强伪标签。此外,提出RoboMixup数据增强方法,结合软注意力与动态裁剪,在提升对退化场景鲁棒性的同时缓解中心偏差。为系统评估鲁棒性,我们构建了DriverAttention-C基准,包含超过10万帧数据,涵盖BDD-A-C、DR(eye)VE-C和DADA-2000-C三个子集。所提方法在三个公开数据集及新基准上均达到或优于全监督先进水平,相对退化损失降低58.8%与52.8%,在KLD与CC指标上中心偏差鲁棒性分别提升12.4%与11.4%。代码与数据见https://github.com/zaplm/DriverAttention。
原文摘要 · Abstract (English)
Robustly predicting attention regions of interest for self-driving systems is crucial for driving safety but presents significant challenges due to the labor-intensive nature of obtaining large-scale attention labels and the domain gap between self-driving scenarios and natural scenes. These challenges are further exacerbated by complex traffic environments, including camera corruption under adverse weather, noise interferences, and central bias from long-tail distributions. To address these issues, we propose a robust unsupervised attention prediction method. An Uncertainty Mining Branch refines predictions by analyzing commonalities and differences across multiple pre-trained models on natural scenes, while a Knowledge Embedding Block bridges the domain gap by incorporating driving knowledge to adaptively enhance pseudo-labels. Additionally, we introduce RoboMixup, a novel data augmentation method that improves robustness against corruption through soft attention and dynamic augmentation, and mitigates central bias by integrating random cropping into Mixup as a regularizer. To systematically evaluate robustness in self-driving attention prediction, we introduce the DriverAttention-C benchmark, comprising over 100k frames across three subsets: BDD-A-C, DR(eye)VE-C, and DADA-2000-C. Our method achieves performance equivalent to or surpassing fully supervised state-of-the-art approaches on three public datasets and the proposed robustness benchmark, reducing relative corruption degradation by 58.8% and 52.8%, and improving central bias robustness by 12.4% and 11.4% in KLD and CC metrics, respectively. Code and data are available at https://github.com/zaplm/DriverAttention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。