提出SOTA框架,让自动驾驶更准识别未知异常物体
Segmenting Objectiveness and Task-awareness Unknown Region for Autonomous Driving
- 用语义融合模块增强异常区域的客观性分割
- 在多个数据集上显著提升未知物体检测准确率
- 适合关注自动驾驶安全性的研究者与工程师
随着基于Transformer架构和大语言模型的发展,道路场景感知精度已大幅提升。然而,现有道路场景分割方法主要在封闭集数据上训练,对分布外(OOD)物体的检测能力不足。虽已有道路异常检测方法提出,但多依赖图像修复和分布外检测技术,存在两大问题:(1)未充分考虑异常区域的客观属性,导致与已知类别相似的异常物体分割不完整;(2)忽视环境约束,误检与自动驾驶任务无关的异常。本文提出一种名为SOTA(Segmenting Objectiveness and Task-awareness)的新框架,通过语义融合块(SFB)增强客观性分割,并利用场景理解引导的提示-上下文适配器(SG-PCA)过滤无关异常。在Fishyscapes Lost and Found、Segment-Me-If-You-Can、RoadAnomaly等多个基准数据集上的实证评估表明,SOTA在多种检测器上均持续提升OOD检测性能,实现鲁棒且精准的分割结果。
原文摘要 · Abstract (English)
With the emergence of transformer-based architectures and large language models (LLMs), the accuracy of road scene perception has substantially advanced. Nonetheless, current road scene segmentation approaches are predominantly trained on closed-set data, resulting in insufficient detection capabilities for out-of-distribution (OOD) objects. To overcome this limitation, road anomaly detection methods have been proposed. However, existing methods primarily depend on image inpainting and OOD distribution detection techniques, facing two critical issues: (1) inadequate consideration of the objectiveness attributes of anomalous regions, causing incomplete segmentation when anomalous objects share similarities with known classes, and (2) insufficient attention to environmental constraints, leading to the detection of anomalies irrelevant to autonomous driving tasks. In this paper, we propose a novel framework termed Segmenting Objectiveness and Task-Awareness (SOTA) for autonomous driving scenes. Specifically, SOTA enhances the segmentation of objectiveness through a Semantic Fusion Block (SFB) and filters anomalies irrelevant to road navigation tasks using a Scene-understanding Guided Prompt-Context Adaptor (SG-PCA). Extensive empirical evaluations on multiple benchmark datasets, including Fishyscapes Lost and Found, Segment-Me-If-You-Can, and RoadAnomaly, demonstrate that the proposed SOTA consistently improves OOD detection performance across diverse detectors, achieving robust and accurate segmentation outcomes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。