无需训练即可检测道路异常,提升自动驾驶安全性。
Road-Aware Anomaly Segmentation with Query-Guided Polygons and CLIP in Autonomous Driving

- 利用查询置信度与道路多边形先验定位潜在异常区域。
- 在三个公开数据集上优于现有无训练方法,Fishyscapes上达最高AP。
- 结合空间结构与语义验证,适合部署于真实自动驾驶系统。
传统语义分割模型基于封闭集假设,在开放世界中难以识别未知或意外物体,常误判或遗漏分布外(OOD)道路异常,威胁自动驾驶安全。本文提出一种轻量级、无需重训练、无需OOD数据或辅助监督的后处理道路感知异常分割框架。该方法基于掩码变压器分割网络,通过查询级掩码置信度并引入多边形道路先验,检测可能对应异常的间隙区域。为抑制误报,进一步设计基于CLIP的零样本语义过滤模块,使用分布内提示(可选广义分布外提示)。通过联合利用空间先验与语义验证,生成鲁棒且可解释的异常预测。在Fishyscapes、SMIYC和RoadAnomaly三个公开基准上评估,性能持续领先,尤其在Fishyscapes LostAndFound上达到最高平均精度(AP),验证了该方法在真实自动驾驶系统中的实用性和可部署性。
原文摘要 · Abstract (English)
Traditional semantic segmentation models operate under a closed-set assumption and struggle to recognize unknown or unexpected objects-an essential capability for autonomous driving. As a result, such models often misclassify or overlook out-of-distribution (OOD) road anomalies, posing safety risks in open-world environments. We present a lightweight, postprocessing, road-aware anomaly segmentation framework that requires no retraining, no OOD data, and no auxiliary supervision. Our approach builds on a mask transformer-based segmentation network by exploiting query-level mask confidence and deriving a polygonal road prior to detect gap regions that may correspond to anomalies. To further suppress false positives, we introduce a CLIP-based zero-shot semantic filtering module using in-distribution prompts, with optional generalized OOD prompts. By jointly leveraging spatial priors and semantic verification, our framework produces robust and interpretable anomaly predictions. Evaluation on three public benchmarks-Fishyscapes, SMIYC, and RoadAnomaly-shows consistently strong performance. In particular, our method outperforms the training-free baseline Maskomaly on most metrics and achieves the highest AP on Fishyscapes LostAndFound. These results demonstrate the practicality and deployability of our approach for real-world autonomous driving systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。