arXiv:2603.01029cs.CV2026-03

用视觉语言模型提升道路异常分割准确率,减少误报。

Vision-Language Feature Alignment for Road Anomaly Segmentation

  • 通过提示学习对齐视觉与文本特征,利用语义先验抑制背景误报。
  • 在三个基准数据集上达到当前最佳性能,显著降低误报率。
  • 适合自动驾驶感知系统开发人员参考使用。

复杂环境中安全的自主系统需要可靠的道路异常分割能力以识别未知障碍物。然而,现有方法常依赖像素级统计判断区域是否异常,导致对天空、植被等语义正常背景产生高误报率,并且对分布外(OOD)实例召回率低,威胁机器人感知与决策安全。为此,我们提出VL-Anomaly框架,引入预训练视觉语言模型(VLMs)的语义先验。设计基于提示学习的对齐模块,将Mask2Forme的视觉特征适配至CLIP的已知类别文本嵌入,有效抑制背景区域的虚假异常响应。推理时,进一步采用多源融合策略,整合文本引导相似性、基于CLIP的图像-文本相似性及检测器置信度,利用互补信息提升预测可靠性。大量实验证明,该方法在RoadAnomaly、SMIYC和Fishyscapes等基准数据集上均取得领先表现。代码已开源:https://github.com/NickHezhuolin/VL-aligner-Road-anomaly-segment。

原文摘要 · Abstract (English)

Safe autonomous systems in complex environments require robust road anomaly segmentation to identify unknown obstacles. However, existing approaches often rely on pixel-level statistics to determine whether a region appears anomalous. This reliance leads to high false-positive rates on semantically normal background regions such as sky or vegetation, and poor recall of true Out-of-distribution (OOD) instances, thereby posing safety risks for robotic perception and decision-making. To address these challenges, we propose VL-Anomaly, a vision-language anomaly segmentation framework that incorporates semantic priors from pre-trained Vision-Language Models (VLMs). Specifically, we design a prompt learning-driven alignment module that adapts Mask2Forme's visual features to CLIP text embeddings of known categories, effectively suppressing spurious anomaly responses in background regions. At inference time, we further introduce a multi-source inference strategy that integrates text-guided similarity, CLIP-based image-text similarity and detector confidence, enabling more reliable anomaly prediction by leveraging complementary information sources. Extensive experiments demonstrate that VL-Anomaly achieves state-of-the-art performance on benchmark datasets including RoadAnomaly, SMIYC and Fishyscapes.Code is released on https://github.com/NickHezhuolin/VL-aligner-Road-anomaly-segment.

异常分割视觉语言模型自动驾驶多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。