arXiv:2504.19706cs.CV2025-04被引 1

提出新基准与方法,提升复杂环境下异常分割的可靠性。

Open-set Anomaly Segmentation in Complex Scenarios

  • 融合能量与熵信息,增强模型对异常的判别能力。
  • 设计扩散生成器,合成高质量异常图像以提升训练效果。
  • 在复杂天气下性能显著提升,适合自动驾驶等安全场景。

在开放世界、高安全性应用(如自动驾驶)中,精确分割分布外(OoD)物体(即异常)至关重要。现有异常分割基准大多聚焦于理想天气条件,导致评估不可靠,忽视了真实环境中多变气象条件(如低光照、浓雾、暴雨)带来的风险。为此,本文提出ComsAmy——一个专为复杂场景下开放集异常分割设计的挑战性基准,涵盖多种恶劣天气、动态驾驶环境和多样异常类型,全面评估模型在真实开放世界中的表现。对多个先进模型的广泛评估显示,现有方法在复杂场景下存在显著缺陷,表明其部署存在严重安全隐患。为此,我们提出一种能量-熵学习(EEL)策略,融合能量与熵的互补信息,增强模型在复杂开放环境下的鲁棒性;同时提出基于扩散的异常数据合成器,生成多样且高质量的异常图像,以改进现有的拷贝粘贴式数据合成方法。在公开数据集和ComsAmy基准上的大量实验表明,所提出的扩散增强能量熵学习(DiffEEL)方法作为通用即插即用模块,能有效提升现有模型性能,平均提升约4.96%的AUPRC和9.87%的FPR95。

原文摘要 · Abstract (English)

Precise segmentation of out-of-distribution (OoD) objects, herein referred to as anomalies, is crucial for the reliable deployment of semantic segmentation models in open-set, safety-critical applications, such as autonomous driving. Current anomalous segmentation benchmarks predominantly focus on favorable weather conditions, resulting in untrustworthy evaluations that overlook the risks posed by diverse meteorological conditions in open-set environments, such as low illumination, dense fog, and heavy rain. To bridge this gap, this paper introduces the ComsAmy, a challenging benchmark specifically designed for open-set anomaly segmentation in complex scenarios. ComsAmy encompasses a wide spectrum of adverse weather conditions, dynamic driving environments, and diverse anomaly types to comprehensively evaluate the model performance in realistic open-world scenarios. Our extensive evaluation of several state-of-the-art anomalous segmentation models reveals that existing methods demonstrate significant deficiencies in such challenging scenarios, highlighting their serious safety risks for real-world deployment. To solve that, we propose a novel energy-entropy learning (EEL) strategy that integrates the complementary information from energy and entropy to bolster the robustness of anomaly segmentation under complex open-world environments. Additionally, a diffusion-based anomalous training data synthesizer is proposed to generate diverse and high-quality anomalous images to enhance the existing copy-paste training data synthesizer. Extensive experimental results on both public and ComsAmy benchmarks demonstrate that our proposed diffusion-based synthesizer with energy and entropy learning (DiffEEL) serves as an effective and generalizable plug-and-play method to enhance existing models, yielding an average improvement of around 4.96% in $\rm{AUPRC}$ and 9.87% in $\rm{FPR}_{95}$.

异常分割自动驾驶扩散模型开放集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。