arXiv:2411.19888cs.CVcs.LG2024-11被引 1

用对比学习提升生成模型,精准定位机器人感知中的异常区域

FlowCLAS: Enhancing Normalizing Flow Via Contrastive Learning For Anomaly Segmentation

  • 在归一化流中加入对比损失,让正常与异常特征在隐空间分离
  • 在多个机器人异常分割数据集上达到最新最好效果,如Fishyscapes和ALLO
  • 适合需要高可靠性的自动驾驶、工业检测等安全关键场景

异常分割是安全关键型机器人应用中识别意外事件的核心能力。归一化流(NFs)作为一类生成模型,因其能高效建模正常数据分布而具有潜力,但在动态场景中,复杂多模态数据分布导致其难以识别分布外样本,性能远落后于领先判别方法。为此,我们提出FlowCLAS,一种融合传统最大似然目标与判别性对比损失的混合框架。通过引入异常暴露(Outlier Exposure),该目标在隐空间显式分离正常与异常特征,既保留了NF的概率基础,又增强了其判别能力。实验表明,FlowCLAS在多个挑战性机器人异常分割基准上取得新SOTA,包括Fishyscapes Lost & Found、Road Anomaly、SegmentMeIfYouCan-ObstacleTrack和ALLO。对比实验还证明,该方法比其他基于异常的训练策略更有效,成功缩小了与先进判别方法的性能差距。

原文摘要 · Abstract (English)

Anomaly segmentation is an essential capability for safety-critical robotics applications that must be aware of unexpected events. Normalizing flows (NFs), a class of generative models, are a promising approach for this task due to their ability to model the inlier data distribution efficiently. However, their performance falters in dynamic scenes, where complex, multi-modal data distributions cause them to struggle with identifying out-of-distribution samples, leaving a performance gap to leading discriminative methods. To address this limitation, we introduce FlowCLAS, a hybrid framework that enhances the traditional maximum likelihood objective of NFs with a discriminative, contrastive loss. Leveraging Outlier Exposure, this objective explicitly enforces a separation between normal and anomalous features in the latent space, retaining the probabilistic foundation of NFs while embedding the discriminative power they lack. The strength of this approach is demonstrated by FlowCLAS establishing new state-of-the-art (SOTA) performance across multiple challenging anomaly segmentation benchmarks for robotics, including Fishyscapes Lost & Found, Road Anomaly, SegmentMeIfYouCan-ObstacleTrack, and ALLO. Our experiments also show that this contrastive approach is more effective than other outlier-based training strategies for NFs, successfully bridging the performance gap to leading discriminative methods. Project page: https://trailab.github.io/FlowCLAS

异常分割归一化流对比学习机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。