arXiv:2608.22679cs.CVcs.RO2026-08TPAMI

提升语义分割的上下文感知与类别均衡,不增加推理开销。

Contextrast++: Robust Multi-Scale Contextual Contrastive Learning for Semantic Segmentation

论文配图:Contextrast++: Robust Multi-Scale Contextual Contrastive Learning for Semantic Segmentation
图 1 · 摘自论文原文
  • 通过自适应融合与多尺度对比学习,增强特征上下文表达。
  • 在Cityscapes和PASCAL VOC上分别提升3.2%和2.8%的mIoU。
  • 适合关注细粒度分割与长尾分布问题的研究者。

语义分割虽因深度学习迅速发展,但仍面临有效捕捉局部与全局上下文及长尾分布问题的挑战。为此,本文提出Contextrast++,一种鲁棒的多尺度上下文对比学习方法,通过改进多尺度特征融合并缓解类别不平衡。该方法包含两个核心组件:1)上下文对比学习(CCL),含自适应融合模块、像素-锚点(PA)损失和锚点-锚点(AA)损失;2)边界感知负样本(BANE)采样。自适应融合模块动态平衡局部与全局特征,生成更具上下文感知的表示;PA损失利用融合后的多尺度特征优化表征学习;AA损失通过存储固定数量类平衡代表锚点的记忆库解决长尾问题。同时,BANE采样从误分类边界区域选择难负样本,提升对比学习中的细粒度精度。大量实验表明,Contextrast++在多个公开数据集上显著优于现有基于对比学习的先进方法,且推理阶段无额外计算开销。

原文摘要 · Abstract (English)

Semantic segmentation has rapidly advanced with deep learning; however, challenges remain in effectively capturing local and global contexts as well as addressing the long-tailed distribution problem. To tackle these issues, we present Contextrast++, a robust contrastive learning method for semantic segmentation that improves multi-scale feature integration and mitigates class imbalance issues. Our method consists of two key components: 1) contextual contrastive learning (CCL) and 2) boundary-aware negative (BANE) sampling. CCL includes three subcomponents: adaptive fusion module, pixel-to-anchor (PA) loss, and anchor-to-anchor (AA) loss. The adaptive fusion module dynamically balances local and global feature integration, resulting in a more context-aware representation. While the PA loss leverages the fused multi-scale features to improve feature representation learning, the AA loss focuses on addressing the long-tailed distribution problem by utilizing a memory bank that stores a fixed number of class-balanced representative anchors. Meanwhile, BANE sampling enhances segmentation precision by selecting hard negatives from misclassified boundary regions, which refines fine-grained details during contrastive learning. As verified in extensive experiments using public datasets, we demonstrate that Contextrast++ substantially improves semantic segmentation performance over existing contrastive learning-based state-of-the-art approaches, while introducing no additional computational overhead during inference.

语义分割对比学习长尾分布多尺度特征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。