arXiv:2510.25174cs.CV2025-10中稿 · IEEE TRANSACTIONS …

动态调整分类器,提升图像语义分割精度

Classifier Enhancement Using Extended Context and Domain Experts for Semantic Segmentation

  • 用记忆库融合全局与局部上下文,动态优化分类器
  • 在ADE20K等3个数据集上达到顶尖性能
  • 适合关注小类分割与类别不平衡问题的研究者

主流语义分割方法通常使用固定参数的朴素分类器对每个像素进行分类。尽管这类分类器能从训练数据中学习全局信息,但其表示方式为一组固定权重和偏置。然而,每张图像具有不同的类别分布,导致分类器难以捕捉单张图像的独特特征。在数据集层面,类别不平衡使模型偏向多数类,限制了对少数类区域的识别能力。本文提出一种扩展上下文感知分类器(ECAC),通过全局(数据集级)和局部(图像级)上下文信息动态调整分类器。具体而言,利用记忆库学习每类的全局上下文信息,并结合当前图像的类别特异性上下文信息,以提升像素标记精度。此外,采用教师-学生网络范式,由领域专家(教师网络)基于真实标签动态调整上下文信息,并将知识传递给学生网络。大量实验表明,所提ECAC在ADE20K、COCO-Stuff10K和Pascal-Context等多个数据集上均达到先进水平。

原文摘要 · Abstract (English)

Prevalent semantic segmentation methods generally adopt a vanilla classifier to categorize each pixel into specific classes. Although such a classifier learns global information from the training data, this information is represented by a set of fixed parameters (weights and biases). However, each image has a different class distribution, which prevents the classifier from addressing the unique characteristics of individual images. At the dataset level, class imbalance leads to segmentation results being biased towards majority classes, limiting the model's effectiveness in identifying and segmenting minority class regions. In this paper, we propose an Extended Context-Aware Classifier (ECAC) that dynamically adjusts the classifier using global (dataset-level) and local (image-level) contextual information. Specifically, we leverage a memory bank to learn dataset-level contextual information of each class, incorporating the class-specific contextual information from the current image to improve the classifier for precise pixel labeling. Additionally, a teacher-student network paradigm is adopted, where the domain expert (teacher network) dynamically adjusts contextual information with ground truth and transfers knowledge to the student network. Comprehensive experiments illustrate that the proposed ECAC can achieve state-of-the-art performance across several datasets, including ADE20K, COCO-Stuff10K, and Pascal-Context.

语义分割分类器优化上下文建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。