在实例分割中发现新类别,提升模型对未知类别的识别能力。
Generalized Class Discovery in Instance Segmentation
- 通过实例级温度调节增强头部类别的泛化能力
- 动态调整伪标签可靠性标准,提升尾部类别的学习效果
- 适合长尾分布下的开放世界实例分割任务
本文研究实例分割中的广义类别发现(GCD)任务,目标是在有标注和无标注数据条件下,发现新类别并训练出能分割已知与未知类别的模型。由于真实世界物体分布具有长尾特性,各类别实例数量严重不均。为此,提出实例级温度分配(ITA)方法以缓解对比学习中头部类别的过强判别性,并引入类别级伪标签可靠性准则,避免在使用伪标签训练时过度剔除尾部类别的样本。同时,动态调整可靠性阈值,在训练初期利用多样化样本,在后期仅依赖高可信度伪标签。此外,设计高效软注意力模块以编码对象特定表示。在 COCO$_{half}$ + LVIS 和 LVIS + Visual Genome 两个设置下进行实验,结果表明该方法优于现有最先进方法。
原文摘要 · Abstract (English)
This work addresses the task of generalized class discovery (GCD) in instance segmentation. The goal is to discover novel classes and obtain a model capable of segmenting instances of both known and novel categories, given labeled and unlabeled data. Since the real world contains numerous objects with long-tailed distributions, the instance distribution for each class is inherently imbalanced. To address the imbalanced distributions, we propose an instance-wise temperature assignment (ITA) method for contrastive learning and class-wise reliability criteria for pseudo-labels. The ITA method relaxes instance discrimination for samples belonging to head classes to enhance GCD. The reliability criteria are to avoid excluding most pseudo-labels for tail classes when training an instance segmentation network using pseudo-labels from GCD. Additionally, we propose dynamically adjusting the criteria to leverage diverse samples in the early stages while relying only on reliable pseudo-labels in the later stages. We also introduce an efficient soft attention module to encode object-specific representations for GCD. Finally, we evaluate our proposed method by conducting experiments on two settings: COCO$_{half}$ + LVIS and LVIS + Visual Genome. The experimental results demonstrate that the proposed method outperforms previous state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。