arXiv:2607.04548cs.CVcs.AI2026-07被引 2

让新类别发现过程可解释,用语义概念空间替代黑箱特征空间。

Explainable Novel Category Discovery in Semantic Concept Space

论文配图:Explainable Novel Category Discovery in Semantic Concept Space
图 1 · 摘自论文原文
  • 在语义概念空间中进行聚类与伪标签分配,避免黑箱特征空间。
  • CIFAR-10准确率达92.63%,CIFAR-100提升至76.45%。
  • 提供可读的类别和实例级解释,适合需要透明性的场景。

新类别发现旨在通过迁移已知类别的知识,从无标签数据中识别未见类别,但现有方法多在不透明的隐层特征空间中进行,虽能准确分离新类别,却难以揭示其语义依据。本文提出xNCD框架,在结构化的语义概念空间中实现基于表示的发现与伪标签分配。该方法通过对齐视觉特征与预训练多模态模型中的视觉-语言相似性先验,学习无标签的概念表示,并在概念空间的逻辑值上应用统一的有标签与无标签自标注目标。此设计使每个发现类别天然可解释,具备稳定的概念签名与实例级概念证据。理论上,通过语义概念瓶颈限制了特征空间假设类,排除大量无约束决策规则,使划分偏向语义可解释坐标。在CIFAR-10、CIFAR-100和CUB-200上的实验表明,xNCD在保持强发现性能的同时提供内在解释能力:任务无关评估下,CIFAR-10总体准确率达92.63%,接近UNO的93.4%;CIFAR-100从73.2%提升至76.45%,且是唯一提供人类可读的类别与实例级解释的方法。

原文摘要 · Abstract (English)

Novel category discovery aims to identify unseen classes from unlabeled data by transferring knowledge from labeled categories, but most existing methods perform discovery in opaque latent feature spaces. As a result, they may separate novel categories accurately while providing little insight into what semantic evidence defines each discovered group. We propose xNCD, an explainable novel category discovery framework that performs both representation-based discovery and pseudo-label assignment directly in a structured semantic concept space. Instead of clustering arbitrary deep features, xNCD learns a label-free concept representation by aligning visual features with vision-language similarity priors from pretrained multimodal models, and then applies a unified labeled-and-unlabeled self-labeling objective over concept-space logits. This design makes each discovered category explainable by construction through stable concept signatures and instance-level concept evidence. Theoretically, we show that routing discovery through a semantic concept bottleneck induces a strict restriction of the feature-space hypothesis class, excluding a large family of unconstrained decision rules and biasing induced partitions toward semantically interpretable concept coordinates. Experiments on CIFAR-10, CIFAR-100, and CUB-200 demonstrate that xNCD preserves strong discovery performance while providing intrinsic explanations. Under task-agnostic evaluation, xNCD achieves 92.63% overall accuracy on CIFAR-10, close to UNO's 93.4%, and improves CIFAR-100 overall accuracy from 73.2% to 76.45%, while being the only compared method that provides human-readable cluster- and instance-level explanations.

新类别发现可解释性语义空间多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。