提出新方法SpHOR,让深度模型更好识别训练外的未知类别。
SphOR: A Representation Learning Perspective on Open-set Recognition for Identifying Unknown Classes in Deep Learning Models
- 先用定制化表示学习构建更清晰的特征空间,再训练分类器。
- 在多个基准上达到最优性能,细粒度数据集提升达5.1%。
- 适合需要高可信度未知类识别的安全关键场景使用。
深度神经网络在安全关键和现实应用中广泛应用,亟需开放集识别(OSR)能力,以识别训练阶段未见的类别,而非错误归入已知类。现有方法多联合训练特征提取与分类头,导致对未知数据表征适应性差;或采用通用目标函数如监督对比学习,不专为OSR设计。为此,我们提出SpHOR,通过监督表示学习显式塑造特征空间。其核心创新包括:(1)利用正交标签嵌入强化类别特异性特征,实现类间清晰分离;(2)施加球面约束,将表示建模为冯·米塞斯-费舍尔分布混合;(3)在表示学习阶段直接集成Mixup与标签平滑(LS)。为量化各技术对OSR表示的增强效果,引入角分离度(AS)与范数分离度(NS)两个指标。结合三项创新,SpHOR在多种粗粒度与细粒度开放集基准上取得领先表现(在AUROC与OSCR上),尤其在语义漂移基准上提升最高达5.1%。代码见https://github.com/nadarasarbahavan/SpHOR。
原文摘要 · Abstract (English)
The reliance on Deep Neural Network (DNN)-based classifiers in safety-critical and real-world applications necessitates Open-Set Recognition (OSR). OSR enables the identification of input data from classes unknown during training as unknown, as opposed to misclassifying them as belonging to a known class. DNNs consist of a feature extraction backbone and classifier head; however, most OSR methods typically train both components jointly, often yielding feature representations that adapt poorly to unknown data. Other approaches employ off-the-shelf objectives, such as supervised contrastive learning, which are not specifically designed for OSR. To address these limitations, we propose SpHOR, which explicitly shapes the feature space via supervised representation learning, before training a classifier. Instead of relying on generic feature learning, SpHOR custom-designs representation learning for OSR through three key innovations: (1) enforcing discriminative class-specific features via orthogonal label embeddings, ensuring clearer separation between classes. (2) imposing a spherical constraint, modeling representations as a mixture of von Mises-Fisher distributions. (3) integrating Mixup and Label Smoothing (LS) directly into the representation learning stage. To quantify how these techniques enhance representations for OSR, we introduce two metrics: the Angular Separability (AS) and Norm Separability (NS). Combining all three innovations, SpHOR achieves state-of-the-art results (in AUROC and OSCR) across various coarse-grained and fine-grained open-set benchmarks, particularly excelling on the Semantic Shift Benchmark with improvements up to 5.1\%. Code at https://github.com/nadarasarbahavan/SpHOR
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。