通过衰减机制提升未知样本识别能力,显著优于现有方法。
COSTARR: Consolidated Open Set Technique with Attenuation for Robust Recognition
- 提出衰减假设,利用训练中学习的小权重来分离已知与未知特征。
- 在ImageNet2012-1K等数据集上,性能超越现有SOTA方法。
- 适用于ViTs、ConvNeXts、ResNet等多种主流模型,通用性强。
视觉识别系统中应对新类别仍是关键挑战。现有开集识别(OSR)方法依赖熟悉性假设,通过缺乏熟悉特征来检测新类。我们提出新的衰减假设:训练中学习到的小权重会衰减特征,兼具区分已知类别和丢弃有助于区分已知/未知类别的信息的双重作用。为利用这一被忽视的信息,我们提出COSTARR,结合熟悉特征存在与不熟悉特征缺失的要求。提供COSTARR分数的概率解释,其与正确分类及属于已知类别的可能性相关。消融实验表明,预衰减深层特征与未充分利用的后衰减哈达玛积特征均对性能提升至关重要。我们在大规模设置下评估,以ImageNet2012-1K作为已知数据,NINCO、iNaturalist、OpenImage-O等作为未知数据,涵盖多种现代预训练架构(ViTs、ConvNeXts、ResNet)。实验表明,COSTARR在不同架构间具有强泛化能力,显著优于先前最先进方法,通过引入此前被舍弃的衰减信息,推动开集识别能力发展。
原文摘要 · Abstract (English)
Handling novelty remains a key challenge in visual recognition systems. Existing open-set recognition (OSR) methods rely on the familiarity hypothesis, detecting novelty by the absence of familiar features. We propose a novel attenuation hypothesis: small weights learned during training attenuate features and serve a dual role-differentiating known classes while discarding information useful for distinguishing known from unknown classes. To leverage this overlooked information, we present COSTARR, a novel approach that combines both the requirement of familiar features and the lack of unfamiliar ones. We provide a probabilistic interpretation of the COSTARR score, linking it to the likelihood of correct classification and belonging in a known class. To determine the individual contributions of the pre- and post-attenuated features to COSTARR's performance, we conduct ablation studies that show both pre-attenuated deep features and the underutilized post-attenuated Hadamard product features are essential for improving OSR. Also, we evaluate COSTARR in a large-scale setting using ImageNet2012-1K as known data and NINCO, iNaturalist, OpenImage-O, and other datasets as unknowns, across multiple modern pre-trained architectures (ViTs, ConvNeXts, and ResNet). The experiments demonstrate that COSTARR generalizes effectively across various architectures and significantly outperforms prior state-of-the-art methods by incorporating previously discarded attenuation information, advancing open-set recognition capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。