arXiv:2410.21807cs.CVcs.AI2024-10被引 3

用非负矩阵分解重做类别发现,让新旧类别更清晰分离。

A Fresh Look at Generalized Category Discovery through Non-negative Matrix Factorization

  • 通过非负矩阵分解建立聚类与对比学习的等价关系。
  • 在语义漂移基准上达到66.1%平均准确率,领先4.7个百分点。
  • 适合研究零样本分类和类别发现的算法开发者。

广义类别发现(GCD)旨在仅用标注的基础类别数据对基础和新颖图像进行分类。然而,现有方法未能充分优化基于余弦相似性的共现矩阵$ar{A}$,导致基础-新颖区域未完全分离且基础/新颖域稀疏性不足。为此,本文提出非负广义类别发现(NN-GCD)框架,采用对称非负矩阵分解(SNMF)作为数学媒介,证明最优K均值与最优SNMF等价,且SNMF求解器与非负对比学习(NCL)优化等价。利用该理论,将$ar{A}$优化与K均值聚类重构为NCL优化问题。为进一步满足非负约束并使模型收敛至近优区域,引入GELU激活函数与NMF NCE损失。为使$ar{A}$从次优状态过渡到理想状态$ar{A}^*$,设计混合稀疏正则化策略施加稀疏约束。实验表明,NN-GCD在多个GCD基准上优于现有方法,于语义漂移基准上实现66.1%平均准确率,较前人提升4.7%。

原文摘要 · Abstract (English)

Generalized Category Discovery (GCD) aims to classify both base and novel images using labeled base data. However, current approaches inadequately address the intrinsic optimization of the co-occurrence matrix $\bar{A}$ based on cosine similarity, failing to achieve zero base-novel regions and adequate sparsity in base and novel domains. To address these deficiencies, we propose a Non-Negative Generalized Category Discovery (NN-GCD) framework. It employs Symmetric Non-negative Matrix Factorization (SNMF) as a mathematical medium to prove the equivalence of optimal K-means with optimal SNMF, and the equivalence of SNMF solver with non-negative contrastive learning (NCL) optimization. Utilizing these theoretical equivalences, it reframes the optimization of $\bar{A}$ and K-means clustering as an NCL optimization problem. Moreover, to satisfy the non-negative constraints and make a GCD model converge to a near-optimal region, we propose a GELU activation function and an NMF NCE loss. To transition $\bar{A}$ from a suboptimal state to the desired $\bar{A}^*$, we introduce a hybrid sparse regularization approach to impose sparsity constraints. Experimental results show NN-GCD outperforms state-of-the-art methods on GCD benchmarks, achieving an average accuracy of 66.1\% on the Semantic Shift Benchmark, surpassing prior counterparts by 4.7\%.

类别发现非负矩阵聚类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。