解决未知类别发现中的梯度干扰问题,提升分类鲁棒性
The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discovery

- 设计梯度协调模块,分离已知与未知类别的优化方向
- 在多个数据集上显著提升现有方法性能,达到新基准
- 适合需要增强模型泛化能力的研究者参考
广义类别发现(GCD)利用标注数据对已知或未知类别的未标注样本进行分类。现有方法通常联合优化有监督和无监督目标,取得良好效果,但内在的优化干扰仍限制其进一步提升。通过量化分析,我们识别出关键问题——梯度纠缠:1)扭曲有监督梯度,削弱已知类间的判别性;2)导致已知类与新类表示子空间重叠,降低新类可分性。为此,我们提出能量感知梯度协调器(EAGC),一个即插即用的梯度级模块,显式调节优化过程。EAGC包含两个组件:基于锚点的梯度对齐(AGA)通过参考模型锚定标注样本的梯度方向,保护已知类判别结构免受未标注梯度干扰;能量感知弹性投影(EEP)将未标注梯度软投影到已知类子空间的补空间,并根据每个样本与已知子空间的对齐程度,自适应调整投影强度,从而减少子空间重叠,同时不抑制可能属于已知类的未标注样本。实验表明,EAGC持续提升现有方法性能,并建立新最优结果。代码见 https://haiyangzheng.github.io/EAGC。
原文摘要 · Abstract (English)
Generalized Category Discovery (GCD) leverages labeled data to categorize unlabeled samples from known or unknown classes. Most previous methods jointly optimize supervised and unsupervised objectives and achieve promising results. However, inherent optimization interference still limits their ability to improve further. Through quantitative analysis, we identify a key issue, i.e., gradient entanglement, which 1) distorts supervised gradients and weakens discrimination among known classes, and 2) induces representation-subspace overlap between known and novel classes, reducing the separability of novel categories. To address this issue, we propose the Energy-Aware Gradient Coordinator (EAGC), a plug-and-play gradient-level module that explicitly regulates the optimization process. EAGC comprises two components: Anchor-based Gradient Alignment (AGA) and Energy-aware Elastic Projection (EEP). AGA introduces a reference model to anchor the gradient directions of labeled samples, preserving the discriminative structure of known classes against the interference of unlabeled gradients. EEP softly projects unlabeled gradients onto the complement of the known-class subspace and derives an energy-based coefficient to adaptively scale the projection for each unlabeled sample according to its degree of alignment with the known subspace, thereby reducing subspace overlap without suppressing unlabeled samples that likely belong to known classes. Experiments show that EAGC consistently boosts existing methods and establishes new state-of-the-art results. Code is available at https://haiyangzheng.github.io/EAGC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。