arXiv:2606.26973cs.CVcs.LG2026-06

通过梯度空间修正提升开放集半监督学习的鲁棒性

Geometric Gradient Rectification for Safe Open-Set Semi-Supervised Learning

  • 用监督梯度作锚点,修正冲突的辅助梯度方向
  • 在CIFAR和ImageNet上同时提升闭集泛化与开集鲁棒性
  • 适合需要处理分布外样本的半监督学习场景

开放集半监督学习旨在利用可能包含分布外异常值的无标签数据,同时保持对分布内类别的性能。现有方法主要遵循两种范式:过滤可疑样本或使用软权重融合无标签目标。我们指出,两者均面临共同权衡:激进过滤会丢弃信息丰富但难分的分布内样本,而过度利用则可能引入与监督学习冲突的辅助梯度,当伪标签错误时尤为明显。因此,我们从样本选择转向梯度层面控制,提出几何梯度修正(GGR)框架。该框架以监督梯度为锚点,将冲突的辅助梯度投影至梯度空间中的可接受区域,确保修正后更新在局部坐标系中不与监督梯度一阶对抗,同时保留可能携带有用表征信号的正交分量。进一步通过子空间感知修正,在噪声小批量梯度下稳定锚点。在CIFAR和ImageNet基准上的实验表明,GGR在多数设置下优于代表性基线,在闭集泛化与开集鲁棒性上均有提升。代码将在https://github.com/JiaheChen2002/GGR发布。

原文摘要 · Abstract (English)

Open-set semi-supervised learning aims to leverage unlabeled data that may contain out-of-distribution outliers while maintaining performance on in-distribution classes. Existing methods mainly follow two paradigms: filtering suspicious samples or incorporating unlabeled objectives with soft weighting. We argue that both face a common trade-off: aggressive filtering can discard informative but hard ID samples, whereas utilization can introduce auxiliary gradients that conflict with supervised learning when pseudo labels are wrong. We therefore shift the focus from sample selection to gradient-level control. We propose \textit{Geometric Gradient Rectification} (GGR), a plug-in framework that uses the supervised gradient as an anchor and projects conflicting auxiliary gradients onto an admissible region in gradient space. This makes the applied auxiliary update first-order non-opposing within the rectified coordinate block while preserving orthogonal components that may still carry useful representation signals. We further extend GGR with subspace-aware rectification to stabilize the anchor under noisy mini-batch gradients. Experiments on CIFAR and ImageNet benchmarks show that GGR improves representative OSSL baselines in most settings and yields gains in both closed-set generalization and open-set robustness. Code will be available at https://github.com/JiaheChen2002/GGR.

半监督学习开放集梯度修正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。