arXiv:2604.21046cs.LG2026-04

通过几何结构优化提升半监督图像分类效果,加快收敛速度。

JEPAMatch: Geometric Representation Shaping for Semi-Supervised Learning

论文配图:JEPAMatch: Geometric Representation Shaping for Semi-Supervised Learning
图 1 · 摘自论文原文
  • 用潜在空间正则化强制特征分布呈各向同性高斯结构。
  • 在CIFAR-100等数据集上显著优于现有方法,收敛速度提升明显。
  • 适合关注模型泛化与训练效率的视觉任务研究者。

半监督学习利用大量无标签数据,在标签稀缺时提升模型性能。现有基于FixMatch的方法虽表现优异,但存在两大瓶颈:多数类主导学习过程,错误伪标签加剧偏差;早期噪声伪标签阻碍决策边界清晰化,需长期训练才能获得有效表示。本文提出从传统置信度阈值转向显式几何表示塑造的新范式。受最近提出的LeJEPA框架启发,该框架理论表明有意义的表示应在潜空间中呈现各向同性高斯结构。我们结合FlexMatch的经典半监督损失与源自LeJEPA的潜空间正则项,设计新训练目标,促进结构化表示的同时保留伪标签优势。在CIFAR-100、STL-10和Tiny-ImageNet上的大量实验表明,本方法持续优于现有基线,且显著加速收敛,大幅降低整体计算成本。

原文摘要 · Abstract (English)

Semi-supervised learning has emerged as a powerful paradigm for leveraging large amounts of unlabeled data to improve the performance of machine learning models when labeled data are scarce. Among existing approaches, methods derived from FixMatch have achieved state-of-the-art results in image classification by combining weak and strong data augmentations with confidence-based pseudo-labeling. Despite their strong empirical performance, these methods typically struggle with two critical bottlenecks: majority classes tend to dominate the learning process, which is amplified by incorrect pseudo-labels, leading to biased models. Furthermore, noisy early pseudo-labels prevent the model from forming clear decision boundaries, requiring prolonged training to learn informative representation. In this paper, we introduce a paradigm shift from conventional logical output threshold base, toward an explicit shaping of geometric representations. Our approach is inspired by the recently proposed Latent-Euclidean Joint-Embedding Predictive Architectures (LeJEPA), a theoretically grounded framework asserting that meaningful representations should exhibit an isotropic Gaussian structure in latent space. Building on this principle, we propose a new training objective that combines the classical semi-supervised loss used in FlexMatch, an adaptive extension of FixMatch, with a latent-space regularization term derived from LeJEPA. Our proposed approach, encourages well-structured representations while preserving the advantages of pseudo-labeling strategies. Through extensive experiments on CIFAR-100, STL-10 and Tiny-ImageNet, we demonstrate that the proposed method consistently outperforms existing baselines. In addition, our method significantly accelerates the convergence, drastically reducing the overall computational cost compared to standard FixMatch-based pipelines.

半监督学习几何表示特征结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。