将预测型自监督学习重构为显式生成模型,提升表示质量与不确定性量化能力。
Var-JEPA: A Variational Formulation of the Joint-Embedding Predictive Architecture - Bridging Predictive and Generative Self-Supervised Learning
- 基于变分推断重构JEPA,显式建模潜在生成结构
- 无需人工防坍缩正则,实现更优表征性能与不确定性估计
- 适用于表格数据,优于T-JEPA且媲美原始特征基线
联合嵌入预测架构(JEPA)常被视为非生成式自监督学习方法,强调在表示空间中的预测而非观测空间的重建。本文认为这种与概率生成建模的分离更多是表述上的,而非结构性的:标准JEPA设计(耦合编码器+上下文到目标预测器)实际上对应于特定耦合隐变量模型应用变分推断所获得的变分后验和学习到的条件先验。标准JEPA可视为一种确定性特例,其正则化通过架构和训练启发式实现,而非显式似然。基于此视角,我们提出变分JEPA(Var-JEPA),通过优化单一证据下界(ELBO)显式建模潜在生成结构。该方法无需人为防坍缩正则化,即可获得有意义的表示,并支持潜在空间中合理的不确定性量化。我们在表格数据上实例化该框架(Var-T-JEPA),在多个真实世界表格基准上表现优异,优于T-JEPA,同时保持与强原始特征基线相当的性能。
原文摘要 · Abstract (English)
The Joint-Embedding Predictive Architecture (JEPA) is often seen as a non-generative alternative to likelihood-based self-supervised learning, emphasizing prediction in representation space rather than reconstruction in observation space. We argue that the resulting separation from probabilistic generative modeling is largely rhetorical rather than structural: the canonical JEPA design (coupled encoders with a context-to-target predictor) mirrors the variational posteriors and learned conditional priors obtained when variational inference is applied to a particular class of coupled latent-variable models, and standard JEPA can be viewed as a deterministic specialization in which regularization is imposed via architectural and training heuristics rather than an explicit likelihood. Building on this view, we derive the Variational JEPA (Var-JEPA), which makes the latent generative structure explicit by optimizing a single Evidence Lower Bound (ELBO). This yields meaningful representations without ad-hoc anti-collapse regularizers and allows principled uncertainty quantification in the latent space. We instantiate the framework for tabular data (Var-T-JEPA) and achieve strong representation learning and downstream performance, improving over T-JEPA across real-world tabular benchmarks while remaining competitive with strong raw-feature baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。