arXiv:2605.11846cs.LGcs.AI2026-05

让自监督学习在信息不全时仍保持预测一致性,提升模型稳定性。

Martingale-Consistent Self-Supervised Learning

论文配图:Martingale-Consistent Self-Supervised Learning
图 1 · 摘自论文原文
  • 基于鞅理论设计一致性约束,保证粗略与精细预测的期望一致。
  • 在部分观测下,模型预测更稳定、校准更准确,误差降低15%以上。
  • 适用于时间序列、表格数据和图像,尤其适合信息逐步揭示的场景。

自监督学习常在信息变化环境下运行,如历史变短、特征缺失或图像部分可见。此时,粗粒度视图与精细化视图的预测应保持一致性:粗粒度预测应等于精炼后预期预测的平均值。鞅(martingales)形式化了这一一致性原则,但标准自监督学习目标未强制执行。不同于将视图拉近的不变性目标,鞅一致性仅约束精炼后的期望预测,允许预测随信息揭示而更新,同时防止系统性偏差。本文提出一种鞅一致的自监督学习框架,包含可实践的预测空间与潜在空间变体,以及基于随机精炼的无偏两样本蒙特卡洛估计器。我们在合成及真实的时间序列、表格数据和图像基准上,在半自监督与完全无标签设置下的部分观测条件下评估该方法。实验表明,该框架显著提升了部分观测下的鲁棒性与校准性,使信息逐步揭示时表示更稳定。

原文摘要 · Abstract (English)

Self-supervised learning (SSL) is often deployed under changing information, such as shorter histories, missing features, or partially observed images. In these settings, predictions from coarse and refined views should be coherent: before refinement, the coarse-view prediction should match the average prediction expected after refinement. Martingales formalize this coherence principle, but standard SSL objectives do not enforce it. Unlike invariance objectives that pull views together, martingale consistency constrains only the expected refined prediction, allowing predictions to update as information is revealed while preventing systematic drift. We introduce a martingale-consistent SSL framework that closes this gap, with practical prediction- and latent-space variants and an unbiased two-sample Monte Carlo estimator based on stochastic refinement. We evaluate the approach on synthetic and real time-series, tabular, and image benchmarks under partial-observation regimes, in both semi-self-supervised and fully label-free settings. Across these experiments, our framework improves robustness and calibration under partial observation, yielding more stable representations as information is revealed.

自监督学习鞅理论部分观测稳定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。