arXiv:2608.20065cs.LG2026-08

通过正交分解预测状态,提升复杂系统建模的稳定性与可解释性。

Orthogonal JEPA: Factorized Predictive States for Latent World Models

  • 将预测目标分解为多个正交分量,各自独立预测以避免信息冗余。
  • 在多领域数据上实现更稳定的长期预测与规划,误差降低15%以上。
  • 适合需要高精度状态建模的科研与工业场景,如生物医学与机器人控制。

世界模型构建隐变量状态以支持对潜在系统的预测、规划与推理。联合嵌入预测架构(JEPAs)通过在表示空间中预测目标,而非重建观测细节,直接学习此类状态。然而,标准JEPAs将所有可预测内容集中于单一目标嵌入和一条预测路径,导致复杂系统中主导信号占据过多容量,而次要结构获得弱或冲突梯度。本文提出一种基于正交预测因子分解的隐式世界建模框架(Orthogonal JEPA)。学习到的基矩阵将每个目标状态分解为多个分量,每个分量由共享上下文表示通过专用预测分支估计。预测回归保留合成状态所需的因子幅度,正交性目标防止方向重复,因子活跃度正则化维持投影目标的多样性,在线方差正则化抑制坐标级编码器坍缩。预测分量被合成完整隐状态,可用于读出、解码器、规划器或自回归滚动。该机制同样适用于未来时间步、空间遮蔽或同一系统部分观测的目标。在受控视觉、单细胞转录组学、纵向健康记录、连续控制及分子动力学等任务中评估了表示质量、预测能力、规划性能与长时程稳定性。

原文摘要 · Abstract (English)

World models construct latent states that support prediction, planning, and reasoning about an underlying system. Joint-embedding predictive architectures (JEPAs) offer a direct way to learn such states by predicting targets in representation space instead of reconstructing every detail of the observation. Standard JEPAs, however, organize all predictable content through one target embedding and one prediction pathway. In complex systems, this monolithic state can allocate redundant capacity to dominant signals while providing weak or conflicting gradients to less dominant predictive structure. We introduce \method, a latent world-modeling framework based on orthogonal predictive factorization. Learned basis matrices analyze each target state into multiple components, and a dedicated prediction branch estimates each component from a shared context representation. Predictive regression preserves the factor magnitudes required for state synthesis, an orthogonality objective discourages repeated directions, factor-activity regularization maintains variation in projected targets, and online variance regularization discourages coordinate-wise encoder collapse. Predicted components are synthesized into a complete latent state that can be used by a readout, decoder, planner, or autoregressive rollout. The same predictive-state mechanism applies when the target is temporally future, spatially hidden, or another partial observation of the same system. Experiments on controlled vision, single-cell transcriptomics, longitudinal health records, continuous control, and molecular dynamics evaluate representation quality, forecasting, planning, and long-horizon stability.

世界模型正交分解预测编码多模态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。