让端到端模型拥有预训练模型的几何优势,提升规划效果。
SCALE: State-Calibrated Latent Embeddings for JEPA Planning in the Right Geometry
- 通过关联隐空间距离与任务状态空间距离,校准隐向量几何结构。
- 在五项任务中,所有求解器平均性能均优于原模型,提升显著。
- 仅需轻量级训练正则,无推理开销,适合高效规划系统部署。
联合嵌入预测世界模型通过将预测终端嵌入与目标嵌入比较来规划,成本基于表示本身定义。两种主流获取非坍缩表示的方法是:继承预训练特征空间(如 DINO-WM),或端到端学习并使用反坍缩正则化(如 LeWorldModel with SIGReg)。两者在不同任务上表现互补。尽管两类模型均可解码任务相关状态,但 DINO-WM 的前主成分通常保留更多状态信息。由于欧氏规划成本受高方差方向主导,这一差异影响状态对候选选择的影响力。我们提出 SCALE(State-CAlibrated Latent Embeddings),使端到端模型的隐空间具备 DINO-WM 所展现的有利几何特性。SCALE 通过将采样的成对隐空间距离与标准化任务相关状态空间距离相关联,实现该特性,无需替换原模型的编码器。在五个任务、三种规划求解器和五个计算预算下,SCALE 在每项任务-求解器组合上的平均表现均优于原始模型。一个隐空间到状态的回归对照实验在嵌入可解码性上达到或超过 SCALE,但隐空间-状态距离对齐几乎不变,且规划收益更不一致。SCALE 仅增加一个轻量级训练时正则,无规划时开销。结果表明,规划不仅依赖于任务相关信息是否存在,还取决于其是否塑造了规划器所用的几何结构。
原文摘要 · Abstract (English)
Joint-embedding predictive world models plan by scoring predicted terminal embeddings against a goal embedding using a cost defined on the representation itself. Two prominent strategies for obtaining non-collapsed representations are to inherit a pretrained feature space, as in DINO-WM, and to learn an embedding end to end with anti-collapse regularization, as in LeWorldModel (LeWM) with SIGReg. These strategies show complementary strengths across tasks. Although task-relevant state is decodable from the full embeddings of both models, DINO-WM's leading principal components usually retain substantially more state information than LeWM's. Because Euclidean planning costs are dominated by high-variance directions, this difference affects how strongly state can influence candidate selection. We propose SCALE (State-CAlibrated Latent Embeddings) to give the end-to-end LeWM representation the favorable geometric property observed in DINO-WM. SCALE induces this property by correlating sampled pairwise latent distances with distances in a standardized task-relevant state space, without replacing LeWM's learned encoder. Across five tasks, three planning solvers, and five compute budgets, SCALE improves every task--solver average over LeWM. A latent-to-state regression control matches or exceeds SCALE's full-embedding decodability yet leaves latent--state distance alignment essentially unchanged and yields less consistent planning gains. SCALE adds a single lightweight training-time regularizer and no planning-time overhead. These results show that planning depends not only on whether task-relevant information is present, but also on whether it shapes the geometry consumed by the planner.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。