arXiv:2609.05461cs.AIcs.LG2026-09

发现冻结的潜空间规划器会严重错判动作优劣,且闭环重规划掩盖了这一缺陷。

ARC-Bench: Closed-Loop Replanning Masks Broken Action Ranking in Frozen JEPA World Models

论文配图:ARC-Bench: Closed-Loop Replanning Masks Broken Action Ranking in Frozen JEPA World Models
图 1 · 摘自论文原文
  • 用固定候选集测试潜空间距离排序动作的能力,发现排序与真实成本不一致。
  • 在导航和操作任务中,最高分动作几乎总是次优,错误具有结构性。
  • 闭环重规划隐藏了问题,导致评估结果虚高,适合研究规划器可信度者关注。

无奖励的潜空间世界模型通过计算预测未来嵌入与目标嵌入的距离来评分候选动作:距离越近的动作越优。这隐含假设潜空间距离可排序动作,即距离排序与真实成本排序一致。本文直接检验该假设,提出ARC-Bench——一种无信息泄露、固定候选的评测协议,用于检测冻结的JEPA风格目标是否正确排序动作。对官方发布的JEPA-WM检查点在导航与操作任务上的测试显示,该假设严重失效:在操作任务中,得分最高的动作几乎总是次优,迷宫任务中也出现相同反转。控制实验表明,即使替换为视频预训练的V-JEPA 1/2编码器(ViT-L/ViT-G规模),缺陷依然存在。排除了来源、欠训练、预算匹配及度量循环等解释后,我们揭示其长期未被发现的原因:闭环重规划掩盖了问题。当降低重规划频率时,导航与操作任务的成功率均崩溃,而成功挽救的轨迹中,初始计划排名失败的比例显著偏高。因此,闭环成功率系统性夸大了冻结潜空间表示的可排序性。ARC-Bench提供测量手段,而掩蔽机制则解释了为何适应、摊销或重规划方法在不直接审计时仍存在风险。

原文摘要 · Abstract (English)

Reward-free latent world models plan by scoring candidate actions with distances in a frozen latent space: an action is preferred if its predicted future embedding lands closer to the goal embedding. This silently assumes that latent closeness is action-rankable, i.e., that ordering candidates by latent distance agrees with ordering them by true cost. We audit this assumption directly. We introduce ARC-Bench, a no-leak, fixed-candidate protocol that measures whether frozen JEPA-style objectives rank candidate actions correctly, and apply it to official released JEPA-WM checkpoints across navigation and manipulation-style control. The assumption fails, severely and structurally: on the official manipulation audits the top-scored candidate is almost always suboptimal, and the same inversion appears in the maze domains. A controlled visual-backbone extension shows that the defect persists when DINOv2 is replaced by video-pretrained V-JEPA 1 and V-JEPA 2 encoders at ViT-L/ViT-G scale. Provenance, undertraining, matched-budget backbone controls, and metric-circularity controls rule out trivial explanations. We then explain why this defect has stayed invisible: closed-loop replanning masks it. When we reduce the planner's replanning frequency, success collapses in both a navigation and a manipulation domain, and the episodes rescued by frequent replanning are enriched for severe first-plan ranking failures in the PointMaze first-plan diagnostic. Closed-loop success rates therefore systematically overstate the rankability of frozen latent representations. ARC-Bench supplies the measurement, and the masking mechanism the explanation, for methods that adapt, amortize, or replan around latent-space planners without directly auditing released JEPA-WM action rankability.

世界模型动作排序闭环规划潜空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。