让视频世界模型在推理时安全优化,避免评估偏差。
SCOPE: Score-Isolated Agentic Optimization for Video World Models

- 将外部控制抽象为有类型的状态,仅允许受约束的更新
- 在Physics-IQ上比原始冻结模型提升14.24分(95%置信区间8.10~21.23)
- 适合需要可审计推理优化的机器人决策系统
视频世界模型日益用于规划与具身决策的模拟器,但推理时改进会引入微妙的评估问题:提示、采样器、验证器和选择器可能共同演化,难以归因性能提升,且保留反馈可能影响最终策略。我们提出 scope( extit{ extsc{Score-Isolated Agentic Optimization}}),一种可审计的冻结视频世界模型推理时自适应框架。 scope 将外部控制表示为有类型状态,仅通过开发证据支持的有限变化更新该状态,并在保留测试前冻结最终策略。在 Physics-IQ 基准上, scope 相比精确冻结基线提升 +14.24(95\/% 置信区间 [+8.10, +21.23])。受控消融实验进一步揭示了场景指定、采样和学习选择带来的增益,但相较于最强匹配的代理基线,提升幅度仍不明确。跨主干和前瞻性评估显示互补结果:有用的推理时更新存在,但其收益并不在不同模型与设置间均匀传递。这些发现共同表明,可靠的推理时自适应不仅需要更好的提议,还需一个严谨机制来决定哪些更新应成为部署系统的一部分。代码已公开于 https://github.com/YuhuaJiang2002/SCOPE。
原文摘要 · Abstract (English)
Video world models are increasingly used as simulators for planning and embodied decision making, yet improving them at inference time introduces a subtle evaluation problem: prompts, samplers, verifiers, and selectors may evolve together, making it difficult to attribute gains or prevent held-out feedback from shaping the final policy. We introduce \scope (\emph{\scopefullname}), a framework for auditable inference-time adaptation of frozen video world models. \scope represents external controls as a typed state, updates this state only through bounded changes supported by development evidence, and freezes the resulting policy before held-out evaluation. On Physics-IQ benchmark, \scope improves over the exact frozen base by $+14.24$ (95\% CI $[+8.10,+21.23]$). Controlled ablations further identify gains from scene specification, sampling, and learned selection, while the margin over the strongest matched agentic baseline remains unresolved. Cross-backbone and prospective evaluations reveal a complementary result: useful inference-time updates exist, but their benefits do not transfer uniformly across models and settings. Together, these findings suggest that reliable inference-time adaptation requires not only better proposals, but also a principled mechanism for deciding which updates should become part of the deployed system. Code is available at https://github.com/YuhuaJiang2002/SCOPE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。