让优化策略真正可复用,通过验证而非直接套用提升模型持续学习效率
verdi: retrieval is not transfer for continual world model optimization

- 用推理时探针构建模型的优化指纹,作为检索依据
- 仅在目标端验证后才接受过往策略为可用知识,减少错误迁移
- 能自动发现并改进诊断手段,适合长期优化任务的系统
基础世界模型在规划、仿真和具身智能方面取得显著进展,但针对用户目标优化预训练模型仍面临挑战:每次优化通常从头开始,且成果难以迁移到后续模型。现有研究代理将成功策略视为可直接复用的方案,缺乏对迁移适用性的原则性保障。本文提出VERDI,一种基于证据许可的世界模型持续优化框架。VERDI通过共享的推理时探针刻画每个模型,构建优化指纹;检索相关经验作为排序后的优化假设,并在冻结的目标侧验证器上验证候选策略后才纳入可复用证据;相邻指纹间的矛盾还会触发探针演化,持续优化诊断表示本身。在Ctrl-World、Cosmos系列及RoboCoin上的实验表明,VERDI将搜索成本降低68%,GPU成本降低69%,负迁移率从0.34降至0.06,转移结果预测准确率达83%。
原文摘要 · Abstract (English)
Foundation world models have made remarkable progress in planning, simulation, and embodied intelligence. However, optimizing a pretrained world model toward a user-specified objective remains difficult: each campaign typically rediscovers optimization strategies from scratch, and the resulting knowledge rarely transfers to the next model. Existing research agents automate the optimization loop but treat successful strategies as directly reusable recipes, without principled safeguards for when transfer is appropriate. We argue instead that retrieval is not transfer: a strategy validated on one model is at best an optimization hypothesis for another, and becomes transferable knowledge only after target-side experimental valida- tion. Guided by this principle, we propose VERDI , a continual framework for evidence-licensed world model optimization. VERDI characterizes each world model through shared inference-time probes to construct an Optimization Fin- gerprint, retrieves relevant prior experience as ranked hypotheses, and validates every candidate under a frozen target-side verifier before admitting it as reusable evidence; contradictions among nearby fingerprints further trigger probe evolution, continually refining the diagnostic representation itself. Experiments on Ctrl-World, the Cosmos family, and RoboCoin show that VERDI reduces search cost by 68%, GPU cost by 69%, and negative transfer from 0.34 to 0.06, while predicting transfer outcomes with 83% sign accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。