arXiv:2510.11892cs.CL2025-10被引 11

用外部教程增强大模型世界模型,提升长期任务规划准确性

R-WoM: Retrieval-augmented World Model For Computer-use Agents

  • 引入外部知识检索,让大模型世界模型更真实可靠
  • 在长序列任务中相对基线提升最高达23.4%
  • 适合需要长期推理的数字环境智能体开发

大型语言模型(LLMs)可作为世界模型,在数字环境中通过模拟未来状态和预测动作结果来提升智能体决策能力,从而减少高成本的试错探索。然而,其性能受限于幻觉问题和静态训练知识,导致长期模拟中错误累积。为系统评估LLMs在世界建模中的适用性,我们通过三个任务——下一状态识别、完整流程规划对齐和里程碑转换识别——检验世界模型的核心能力。结果显示,虽然LLMs能有效捕捉即时下一步状态并识别有意义的状态转换,但在完整流程规划任务中表现迅速下降,暴露出其在长时序动态建模上的局限性。为此,我们提出检索增强的世界模型(R-WoM),通过从外部教程中检索事实性、实时知识来约束LLM的模拟过程。实验表明,R-WoM在OSWorld和Webarena数据集子集上相较基线分别实现最高23.4%和16.3%的相对提升,尤其在长周期任务中优势显著。

原文摘要 · Abstract (English)

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However, this capability is fundamentally limited by LLMs' tendency toward hallucination and their reliance on static training knowledge, which can lead to compounding errors that inhibit long-horizon simulations. To systematically investigate whether LLMs are appropriate for world modeling, we probe two core capabilities of world models--future state prediction and reward estimation--through three tasks: next-state identification, full-procedure planning alignment, and milestone transition recognition. Our analysis shows that while LLMs effectively capture immediate next states and identify meaningful state transitions, their performance rapidly degrades in full-procedure planning. This highlights LLMs' limitations in reliably modeling environment dynamics over long horizons. To address these limitations, we propose the Retrieval-augmented World Model (R-WoM), which grounds LLM simulations by incorporating factual, up-to-date knowledge retrieved from external tutorials. Experiments show that R-WoM achieves relative improvements of up to 23.4% and 16.3% on the subsets of OSWorld and Webarena compared to baselines, with particular advantage in longer-horizon simulations.

世界模型智能体检索增强长程规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。