arXiv:2605.09423cs.AI2026-05被引 3

用会自我进化代码的智能体自动生成可交互的3D学习环境。

SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learning

论文配图:SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learning
图 1 · 摘自论文原文
  • 用语言/图像指令驱动代码智能体构建物理真实的3D世界
  • 自进化机制提升生成可靠性,使智能体在新环境上表现提升18点
  • 支持环境与智能体协同进化,适合强化学习和具身智能研究者

基于大模型的数字智能体在编程、网页导航和计算机使用等场景中快速发展,得益于可扩展的仿真沙箱。相比之下,具身智能体仍缺乏丰富、多样且可自动生成的3D交互环境。现有模拟器依赖人工设计或程序化模板,而近期基于大模型的3D生成系统多生成静态场景,难以支持可验证任务和标准学习接口。本文提出SimWorld Studio,一个基于虚幻引擎5的开源平台,用于生成动态演进的具身学习环境。核心是SimCoder——一种技能增强的代码智能体,能根据语言或图像指令编写并执行引擎级代码,构建物理真实的3D世界。SimCoder通过编译错误、物理检测和视觉语言模型反馈进行自我进化,持续优化环境并积累可复用工具与技能。生成环境以Gym风格导出,供具身智能体学习。平台还支持环境与智能体的协同进化:智能体性能反馈引导SimCoder生成贴近学习者能力边界的适应性课程,使环境随智能体进步而逐渐变难。三个具身导航案例表明,自进化提升生成可靠性,生成环境显著提升智能体泛化性能;协同进化相较固定环境学习提升18个百分点,较未训练智能体提升40个百分点。

原文摘要 · Abstract (English)

LLM/VLM-based digital agents have advanced rapidly thanks to scalable sandboxes for coding, web navigation, and computer use, which provide rich interactive training grounds. In contrast, embodied agents still lack abundant, diverse, and automatically generated 3D environments for interactive learning. Existing embodied simulators rely on manually crafted scenes or procedural templates, while recent LLM-based 3D generation systems mainly produce static scenes rather than deployable environments with verifiable tasks and standard learning interfaces. We introduce SimWorld Studio, an open-source platform built on Unreal Engine 5 for generating evolving embodied learning environments. At its core is SimCoder, a tool/skill-augmented coding agent that writes and executes engine-level code to construct physically grounded 3D worlds from language/image instructions. SimCoder self-evolves by using verifier feedback (e.g., compilation errors, physics checks, VLM critiques) to revise environments and autonomously add reusable tools and skills to its library. Generated worlds are exported as Gym-style environments for embodied agent learning. SimWorld Studio further enables co-evolution between environment generation and embodied learning: agent performance feedback guides SimCoder to generate adaptive curricula near the learner's capability frontier, so that environments become increasingly challenging as the embodied agent improves. Three case studies on embodied navigation show that self-evolution improves generation reliability, generated environments substantially improve embodied agent performance that generalizes to unseen benchmarks, and co-evolution yields an 18-point success-rate gain over fixed-environment learning and a 40-point gain over an untrained agent.

具身智能环境生成自进化强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。