arXiv:2605.14700cs.RO2026-05

用自然语言生成可运行的机器人仿真环境,1分钟内完成

SR-Platform: An Agentic Pipeline for Natural Language-Driven Robot Simulation Environment Synthesis

论文配图:SR-Platform: An Agentic Pipeline for Natural Language-Driven Robot Simulation Environment Synthesis
图 1 · 摘自论文原文
  • 用大模型分解任务,从语言描述自动生成3D场景结构
  • 5个物体场景平均耗时50秒,缓存加速后30-40秒完成
  • 适合非专业用户快速构建机器人训练环境

机器人仿真环境生成仍是基于仿真的机器人学习中的主要瓶颈。构建一个可用的MuJoCo场景通常需要掌握3D资产建模、MJCF规范、空间布局、碰撞避免和机器人模型集成等专业知识。我们提出SR-Platform,一个已投入生产的智能体系统,可将自由形式的自然语言描述转化为可执行且物理有效的MuJoCo环境。该系统将场景生成分解为四个阶段:基于大模型的调度器将用户意图转化为结构化场景计划;资产锻造模块通过大模型到CadQuery的合成方式检索缓存资产或生成新3D几何体;布局建筑师分配物体位姿并验证工业约束;桥接层组装最终MJCF场景并合并选定的机器人模型。系统以九个服务的Docker栈部署,支持WebSocket进度流、MinIO后端的网格存储、基于Qdrant的语义资产检索、Redis任务状态管理及InfluxDB遥测。基于30天生产数据(覆盖611次成功的大模型调用),SR-Platform生成五物体场景的中位端到端延迟约为50秒,缓存加速场景完成时间在30-40秒之间。资产锻造模块首次尝试重试率为11.3%,具备自动恢复能力,缓存检索可避免对已生成物体类型重复调用大模型。结果表明,智能体式场景合成能显著降低创建多样化机器人训练环境所需的手动工作量,使用户仅需英文提示即可在一分钟内生成可执行的MuJoCo场景。

原文摘要 · Abstract (English)

Generating robot simulation environments remains a major bottleneck in simulation-based robot learning. Constructing a training-ready MuJoCo scene typically requires expertise in 3D asset modeling, MJCF specification, spatial layout, collision avoidance, and robot-model integration. We present SR-Platform, a production-deployed agentic system that converts free-form natural language descriptions into executable, physically valid MuJoCo environments. SR-Platform decomposes scene synthesis into four stages: an LLM-based orchestrator that converts user intent into a structured scene plan; an asset forge that retrieves cached assets or generates new 3D geometry through LLM-to-CadQuery synthesis; a layout architect that assigns object poses and verifies industrial constraints; and a bridge layer that assembles the final MJCF scene and merges the selected robot model. The system is deployed as a nine-service Docker stack with WebSocket progress streaming, MinIO-backed mesh storage, Qdrant-based semantic asset retrieval, Redis job state, and InfluxDB telemetry. Using 30 days of production telemetry covering 611 successful LLM calls, SR-Platform generates five-object scenes with a median end-to-end latency of approximately 50 s, while cache-accelerated scenes complete in approximately 30-40 s. The asset forge shows an 11.3% first-attempt retry rate with automatic recovery, and cached asset retrieval removes per-object LLM calls for previously generated object types. These results show that agentic scene synthesis can reduce the manual effort required to create diverse robot training environments, enabling users to produce executable MuJoCo scenes from plain English prompts in under one minute.

机器人仿真自然语言生成智能体系统自动化建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。