arXiv:2511.04769cs.RO2025-11ICLR被引 5

用逆向设计自动生成机器人仿真环境,提升训练多样性与鲁棒性。

ReGen: Generative Robot Simulation via Inverse Design

  • 基于行为反推环境,通过结构化图生成仿真场景
  • 在自动驾驶与机械臂任务中生成更复杂多样的环境,成功率高
  • 适合需要多样化数据增强的机器人学习研究者

仿真在扩展机器人学习和验证策略中起关键作用,但构建仿真仍需大量人力。本文提出ReGen,一种通过逆向设计自动化的生成式仿真框架。给定机器人的行为(如运动轨迹或目标函数)及其文本描述,ReGen可推断出可能引发该行为的合理场景与环境。ReGen利用大语言模型扩展一个编码因果关系、相关实体及其属性的有向图,再将该图转化为符号程序,配置并执行机器人仿真环境。本框架支持:(i) 基于主体行为的数据增强;(ii) 可控的反事实场景生成;(iii) 对智能体认知与心理状态的推理;(iv) 不同感知模态的推理,例如因GPS故障导致刹车。我们在自动驾驶与机器人操作任务中验证了ReGen,生成的仿真环境比现有方法更丰富复杂,成功率达高,并能可控生成边缘情况。该方法增强了机器人策略验证能力,支持数据或仿真增强,推动了可扩展机器人学习以提升泛化与鲁棒性。代码与示例视频见:https://regen-sim.github.io/

原文摘要 · Abstract (English)

Simulation plays a key role in scaling robot learning and validating policies, but constructing simulations remains a labor-intensive process. This paper introduces ReGen, a generative simulation framework that automates simulation design via inverse design. Given a robot's behavior -- such as a motion trajectory or an objective function -- and its textual description, ReGen infers plausible scenarios and environments that could have caused the behavior. ReGen leverages large language models to synthesize scenarios by expanding a directed graph that encodes cause-and-effect relationships, relevant entities, and their properties. This structured graph is then translated into a symbolic program, which configures and executes a robot simulation environment. Our framework supports (i) augmenting simulations based on ego-agent behaviors, (ii) controllable, counterfactual scenario generation, (iii) reasoning about agent cognition and mental states, and (iv) reasoning with distinct sensing modalities, such as braking due to faulty GPS signals. We demonstrate ReGen in autonomous driving and robot manipulation tasks, generating more diverse, complex simulated environments compared to existing simulations with high success rates, and enabling controllable generation for corner cases. This approach enhances the validation of robot policies and supports data or simulation augmentation, advancing scalable robot learning for improved generalization and robustness. We provide code and example videos at: https://regen-sim.github.io/

机器人仿真逆向设计生成式模型强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。