统一四大环境接口,让机器人任务规划模型更好训练与评估。
UniETP: Unifying Environments for Generalizable Embodied Task Planning

- 整合四大仿真环境,统一观察与动作空间。
- 自动构建多难度任务数据集,覆盖复杂逻辑与指令理解。
- 支持复杂任务目标评估,助力通用智能体开发。
本文聚焦具身任务规划问题,即智能体需在交互环境中执行一系列原子动作以完成用户指定任务。尽管此前已构建多种仿真器与数据集,但各系统使用独立的观测格式、动作类型和任务领域,导致评估不一致且训练数据难以扩展。为推动通用化具身规划,我们提出UniETP,一个集成AI2-THOR、VirtualHome、Habitat、BEHAVIOR四个常用仿真器的统一接口。UniETP兼具标准化与多样性:一方面将所有仿真器形式化为一致的观测与动作空间,并构建支持复杂任务目标的评估体系;另一方面,在任务逻辑、实例定位与指令理解等维度增强任务多样性与复杂性,自动构造包含不同难度级别的新数据集。我们在该基准上对近期模型进行广泛实验,评估其具身规划能力并分析性能瓶颈。代码与数据将公开于https://github.com/woyut/UniETP。
原文摘要 · Abstract (English)
This paper focuses on the problem of Embodied Task Planning, where an agent is required to execute a sequence of atomic actions within an interactive environment to complete a user-specified task. Though a variety of simulators and datasets have previously been built for this task, these efforts are largely isolated, with each using its own observation format, action type, and task domain. This fragmentation complicates comprehensive model evaluation and hinders the scalability of training data. As an effort towards generalizable embodied planning, we propose UniETP, a unified interface integrating four commonly-used simulators (AI2-THOR, VirtualHome, Habitat, BEHAVIOR). UniETP is characterized by both standardization and diversity. On one hand, it formalizes all the simulators into a consistent observation and action space, and builds an evaluation system to support complicated task goal. On the other hand, it enhances task diversity and complexity across dimensions like task logic, instance grounding, and instruction understanding, constructing a new dataset with varied levels of difficulty in an automatic manner. Extensive experiments on the proposed benchmark are conducted to evaluate the embodied planning capabilities of recent models and analyze the performance bottlenecks. Codes and data will be available at https://github.com/woyut/UniETP .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。