让智能体自主构建任务域模型,减少错误并无需人工干预。
Learning Hierarchical Domain Models Through Environment-Grounded Interaction
- 通过分层抽象与环境模拟自动修正模型不一致
- 在两个国际规划竞赛和机器人装配任务中准确率更高
- 无需人类反馈,仅需基础技能和仿真器
域模型使自主智能体能生成可解释的长期任务计划。但在开放世界中,单一通用域模型难以覆盖多样任务,智能体必须实时生成特定任务的模型。大语言模型(LLMs)虽具备常识知识可生成域模型,但错误率高,限制应用;现有方法依赖大量人工反馈或先验知识,阻碍自主部署。本文提出LODGE框架,通过LLM与环境接地实现自主域学习。该框架基于分层抽象与自动化模拟,识别并修正抽象层间及模型与环境间的不一致。其任务无关性体现在仅需访问仿真器和一组通用可执行低级技能,即可生成谓词、操作符及其前提与效果。在两个国际规划竞赛(IPC)领域和一个机器人装配领域实验中,LODGE生成的域模型更准确,任务成功率更高,且所需环境交互极少,无需人类反馈或示范。
原文摘要 · Abstract (English)
Domain models enable autonomous agents to solve long-horizon tasks by producing interpretable plans. However, in open-world environments, a single general domain model cannot capture the variety of tasks, so agents must generate suitable task-specific models on the fly. Large Language Models (LLMs), with their implicit common knowledge, can generate such domains, but suffer from high error rates that limit their applicability. Hence, related work relies on extensive human feed-back or prior knowledge, which undermines autonomous, open-world deployment. In this work, we propose LODGE, a framework for autonomous domain learning from LLMs and environment grounding. LODGE builds on hierarchical abstractions and automated simulations to identify and correct inconsistencies between abstraction layers and between the model and environment. Our framework is task-agnostic, as it generates predicates, operators, and their preconditions and effects, while only assuming access to a simulator and a set of generic, executable low-level skills. Experiments on two International Planning Competition ( IPC) domains and a robotic assembly domain show that LODGE yields more accurate domain models and higher task success than existing methods, requiring remarkably few environment interactions and no human feedback or demonstrations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。