用有限状态机让语言指令自动验证并持续执行约束
CEDAR: Automata as Verifiable Interfaces for Language-Guided Embodied Action

- 将自然语言指令转为环境事件的正则语言,构建可验证的状态机
- 在Minecraft中保持时空约束,比基线少30%的LLM调用
- 适合需要长期约束的智能体任务,如游戏自动化或机器人控制
自然语言指令驱动具身智能体时,用户常施加需随世界变化持续维持的约束。代码生成型大模型虽能产出合理行为,但其自由格式程序缺乏稳定对象,难以验证、组合新约束或从失败轨迹修复。我们提出CEDAR,一种基于反例引导的框架,将指令建模为环境事件轨迹上的正则语言。利用语言模型进行语义判断,执行轨迹用于纠错,并将技能与规范均表示为确定性有限自动机(DFA)。这使约束成为可执行的有限状态对象:学习到的技能可与“夜间休息”或“留在该生物群落”等规范相交,生成内建约束的控制器。在Minecraft中,使用与程序生成基线相同的模拟器/接口观测,CEDAR成功维持了基线无法保持的时间和空间约束,并实现了学习技能的复用,减少了累计的LLM查询量。结果表明,正则语言为自然语言指令与具身智能体策略之间提供了实用的验证层。
原文摘要 · Abstract (English)
Natural-language tasking of embodied agents is rarely just goal specification: users also impose constraints that must persist while the world changes. Code-generating LLM agents can produce plausible behaviors for such instructions, but their free-form programs provide no stable object to verify, compose with new constraints, or repair from a failing trace. We present CEDAR, a counterexample-guided framework that grounds instructions as regular languages over environment event traces. CEDAR uses a language model for semantic judgments and execution traces for correction, then represents both skills and specifications as deterministic finite automata. This turns constraints into executable finite-state objects: a learned skill can be intersected with a learned sleep at night or stay in this biome specification, yielding a controller that enforces the learned constraint by construction rather than by repeated prompting. In Minecraft, with the same simulator/API observations available to a program-generating baseline, CEDAR maintains temporal and spatial constraints that the baseline fails to preserve and amortizes reuse of learned skills, reducing cumulative LLM queries. These results suggest that regular languages offer a practical verification layer between natural-language instructions and embodied-agent policies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。