arXiv:2606.31260cs.RO2026-06

用符号化方法让机器人任务规划又快又准,验证只需毫秒

Plan Right, Then Plan Tight: Symbolic RL for Efficient Embodied Reasoning

论文配图:Plan Right, Then Plan Tight: Symbolic RL for Efficient Embodied Reasoning
图 1 · 摘自论文原文
  • 用BDDL语言构建统一接口,自动验证计划可行性
  • 在BEHAVIOR-1000上达97.3分严格通过率,比基线高25.9%
  • 自适应长度调度让难任务自动放宽约束,效率提升79%

具身任务规划要求智能体将自然语言指令转化为物理场景中的可执行动作序列,是家庭、辅助及服务机器人的关键能力。现有基于提示和强化学习的规划器虽能生成流畅动作文本,但缺乏低成本的确定性验证机制,而高保真仿真又太慢无法作为内层训练信号。本文提出仅需一个从开放世界视频或精选任务中自动生成的BDDL规范,即可作为数据构建、计划验证与奖励设计的共享接口。结合视频转BDDL解析器、大模型验证器与轻量符号引擎,实现毫秒级密集反馈。进一步引入GroupAdapt,利用批次内通过率作为零成本信号,使困难提示获得更宽松的长度容忍度,并随通过率提升自动收紧。在该验证器与调度策略引导下,8B规模规划器在BEHAVIOR-1000上取得97.3的严格通过率,相较Qwen3-8B基线提升25.9%;超越最强大型模型基线3.5%,同时响应长度压缩79%至207个标记,体现高效与有效兼具。

原文摘要 · Abstract (English)

Embodied task planning asks an agent to turn a natural-language instruction into an executable sequence of actions in a physical scene, and is a building block for household, assistive, and service robots. Recent prompting-based and reinforcement-learning planners generate fluent action text but lack a cheap deterministic check that the produced plan is valid in the target world, while high-fidelity simulation is too slow to serve as an inner-loop training signal. The general problem is therefore how to obtain verifiable supervision and rewards for embodied planners without relying on string-level matching or full simulation. Here we show that a single BDDL specification, automatically constructed from open-world video evidence or curated tasks, can serve as a shared interface for data construction, plan verification, and reward design. A video-to-BDDL parser, an LLM verifier, and a lightweight symbolic engine together supply dense feedback at millisecond latency. We further introduce GroupAdapt, a difficulty-aware length schedule that uses the in-batch group pass rate as a zero-cost signal so that hard prompts get wider length tolerance and automatically tighten as their pass rate improves. Under the guidance of the proposed verifier and GroupAdapt schedule, the 8B planner attains a Strict-Pass score of 97.3 on BEHAVIOR-1000, yielding a 25.9 percent relative improvement over the Qwen3-8B baseline. This result exceeds the strongest large-model baseline by 3.5 percent, while simultaneously compressing the response length by 79 percent to 207 tokens, demonstrating both effectiveness and efficiency.

具身智能符号推理任务规划强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。