为具身智能体设计预算化重规划机制,解决大上下文导致的延迟瓶颈。
When Replanning Becomes the Bottleneck: Budgeted Replanning for Embodied Agents

- 通过预算控制决定是否重规划、选模式并分配令牌与延迟目标。
- 在多个平台将重规划令牌减少62%-92%,延迟超限率降至4.7%-50.0%。
- 适合对实时性敏感的机器人任务,尤其在复杂环境中提升稳定性。
具身智能体频繁重规划以应对执行漂移、部分可观测性和协作风险,但每次基于大语言模型的重规划会累积文本上下文,导致上下文过大时重规划延迟出现长尾分布,即使任务成功率高也可能错过实时截止时间,这种失败模式仅靠平均延迟或成功率难以察觉。我们提出BRACE控制器,将重规划建模为带预算的控制环,决策是否重规划、选择重规划模式,并显式分配令牌预算和延迟服务等级目标(SLO),同时考虑可选效率模块。作为可复用组件,我们引入E-RECAP,一种成本感知的渐进式令牌剪枝方法,预测令牌效用并在变压器层间剪枝上下文,同时保留关键头尾令牌。在Meta Habitat、RoboFactory和AirSim中,使用E-RECAP的BRACE将重规划调用令牌数减少62%-92%,延迟超限率从85.5%-100.0%降至4.7%-50.0%,且任务成功率已饱和。在更难的RoboFactory场景中,开环、冻结计划和无BRACE均失败,而BRACE + E-RECAP实现80.0%成功率,延迟超限率仅4.6%,证明了面向尾部延迟的每调用预算机制在多种具身平台上的有效性。
原文摘要 · Abstract (English)
Embodied agents replan frequently to recover from execution drift, partial observability, and coordination hazards, but each LLM-based replanning call can consume an accumulated textual context that grows over time and across agents. Once this context becomes large, replanning latency develops heavy tails and can miss real-time deadlines even when task success remains high, a failure mode that is hard to detect from average latency or success alone. We present BRACE, a controller that formulates replanning as a budgeted control loop by deciding whether to replan, selecting a replanning mode, and allocating an explicit token budget and latency service-level objective (SLO) while accounting for optional efficiency modules. As a reusable component, we introduce E-RECAP, a cost-aware progressive token pruning method that predicts token utility and prunes replanning contexts across transformer layers while preserving critical head and tail tokens. Across Meta Habitat, RoboFactory, and AirSim, BRACE with E-RECAP reduces replanning-call token counts by 62-92% and SLO violation rates from 85.5-100.0% to 4.7-50.0% in settings where task success is already saturated. In a harder RoboFactory setting where open-loop, frozen-plan, and No BRACE all fail, BRACE + E-RECAP reaches 80.0% success with 4.6% SLO violations, demonstrating that tail-aware per-call budgeting is effective across embodied platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。