arXiv:2603.16673cs.ROcs.AI2026-03被引 3

让机器人智能决定何时思考,避免算力浪费或决策失误。

When Should a Robot Think? Resource-Aware Reasoning via Reinforcement Learning for Embodied Robotic Decision-Making

  • 用强化学习训练机器人自主判断是否推理、如何推理
  • 在ALFRED数据集上任务成功率提升,延迟降低30%以上
  • 适合需要高效稳定决策的实体机器人系统

具身机器人系统越来越多依赖大语言模型(LLM)进行高层推理、规划和决策。然而调用LLM推理会带来显著的计算延迟和资源开销,可能中断动作执行,降低系统可靠性。过度推理会延迟行动,推理不足则常导致错误决策和任务失败。这引出具身智能体的核心问题:何时该思考,何时该行动?本文提出RARRL(基于强化学习的资源感知推理),一种分层框架,实现对具身智能体的资源感知协调。不同于学习底层控制策略,RARRL学习高层编排策略,运行于智能体决策层。该策略使智能体能根据当前观测、执行历史和剩余资源,自适应决定是否调用推理、选择何种推理角色以及分配多少计算预算。大量实验,包括基于ALFRED基准的实测延迟数据,表明RARRL在任务成功率、执行延迟和鲁棒性方面均优于固定或启发式推理策略。结果表明,自适应推理控制对构建可靠高效的具身机器人至关重要。

原文摘要 · Abstract (English)

Embodied robotic systems increasingly rely on large language model (LLM)-based agents to support high-level reasoning, planning, and decision-making during interactions with the environment. However, invoking LLM reasoning introduces substantial computational latency and resource overhead, which can interrupt action execution and reduce system reliability. Excessive reasoning may delay actions, while insufficient reasoning often leads to incorrect decisions and task failures. This raises a fundamental question for embodied agents: when should the agent reason, and when should it act? In this work, we propose RARRL (Resource-Aware Reasoning via Reinforcement Learning), a hierarchical framework for resource-aware orchestration of embodied agents. Rather than learning low-level control policies, RARRL learns a high-level orchestration policy that operates at the agent's decision-making layer. This policy enables the agent to adaptively determine whether to invoke reasoning, which reasoning role to employ, and how much computational budget to allocate based on current observations, execution history, and remaining resources. Extensive experiments, including evaluations with empirical latency profiles derived from the ALFRED benchmark, show that RARRL consistently improves task success rates while reducing execution latency and enhancing robustness compared with fixed or heuristic reasoning strategies. These results demonstrate that adaptive reasoning control is essential for building reliable and efficient embodied robotic agents.

具身智能强化学习推理优化机器人决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。