arXiv:2605.24152cs.AI2026-05

用神经启发的逆学习框架,让机器人更快更省力地规划和控制动作。

Neuro-Inspired Inverse Learning for Planning and Control

论文配图:Neuro-Inspired Inverse Learning for Planning and Control
图 1 · 摘自论文原文
  • 通过端到端训练逆模型,结合前向模型与分层结构实现高效动作规划。
  • 在多个基准测试中平均提升24.2%,推理耗时降低10~100倍。
  • 适合对延迟和算力敏感的机器人、量子控制等实时应用场景。

我们提出一种受神经科学启发的具身规划与控制框架。基于哺乳动物大脑实现快速高效目标行为的三大原则——成对的前向/逆向内部模型、开环多步运动指令、分层有序的动作组织——Inverter框架采用端到端训练的可学习组件,并在自然条件下补充解析或算法模块;我们形式化了逆学习(IL),并将其与监督学习、强化学习及模仿学习区分开来。IL融合了强化学习式的单次前向推断(仅输出一步动作)与最优控制式的全轨迹序列规划(但需迭代计算)。单个Inverter或两级堆叠在3个Maze2D和6个AntMaze D4RL变体上,平均性能提升24.2%(范围-1.9%至+78.2%),推理计算量减少一到两个数量级。尤为关键的是,通过在整个T步动作序列上优化前向模型(FoM),而非逐步优化,Inverter能生成平滑、目标一致、全局结构化的轨迹,其控制策略逼近解析最优解,甚至优于训练数据所依据的策略。我们还发现一种IL失效模式:在训练数据覆盖过窄时出现前向模型“黑客”现象,可通过引入覆盖更广的随机数据缓解。作为应用示例,脉冲逆学习器以超过1000倍的效率合成任意单量子比特门,保真度媲美标准数值优化方法GRAPE。综上,我们得出结论:逆学习为世界接口提供了一类通用且高效的解决方案,尤其适用于对延迟和资源敏感的具身人工智能。

原文摘要 · Abstract (English)

We present a neuro-inspired framework for embodied planning and control. Building on three principles that enable fast and highly effective goal-directed behavior in the mammalian brain - paired forward/inverse internal models, open-loop multi-step motor commands, and sequential, hierarchical organization of action - our Inverter framework uses learned components, trained end-to-end through Inverse Learning (IL) and supplemented where natural by analytic or algorithmic modules; we formalize IL and delineate it from supervised, reinforcement, and imitation learning. IL bridges Reinforcement Learning (RL)-style amortization, which runs in a single forward pass but emits only one action at a time, and Optimal Control (OC)-style sequence planning over whole trajectories, but with iterative test-time computation. Single Inverters or hierarchical n=2 Inverter stacks match or improve on offline-RL and diffusion-planner baselines on all 3 maze2d and 6 antmaze D4RL variants by an average of +24.2% (range -1.9% to +78.2%), at one-to-two orders of magnitude less inference compute time. Distinctively, optimizing through the Forward Model (FoM) over the entire T-step action sequence - rather than per step - lets Inverters produce smooth, goal-coherent, trajectory-wide structure and reach control policies closer to the analytic optimum than the policy underlying the training data itself. We also identify a failure mode of IL: FoM hacking under narrow training-data coverage, which we mitigate by using random training data with broader coverage. As an application example, a Pulse Inverter synthesizes arbitrary single-qubit quantum gates with fidelity matching the standard iterative numerical baseline (GRAPE), at more than 1000x lower per-gate compute time. In summary, we conclude that IL enables a versatile class of world-interfaces, especially for latency- and resource-critical embodied AI.

机器人控制逆学习神经启发高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。