arXiv:2602.07227cs.LGcs.RO2026-02被引 1

用小脑机制实现机器人故障自修复,不改原模型也能快速适应。

Cerebellar-Inspired Residual Control for Fault Recovery: From Inference-Time Adaptation to Structural Consolidation

  • 借鉴小脑结构,用固定特征扩展和局部可塑性路径在线修正错误。
  • 在半猫和人类模型上故障下性能提升最高达66%,严重扰动时仍稳定。
  • 适合部署后需自适应的机器人系统,尤其看重可靠性与安全性的场景。

实际环境中部署的机器人策略常遭遇训练后故障,此时重训练、探索或系统识别均不现实。本文提出一种推理时的小脑启发式残差控制框架,通过在线修正动作增强冻结的强化学习策略,实现无需修改基础策略参数的故障恢复。该框架体现小脑核心原理:通过固定特征扩展实现高维模式分离,采用并行微区式残差通路,以及在不同时间尺度上运作的兴奋性与抑制性可塑性痕迹。这些机制可在训练后扰动下实现快速、局部的修正,避免全局策略更新带来的不稳定。保守的性能驱动元自适应机制调控残差强度与可塑性,保留正常行为并抑制不必要的干预。在MuJoCo基准测试中,面对执行器、动力学和环境扰动, exttt{HalfCheetah-v5} 性能最高提升66%, exttt{Humanoid-v5} 提升53%;严重偏移下表现平稳,且持续残差修正可被整合进策略参数,提升整体鲁棒性。

原文摘要 · Abstract (English)

Robotic policies deployed in real-world environments often encounter post-training faults, where retraining, exploration, or system identification are impractical. We introduce an inference-time, cerebellar-inspired residual control framework that augments a frozen reinforcement learning policy with online corrective actions, enabling fault recovery without modifying base policy parameters. The framework instantiates core cerebellar principles, including high-dimensional pattern separation via fixed feature expansion, parallel microzone-style residual pathways, and local error-driven plasticity with excitatory and inhibitory eligibility traces operating at distinct time scales. These mechanisms enable fast, localized correction under post-training disturbances while avoiding destabilizing global policy updates. A conservative, performance-driven meta-adaptation regulates residual authority and plasticity, preserving nominal behavior and suppressing unnecessary intervention. Experiments on MuJoCo benchmarks under actuator, dynamic, and environmental perturbations show improvements of up to $+66\%$ on \texttt{HalfCheetah-v5} and $+53\%$ on \texttt{Humanoid-v5} under moderate faults, with graceful degradation under severe shifts and complementary robustness from consolidating persistent residual corrections into policy parameters.

机器人小脑机制故障恢复在线自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。