arXiv:2602.17174cs.LGcs.AI2026-02

分步学习多种不确定性,提升非线性系统控制鲁棒性

Continual Uncertainty Learning for Robust Control of Nonlinear Systems with Multiple Heterogeneous Uncertainties

  • 将复杂控制问题分解为渐进式学习任务,逐个攻克不同不确定性
  • 在多种工况下保持稳定性能,振动抑制效果优于传统方法
  • 适合工业级非线性系统控制,尤其适用于动态变化大的场景

具有多种不确定性的机械系统鲁棒控制仍是基础挑战,尤其当非线性动力学与工况变化交织时。尽管深度强化学习结合领域随机化在缓解仿真到现实差距方面表现良好,但同时处理所有不确定性源常导致次优策略和低学习效率。本文提出持续不确定性学习(CUL),一种基于课程的持续学习框架,用于对多重异质不确定性叠加的非线性系统进行鲁棒控制。核心思想是通过将系统扩展为一系列不确定性逐步扩展和多样化的被控对象(plants),将原始控制问题分解为一系列持续学习任务,使每种不确定性的应对策略得以顺序学习。在该课程中,策略在多个被控对象集上通过内存高效的抗遗忘正则化更新,保留早期不确定性学习到的策略。同时,在学习过程中嵌入模型基控制器,确保所有被控对象集共享基准性能,使智能体仅学习每种不确定性下的残差补偿,显著提升样本效率。该框架应用于汽车动力总成主动振动控制器设计,对比验证表明,所设计控制器在广泛工况下对结构非线性和动态变化均保持鲁棒性,并提升了控制性能。

原文摘要 · Abstract (English)

Robust control of mechanical systems with multiple uncertainties remains a fundamental challenge, particularly when nonlinear dynamics and operating-condition variations are intricately intertwined. Although deep reinforcement learning combined with domain randomization has shown promise in mitigating the sim-to-real gap, simultaneously handling all the sources of uncertainty often leads to sub-optimal policies and poor learning efficiency. This study proposes continual uncertainty learning (CUL), a curriculum-based continual learning framework for robust control of nonlinear systems on which multiple heterogeneous uncertainties are simultaneously superimposed. The core idea is to decompose the original control problem into a sequence of continual learning tasks by extending the system into a set of plants whose uncertainties are progressively expanded and diversified, so that the strategy for handling each uncertainty is acquired sequentially. Within this curriculum, the policy is updated across the plant sets under a memory-efficient anti-forgetting regularization, which preserves the strategies acquired for earlier uncertainties. In parallel, a model-based controller that guarantees a shared baseline performance across all the plant sets is embedded in the learning process, so that the agent learns only the residual compensation for each uncertainty, thereby substantially enhancing sample efficiency. The proposed framework is applied to the design of an active vibration controller for automotive powertrains as a practical industrial application. Comparative validation demonstrates that the resulting controller remains robust against structural nonlinearities and dynamic variations over a wide range of plant conditions while improving the control performance.

鲁棒控制持续学习非线性系统不确定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。