arXiv:2509.19672cs.ROmath.DS2025-09NeurIPS

让控制器学会从历史轨迹中学习,自动避开复杂环境中的局部最优

Memory-Augmented Potential Field Theory: A Framework for Adaptive Control in Non-Convex Domains

论文配图:Memory-Augmented Potential Field Theory: A Framework for Adaptive Control in Non-Convex Domains
图 1 · 摘自论文原文
  • 用记忆构建动态势场,捕捉状态空间的拓扑特征
  • 在非凸环境中实现快速逃离局部最优,收敛性更优
  • 无需额外训练,适合机器人等动态系统实时控制

随机最优控制在复杂非凸环境中常因无法利用历史轨迹数据而陷入局部最优。本文提出记忆增强势场理论,将历史经验融入随机最优控制的统一数学框架。该方法动态构建基于记忆的势场,识别并编码状态空间的关键拓扑特征,使控制器能自动从过往经验中学习并调整优化策略。理论分析表明,该势场具备非凸逃逸能力、渐近收敛性与计算高效性。我们在记忆增强模型预测路径积分(Memory-Augmented MPPI)控制器中实现了该框架,在复杂非凸环境中表现出显著提升的性能。该方法为控制系统的经验学习提供了通用范式,尤其适用于机器人动力学系统,可在不依赖领域知识或大量离线训练的情况下,有效导航复杂状态空间。

原文摘要 · Abstract (English)

Stochastic optimal control methods often struggle in complex non-convex landscapes, frequently becoming trapped in local optima due to their inability to learn from historical trajectory data. This paper introduces Memory-Augmented Potential Field Theory, a unified mathematical framework that integrates historical experience into stochastic optimal control. Our approach dynamically constructs memory-based potential fields that identify and encode key topological features of the state space, enabling controllers to automatically learn from past experiences and adapt their optimization strategy. We provide a theoretical analysis showing that memory-augmented potential fields possess non-convex escape properties, asymptotic convergence characteristics, and computational efficiency. We implement this theoretical framework in a Memory-Augmented Model Predictive Path Integral (MPPI) controller that demonstrates significantly improved performance in challenging non-convex environments. The framework represents a generalizable approach to experience-based learning within control systems (especially robotic dynamics), enhancing their ability to navigate complex state spaces without requiring specialized domain knowledge or extensive offline training.

强化学习控制理论机器人非凸优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。