通过谱剪裁让线性系统既准确又稳定,还超快。
On the Surprising Effectiveness of Spectral Clipping in Learning Stable Linear and Latent-Linear Dynamical Systems
- 学习后对系统矩阵的谱进行剪裁,保持特征向量不变。
- 在多个数据集上实现高精度且可证明稳定的动态预测。
- 适合需要快速构建稳定控制策略的机器人研究者。
从数据中学习稳定线性动力系统时,理想的三个属性是:预测准确性、可验证的稳定性与计算效率。无约束最小化预测误差能实现高精度和高效率,但无法保证稳定性。现有方法虽能维持准确性,但需额外计算成本。本文探索一种看似简单的后处理方法:在使用无约束最小二乘法学习系统后,对系统矩阵的谱进行剪裁——即进行特征分解,将模大于1的特征值截断至1,保持特征向量不变。该方法称为谱剪裁(SC)。我们进一步将SC与Koopman算子结合,用于学习非线性系统的稳定预测,如多指机器人灵巧操作中的复杂动力学。在两个不同应用场景及公开基准数据集上的全面实验表明,该简单方法可高效学习高度准确且可证明稳定的动态模型。显著的是,其性能可媲美甚至超越强基线,且速度提升数个数量级。此外,即使训练数据包含失败或不完整演示,该方法仍能学习到稳定机器人策略。代码与数据集见:https://github.com/GT-STAR-Lab/spec_clip。
原文摘要 · Abstract (English)
When learning stable linear dynamical systems from data, three important properties are desirable: i) predictive accuracy, ii) verifiable stability, and iii) computational efficiency. Unconstrained minimization of prediction errors leads to high accuracy and efficiency but cannot guarantee stability. Existing methods to enforce stability often preserve accuracy, but do so only at the cost of increased computation. In this work, we investigate if a seemingly-naive procedure can simultaneously offer all three desiderata. Specifically, we consider a post-hoc procedure in which we surgically manipulate the spectrum of the linear system after it was learned using unconstrained least squares. We call this approach spectral clipping (SC) as it involves eigen decomposition and subsequent reconstruction of the system matrix after any eigenvalues whose magnitude exceeds one have been clipped to one (without altering the eigenvectors). We also show that SC can be readily combined with Koopman operators to learn nonlinear dynamical systems that can generate stable predictions of nonlinear phenomena, such as those underlying complex dexterous manipulation skills involving multi-fingered robotic hands. Through comprehensive experiments involving two different applications and publicly available benchmark datasets, we show that this simple technique can efficiently learn highly-accurate predictive dynamics that are provably-stable. Notably, we find that SC can match or outperform strong baselines while being orders-of-magnitude faster. Finally, we find that SC can learn stable robot policies even when the training data includes unsuccessful or truncated demonstrations. Our code and datasets can be found at https://github.com/GT-STAR-Lab/spec_clip.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。