用扩散模型提升机器人动力学建模的鲁棒性与实时性
Diffusion Sequence Models for Generative In-Context Meta-Learning of Robot Dynamics

- 将系统识别建模为上下文元学习,对比确定性与生成式序列模型
- 扩散模型在分布外场景下显著提升预测鲁棒性,其中修补型扩散表现最佳
- 预热采样使扩散模型满足实时控制需求,适合实际机器人应用
准确建模机器人动力学对基于模型的控制至关重要,但在分布偏移和实时约束下仍具挑战。本文将系统识别问题形式化为上下文元学习任务,比较了确定性与生成式序列模型在前向动力学预测中的表现。以基于Transformer的元模型为强基准,引入两种互补的扩散模型方法:(i) 修补型扩散(Diffuser),学习输入-观测联合分布;(ii) 条件扩散模型(CNN与Transformer),根据控制输入生成未来观测。通过大规模随机仿真,分析了模型在分布内与分布外情形下的性能,以及控制相关的计算权衡。实验表明,扩散模型显著提升了分布偏移下的鲁棒性,其中修补型扩散表现最优。最后,证明预热采样可使扩散模型满足实时控制要求,具备实际应用潜力。结果表明,生成式元模型是机器人中鲁棒系统识别的有前途方向。
原文摘要 · Abstract (English)
Accurate modeling of robot dynamics is essential for model-based control, yet remains challenging under distributional shifts and real-time constraints. In this work, we formulate system identification as an in-context meta-learning problem and compare deterministic and generative sequence models for forward dynamics prediction. We take a Transformer-based meta-model, as a strong deterministic baseline, and introduce to this setting two complementary diffusion-based approaches: (i) inpainting diffusion (Diffuser), which learns the joint input-observation distribution, and (ii) conditioned diffusion models (CNN and Transformer), which generate future observations conditioned on control inputs. Through large-scale randomized simulations, we analyze performance across in-distribution and out-of-distribution regimes, as well as computational trade-offs relevant for control. We show that diffusion models significantly improve robustness under distribution shift, with inpainting diffusion achieving the best performance in our experiments. Finally, we demonstrate that warm-started sampling enables diffusion models to operate within real-time constraints, making them viable for control applications. These results highlight generative meta-models as a promising direction for robust system identification in robotics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。