用低精度模拟器做先验,让深度学习在少数据下也能高效学真实系统动态。
Simulation Priors for Data-Efficient Deep Learning
- 用低精度模拟器作为贝叶斯深度学习的先验,融合物理规律与数据驱动优势。
- 在生物、农业、机器人等多领域,少数据下学习复杂动态表现更优。
- 适合需要少样本快速学习的现实场景,如自动驾驶、机器人控制。
如何让人工智能系统在真实世界中高效学习?第一性原理模型广泛用于模拟自然系统,但常因简化假设而无法捕捉真实复杂性;相比之下,深度学习可无须过多假设地估计复杂动态,却需大量代表性数据。我们提出SimPEL方法,通过将低保真模拟器作为贝叶斯深度学习中的先验,高效结合第一性原理模型与数据驱动学习。该方法在数据稀缺时利用模拟器知识,在数据充足时发挥深度学习的灵活性,同时精确量化认知不确定性。我们在生物、农业和机器人等多个领域验证了SimPEL,结果表明其在学习复杂动态方面表现优异。在基于模型的强化学习中,它有效弥合了仿真到现实的差距。在高速遥控车停车任务中,仅需少量数据即可学习涉及漂移的高动态操作,显著优于当前最先进基线。这些结果凸显了SimPEL在复杂现实环境中实现数据高效学习与控制的巨大潜力。
原文摘要 · Abstract (English)
How do we enable AI systems to efficiently learn in the real-world? First-principles models are widely used to simulate natural systems, but often fail to capture real-world complexity due to simplifying assumptions. In contrast, deep learning approaches can estimate complex dynamics with minimal assumptions but require large, representative datasets. We propose SimPEL, a method that efficiently combines first-principles models with data-driven learning by using low-fidelity simulators as priors in Bayesian deep learning. This enables SimPEL to benefit from simulator knowledge in low-data regimes and leverage deep learning's flexibility when more data is available, all the while carefully quantifying epistemic uncertainty. We evaluate SimPEL on diverse systems, including biological, agricultural, and robotic domains, showing superior performance in learning complex dynamics. For decision-making, we demonstrate that SimPEL bridges the sim-to-real gap in model-based reinforcement learning. On a high-speed RC car task, SimPEL learns a highly dynamic parking maneuver involving drifting with substantially less data than state-of-the-art baselines. These results highlight the potential of SimPEL for data-efficient learning and control in complex real-world environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。