用低精度仿真训练,实现智能体快速适应真实复杂环境。
From Abstraction to Reality: DARPA's Vision for Robust Sim-to-Real Autonomy
- 通过多组低精度仿真学习共性语义,实现抽象到现实的迁移。
- 在动态复杂场景中,显著提升自主系统适应速度与鲁棒性。
- 适合需快速部署、跨平台应用的机器人与自动驾驶研发者。
DARPA的TIAMAT项目旨在解决自主技术在动态复杂环境、任务与平台间的快速且稳健迁移问题。现有仿真到现实(sim-to-real)迁移方法依赖高保真仿真,在广泛适应性上表现不佳,尤其在时间敏感场景中。尽管诸多方法在特定任务上表现优异,但面对未知、复杂且动态的真实世界情况时,常因仿真固有局限而失效。与当前依赖高精度仿真及领域随机化、模仿学习等技术缩小模拟与现实差距的研究不同,TIAMAT转而强调直接将自主系统栈迁移到真实环境,利用多样低(或较低)保真度仿真生成广泛有效的转移能力。通过从多个仿真环境的共享语义中抽象学习,实现从抽象到现实的高效迁移,并优化整个自主流程,克服仿真行为向真实性能转化中的固有挑战。
原文摘要 · Abstract (English)
The DARPA Transfer from Imprecise and Abstract Models to Autonomous Technologies (TIAMAT) program aims to address rapid and robust transfer of autonomy technologies across dynamic and complex environments, goals, and platforms. Existing methods for simulation-to-reality (sim-to-real) transfer often rely on high-fidelity simulations and struggle with broad adaptation, particularly in time-sensitive scenarios. Although many approaches have shown incredible performance at specific tasks, most techniques fall short when posed with unforeseen, complex, and dynamic real-world scenarios due to the inherent limitations of simulation. In contrast to current research that aims to bridge the gap between simulation environments and the real world through increasingly sophisticated simulations and a combination of methods typically assuming a small sim-to-real gap -- such as domain randomization, domain adaptation, imitation learning, meta-learning, policy distillation, and dynamic optimization -- TIAMAT takes a different approach by instead emphasizing transfer and adaptation of the autonomy stack directly to real-world environments by utilizing a breadth of low(er)-fidelity simulations to create broadly effective sim-to-real transfers. By abstractly learning from multiple simulation environments in reference to their shared semantics, TIAMAT's approaches aim to achieve abstract-to-real transfer for effective and rapid real-world adaptation. Furthermore, this program endeavors to improve the overall autonomy pipeline by addressing the inherent challenges in translating simulated behaviors into effective real-world performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。