用迁移学习让赛车智能体快速适应新赛道,提升训练效率。
Transfer Learning for Customized Car Racing Environments

- 在已有赛道训练后,直接迁移到新赛道或微调,实现零样本迁移
- 模型类方法比无模型方法更快收敛且性能更优,最快达3.2秒/圈
- 适合需要快速部署的自动驾驶仿真测试场景
迁移学习是一种让模型/智能体将从一个任务中学到的知识应用于相关任务的技术,常用于深度学习问题。本项目探索深度强化学习中的迁移学习应用,目标是在OpenAI的赛车环境中实现快速完赛。通过在一个赛道上训练智能体,再将其迁移至其他定制化目标环境,采用零样本迁移或微调策略进行测试。同时,对比了模型基础与模型无关方法的表现,发现模型类方法在性能和收敛速度上均显著优于后者。实验表明,多数设置下迁移学习不仅提升了目标域表现,还在学习过程中保持高效率。
原文摘要 · Abstract (English)
Transfer Learning, a technique where a model/agent can use the knowledge/expertise that it gained from one task and exploit that to solve another closely-related task, is often used in tackling problems in deep learning. Through this project, we explore transfer learning in the purview of deep reinforcement learning. Specifically, we want to use transfer learning to achieve the fast lap times in OpenAI's Car racing environment by training the agent on one circuit, and racing it on other customized target environments by zero-shot transfer or by additional fine-tuning. In addition, we compare the performance of model-based and model-free approaches, and observe that model-based approaches dominate in performance and converge faster than model-free approaches in this environment. We observe that transfer learning in most setups not only boosts the performance on the target domain, but also shows high performance ability during learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。