用视觉与文本建模任务相似性,高效挑选可迁移策略。
FAST: Similarity-based Knowledge Transfer for Efficient Policy Learning
- 通过视觉帧和文本描述构建任务动态的潜在表示,计算环境相似度。
- 在多条赛道上,训练步数显著减少,性能接近从零学习方法。
- 适合游戏开发等动态场景中需快速适应新任务的智能体应用。
迁移学习(TL)通过跨任务转移知识具有加速学习的潜力。然而,其面临负迁移、领域适配及源策略选择效率低等关键挑战,这些在不断演化的领域(如游戏开发)中尤为突出,新智能体持续发布成本高且效率低。本文针对上述问题提出FAST——基于自适应相似性的迁移框架,利用视觉帧与文本描述生成任务动态的潜在表征,进而估算环境间相似度,并据此筛选候选策略以实现知识迁移,简化新任务的学习过程。在多个赛道上的实验表明,FAST在显著减少训练步数的同时,达到了与从零学习相当的最终性能,验证了嵌入驱动的任务相似性估计的有效性。
原文摘要 · Abstract (English)
Transfer Learning (TL) offers the potential to accelerate learning by transferring knowledge across tasks. However, it faces critical challenges such as negative transfer, domain adaptation and inefficiency in selecting solid source policies. These issues often represent critical problems in evolving domains, i.e. game development, where scenarios transform and agents must adapt. The continuous release of new agents is costly and inefficient. In this work we challenge the key issues in TL to improve knowledge transfer, agents performance across tasks and reduce computational costs. The proposed methodology, called FAST - Framework for Adaptive Similarity-based Transfer, leverages visual frames and textual descriptions to create a latent representation of tasks dynamics, that is exploited to estimate similarity between environments. The similarity scores guides our method in choosing candidate policies from which transfer abilities to simplify learning of novel tasks. Experimental results, over multiple racing tracks, demonstrate that FAST achieves competitive final performance compared to learning-from-scratch methods while requiring significantly less training steps. These findings highlight the potential of embedding-driven task similarity estimations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。