让无人机通过自我博弈逐步提升竞速能力,自动适应更高难度挑战。
SPIRAL: Self-Play Incremental Racing Algorithm for Learning in Multi-Drone Competitions
- 采用自对弈机制,让无人机不断对抗更强的自己,逐步进化策略。
- 从基础飞行到复杂协同竞速,训练过程自然提升挑战强度。
- 兼容主流强化学习算法,适合研究多无人机自主竞速的团队。
本文提出SPIRAL(自对弈增量竞速算法),一种用于训练多无人机在竞速比赛中自主决策的新方法。该方法通过自对弈机制,在动态复杂环境中逐步培养复杂的竞速行为。无人机持续与自身不断进化的版本对抗,使竞争难度自然递增。这一渐进式学习过程引导智能体从掌握基本飞行控制,发展为执行高级协同竞速策略。该框架可与任意先进深度强化学习(DRL)算法结合,具有高度灵活性。仿真结果验证了SPIRAL的有效性,并对多种DRL算法在其中的表现进行了基准测试。本工作为自主无人机竞速领域提供了一个通用、可扩展且自我优化的学习框架。其通过自对弈机制自动生成适切且不断升级的挑战,为构建复杂多智能体环境中稳健、自适应的竞速策略提供了新方向。
原文摘要 · Abstract (English)
This paper introduces SPIRAL (Self-Play Incremental Racing Algorithm for Learning), a novel approach for training autonomous drones in multi-agent racing competitions. SPIRAL distinctively employs a self-play mechanism to incrementally cultivate complex racing behaviors within a challenging, dynamic environment. Through this self-play core, drones continuously compete against increasingly proficient versions of themselves, naturally escalating the difficulty of competitive interactions. This progressive learning journey guides agents from mastering fundamental flight control to executing sophisticated cooperative multi-drone racing strategies. Our method is designed for versatility, allowing integration with any state-of-the-art Deep Reinforcement Learning (DRL) algorithms within its self-play framework. Simulations demonstrate the significant advantages of SPIRAL and benchmark the performance of various DRL algorithms operating within it. Consequently, we contribute a versatile, scalable, and self-improving learning framework to the field of autonomous drone racing. SPIRAL's capacity to autonomously generate appropriate and escalating challenges through its self-play dynamic offers a promising direction for developing robust and adaptive racing strategies in multi-agent environments. This research opens new avenues for enhancing the performance and reliability of autonomous racing drones in increasingly complex and competitive scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。