Ludax让棋类游戏快速模拟,支持强化学习训练。
Ludax: A GPU-Accelerated Domain Specific Language for Board Games
- 用领域专用语言描述棋类规则,自动编译为加速代码。
- 相比传统方法,训练速度提升数倍,支持大规模实验。
- 适合做强化学习、认知科学等研究的快速原型开发。
棋类游戏长期作为人工智能研究的基准和测试环境。关键一步是开发游戏描述语言:将特定领域的代码编译为可运行、可模拟的游戏环境,使研究人员无需手动实现每个游戏即可在多个游戏中泛化算法。近年来,强化学习的进步很大程度上得益于硬件加速的发展。JAX 等库使从业者能充分利用前沿计算硬件,通常使训练和测试提速数个数量级。本文提出这两方面研究的融合:一种面向棋类游戏的领域专用语言,能自动编译为硬件加速代码。我们的框架 Ludax 将游戏描述语言的通用性与现代并行处理硬件的速度相结合,设计用于无缝嵌入现有深度学习流程。我们设想 Ludax 能普遍加速游戏研究,涵盖强化学习到认知科学,通过实现快速模拟和灵活表示。本文详细阐述 Ludax 的描述语言、编译技术,并提供性能基准和强化学习智能体训练演示。Ludax 框架及已有棋类游戏实现已开源,可供自由使用。
原文摘要 · Abstract (English)
Games have long been used as benchmarks and testing environments for research in artificial intelligence. A key step in supporting this research was the development of game description languages: frameworks that compile domain-specific code into playable and simulatable game environments, allowing researchers to generalize their algorithms and approaches across multiple games without having to manually implement each one. More recently, progress in reinforcement learning (RL) has been largely driven by advances in hardware acceleration. Libraries like JAX allow practitioners to take full advantage of cutting-edge computing hardware, often speeding up training and testing by orders of magnitude. Here, we present a synthesis of these strands of research: a domain-specific language for board games which automatically compiles into hardware-accelerated code. Our framework, Ludax, combines the generality of game description languages with the speed of modern parallel processing hardware and is designed to fit neatly into existing deep learning pipelines. We envision Ludax as a tool to help accelerate games research generally, from RL to cognitive science, by enabling rapid simulation and providing a flexible representation scheme. We present a detailed breakdown of Ludax's description language and technical notes on the compilation process, along with speed benchmarking and a demonstration of training RL agents. The Ludax framework, along with implementations of existing board games, is open-source and freely available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。