arXiv:2508.06559cs.AIcs.GT2025-08被引 1

用GPU加速求解复杂牌戏帕苏尔的近似纳什均衡。

Solving Pasur Using GPU-Accelerated Counterfactual Regret Minimization

  • 基于CUDA与PyTorch构建高效框架,拆分游戏状态与累积得分降低内存开销。
  • 通过逐轮逆向训练,构建超10亿节点的完整博弈树并求得近似最优策略。
  • 适用于类似回合制策略游戏或金融交易等可分阶段建模的场景。

帕苏尔是一种六轮进行的捕鱼类纸牌游戏,规则复杂且博弈树规模庞大。本文提出一种基于CUDA的计算框架,利用PyTorch CUDA张量处理规则复杂性,并将博弈树分解为实际牌局状态与前轮继承得分两部分。通过展开过程将二者组合生成完整博弈树,仅存储关键策略值与节点连接,显著降低内存占用。采用从终局往回递推的训练策略,逐步传播平均收益至早期阶段。该方法构建的博弈树平均包含超过10^9个节点。在计算出近似纳什均衡后,训练树基模型以实时预测策略。通过大规模自对弈(每对局模拟10,000场)并行运行于GPU,估算各牌组公平价值。该框架可推广至其他动作树可分轮次的强化学习问题,如回合制策略游戏或金融市场的序列决策。

原文摘要 · Abstract (English)

Pasur is a fishing card game played over six rounds and is played similarly to games such as Cassino and Scopa, and Bastra. This paper introduces a CUDA-accelerated computational framework for simulating Pasur, emphasizing efficient memory management. We use our framework to compute near-Nash equilibria via Counterfactual Regret Minimization (CFR), a well-known algorithm for solving large imperfect-information games. Solving Pasur presents unique challenges due to its intricate rules and the large size of its game tree. We handle rule complexity using PyTorch CUDA tensors and to address the memory-intensive nature of the game, we decompose the game tree into two key components: (1) actual game states, and (2) inherited scores from previous rounds. We construct the Full Game Tree by pairing card states with accumulated scores in the Unfolding Process. This design reduces memory overhead by storing only essential strategy values and node connections. To further manage computational complexity, we apply a round-by-round backward training strategy, starting from the final round and recursively propagating average utilities to earlier stages. Our approach constructs the complete game tree, which on average consists of over $10^9$ nodes. We provide detailed implementation snippets. After computing a near-Nash equilibrium strategy, we train a tree-based model to predict these strategies for use during gameplay. We then estimate the fair value of each deck through large-scale self-play between equilibrium strategies by simulating, for instance, 10,000 games per matchup, executed in parallel using GPU acceleration. Similar frameworks can be extended to other reinforcement learning algorithms where the action tree naturally decomposes into multiple rounds such as turn-based strategy games or sequential trading decisions in financial markets.

博弈论GPU加速近似纳什均衡强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。