通过游戏数据自动估测并调整AI棋力,让其更像人类玩家。
Strength Estimation and Human-Like Strength Adjustment in Games
- 基于15盘对局预测棋力等级,准确率超80%
- 新算法使AI棋力可调至指定水平,动作与人类匹配率达51.33%
- 适用于围棋、象棋,提升人机对弈真实感
在人工智能超越人类玩家的游戏场景中,棋力估测与调整至关重要。本文提出一种新型棋力系统,包含强度估测器(SE)和基于SE的蒙特卡洛树搜索(SE-MCTS),能从游戏过程中预测玩家强度并实现拟人化风格。SE无需人工干预即可通过观察对局计算强度分值与排名。SE-MCTS利用强度分值动态调节对弈难度与风格。实验在围棋上进行,仅需15盘对局即达80%以上排名预测准确率,远超此前需100盘才达49%的方法。在强度调整方面,SE-MCTS实现目标等级的同时,动作与人类一致率达51.33%,优于先前最优的42.56%。该方法进一步应用于国际象棋,结果一致,证明其通用性。代码已公开。
原文摘要 · Abstract (English)
Strength estimation and adjustment are crucial in designing human-AI interactions, particularly in games where AI surpasses human players. This paper introduces a novel strength system, including a strength estimator (SE) and an SE-based Monte Carlo tree search, denoted as SE-MCTS, which predicts strengths from games and offers different playing strengths with human styles. The strength estimator calculates strength scores and predicts ranks from games without direct human interaction. SE-MCTS utilizes the strength scores in a Monte Carlo tree search to adjust playing strength and style. We first conduct experiments in Go, a challenging board game with a wide range of ranks. Our strength estimator significantly achieves over 80% accuracy in predicting ranks by observing 15 games only, whereas the previous method reached 49% accuracy for 100 games. For strength adjustment, SE-MCTS successfully adjusts to designated ranks while achieving a 51.33% accuracy in aligning to human actions, outperforming a previous state-of-the-art, with only 42.56% accuracy. To demonstrate the generality of our strength system, we further apply SE and SE-MCTS to chess and obtain consistent results. These results show a promising approach to strength estimation and adjustment, enhancing human-AI interactions in games. Our code is available at https://rlg.iis.sinica.edu.tw/papers/strength-estimator.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。