通过分析不同水平玩家的行为策略,提升游戏技能评估精度。
Policies of Multiple Skill Levels for Better Strength Estimation in Games
- 基于人类对弈数据训练多层级行为策略模型。
- 10局对战下围棋准确率达80%,20局达92%。
- 适合需精准匹配人类水平的AI对战系统开发。
准确估计人类技能水平对于设计有效的人机交互至关重要,使AI能够提供适当挑战或引导。在人工智能已战胜顶尖职业选手的游戏中,技能评估在调整AI行为以匹配人类水平方面起关键作用。此前最先进的研究提出一种基于人类对战数据训练的技能估计算法,可计算得分并推断玩家等级。本文观察到人类玩家的行为倾向随技能水平变化,因此提出新方法:除技能得分外,还从神经网络中获取不同技能层级的策略,并将这些策略特征与得分结合进行评估。我们在围棋和国际象棋上进行了实验。围棋方面,给出10局对战数据时,本方法准确率达80%,20局时提升至92%;相比之下,先前最优方法在10局时为71%,20局时为84%,分别提升8-9%。国际象棋结果也呈现类似改进。该研究推动了更精准的技能评估方法发展,有助于优化人机互动体验。
原文摘要 · Abstract (English)
Accurately estimating human skill levels is crucial for designing effective human-AI interactions so that AI can provide appropriate challenges or guidance. In games where AI players have beaten top human professionals, strength estimation plays a key role in adapting AI behavior to match human skill levels. In a previous state-of-the-art study, researchers have proposed a strength estimator trained using human players' match data. Given some matches, the strength estimator computes strength scores and uses them to estimate player ranks (skill levels). In this paper, we focus on the observation that human players' behavior tendency varies according to their strength and aim to improve the accuracy of strength estimation by taking this into account. Specifically, in addition to strength scores, we obtain policies for different skill levels from neural networks trained using human players' match data. We then combine features based on these policies with the strength scores to estimate strength. We conducted experiments on Go and chess. For Go, our method achieved an accuracy of 80% in strength estimation when given 10 matches, which increased to 92% when given 20 matches. In comparison, the previous state-of-the-art method had an accuracy of 71% with 10 matches and 84% with 20 matches, demonstrating improvements of 8-9%. We observed similar improvements in chess. These results contribute to developing a more accurate strength estimation method and to improving human-AI interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。