AI下棋像人一样思考,还能自适应调整思考时间。
Human-aligned Chess with a Bit of Search
- 用真实对局数据训练,模拟人类从新手到大师的行为模式
- 自适应搜索使平均实力差距仅49埃洛,对高手表现如大师级
- 适合想体验真实人类对弈风格的玩家或研究人机协同
国际象棋长期作为人工智能追求人类智能的试验场,近年来的棋类AI已超越最强人类选手。然而这些系统并不具备人类对齐性,无法匹配所有人类对手的水平,也难以建模人类行为。本文提出Allie,一种基于真实对局日志训练的国际象棋AI,可建模从新手到大师全谱系的人类行为,包括思考时间、认输等非走子行为。离线评估显示,Allie在人类走法预测上优于现有最佳模型,并在关键位置表现出类似人类的深思习惯。模型学习到每个局面的奖励分配,可在推理中作为新型时间自适应蒙特卡洛树搜索(MCTS)的奖励函数,搜索时间根据人类在此类位置的思考时长动态调整。大规模在线测试中,该方法在1000至2600埃洛的玩家中平均技能差距仅49埃洛,显著优于无搜索与标准MCTS基线。面对2500埃洛等级分的特级大师对手,配备自适应搜索的Allie展现出同等级大师实力,且全程仅从人类数据学习。
原文摘要 · Abstract (English)
Chess has long been a testbed for AI's quest to match human intelligence, and in recent years, chess AI systems have surpassed the strongest humans at the game. However, these systems are not human-aligned; they are unable to match the skill levels of all human partners or model human-like behaviors beyond piece movement. In this paper, we introduce Allie, a chess-playing AI designed to bridge the gap between artificial and human intelligence in this classic game. Allie is trained on log sequences of real chess games to model the behaviors of human chess players across the skill spectrum, including non-move behaviors such as pondering times and resignations In offline evaluations, we find that Allie exhibits humanlike behavior: it outperforms the existing state-of-the-art in human chess move prediction and "ponders" at critical positions. The model learns to reliably assign reward at each game state, which can be used at inference as a reward function in a novel time-adaptive Monte-Carlo tree search (MCTS) procedure, where the amount of search depends on how long humans would think in the same positions. Adaptive search enables remarkable skill calibration; in a large-scale online evaluation against players with ratings from 1000 to 2600 Elo, our adaptive search method leads to a skill gap of only 49 Elo on average, substantially outperforming search-free and standard MCTS baselines. Against grandmaster-level (2500 Elo) opponents, Allie with adaptive search exhibits the strength of a fellow grandmaster, all while learning exclusively from humans.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。