arXiv:2605.19091cs.LG2026-05被引 6

用统一模型同时提升下棋强度、预测人类走法和可解释性

Chessformer: A Unified Architecture for Chess Modeling

论文配图:Chessformer: A Unified Architecture for Chess Modeling
图 1 · 摘自论文原文
  • 将棋盘格子作为令牌,用几何注意力偏置动态建模棋局结构
  • 人类走法预测准确率达57.1%,参数量不足旧方法四分之一
  • 可直接定位注意力到具体棋格,实现细粒度可解释分析

国际象棋长期作为人工智能的典型测试平台,但其核心任务的建模方法已分化。提升棋力、预测人类走法与增强可解释性通常依赖不同架构,且常与领域几何结构脱节。本文提出Chessformer,一种统一架构,在三项核心目标上均达新高度。该模型为仅编码器的Transformer,将棋盘格子作为输入令牌,引入新型动态位置编码‘几何注意力偏置’(GAB),自适应棋类几何特性,并采用基于注意力的源-目标策略头预测动作。在多项评估中,我们构建了maiathree系列人类走法预测模型,达到57.1%的走法匹配准确率,参数量少于此前最优方法的四分之一;将其集成至领先开源引擎Leela Chess Zero,棋力提升超过100 Elo,在重大赛事中击败Stockfish;此外,因格子级令牌设计,注意力模式与激活可直接映射至具体棋格,实现精细可解释性分析。结果表明,将模型的标记方式、位置编码与输出结构对齐领域本质,可同步提升性能、人机兼容性与可解释性。

原文摘要 · Abstract (English)

Chess has long served as a canonical testbed for artificial intelligence, but modeling approaches for its central tasks have diverged. Maximizing playing strength, predicting human play, and enabling interpretability are typically solved with disparate architectures, and these designs are often misaligned with the geometry of the domain. This raises the natural question of whether these objectives require separate modeling paradigms, or if there exists a single architecture that supports them simultaneously. We introduce Chessformer, a unified architecture that advances the state of the art on all three central goals in chess modeling. Chessformer is an encoder-only transformer that represents board squares as tokens, augments self-attention with a novel dynamic positional encoding called Geometric Attention Bias (GAB) that adapts to domain-specific geometry, and predicts actions with an attention-based source-destination policy head. We evaluate Chessformer on each front. First, we develop \maiathree, a family of models for human move prediction that reaches 57.1\% move-matching accuracy, significantly surpassing the previous state of the art with fewer than a quarter of the parameters. Second, we integrate Chessformer into Leela Chess Zero, a leading open-source engine, adding over 100 Elo of playing strength and resulting in tournament victories over Stockfish in major computer chess competitions. Third, we show that Chessformer's square-token design makes attention patterns and activations directly attributable to board squares, enabling granular interpretability analyses that prior architectures do not naturally support. More broadly, our results demonstrate that aligning a model's tokenization, positional encoding, and output design with the underlying structure of a domain can yield simultaneous gains in performance, human compatibility, and interpretability.

国际象棋Transformer可解释性统一模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。