arXiv:2409.20553cs.AI2024-09NeurIPS被引 33

统一建模棋手技能进阶,让AI更懂人类下棋方式。

Maia-2: A Unified Model for Human-AI Alignment in Chess

  • 设计技能感知注意力机制,动态融合棋力与局面信息。
  • 在不同水平棋手上实现更精准的人机对齐,提升教学适配性。
  • 为智能教练和人类决策研究提供可扩展的统一框架。

随着人工智能在多个领域超越人类并精确建模人类行为,算法驱动的教学成为可能。棋类是研究人机对齐的理想系统:拥有悠久的研究历史、成熟的超人级AI如AlphaZero,以及基于棋力等级的精确能力度量。以往研究使用独立模型分别捕捉不同水平的人类下棋风格,缺乏跨水平的连贯性,限制了其作为教学伙伴的有效性。本文提出一种统一建模方法,能一致地刻画从新手到大师各阶段的人类下棋风格,并直接建模人类学习过程。针对人类学习的非线性特性,引入技能感知注意力机制,动态整合玩家能力与棋局状态表示。实验表明,该框架显著提升了不同水平棋手与AI之间的对齐程度,为深入理解人类决策和开发智能教学工具奠定基础。

原文摘要 · Abstract (English)

There are an increasing number of domains in which artificial intelligence (AI) systems both surpass human ability and accurately model human behavior. This introduces the possibility of algorithmically-informed teaching in these domains through more relatable AI partners and deeper insights into human decision-making. Critical to achieving this goal, however, is coherently modeling human behavior at various skill levels. Chess is an ideal model system for conducting research into this kind of human-AI alignment, with its rich history as a pivotal testbed for AI research, mature superhuman AI systems like AlphaZero, and precise measurements of skill via chess rating systems. Previous work in modeling human decision-making in chess uses completely independent models to capture human style at different skill levels, meaning they lack coherence in their ability to adapt to the full spectrum of human improvement and are ultimately limited in their effectiveness as AI partners and teaching tools. In this work, we propose a unified modeling approach for human-AI alignment in chess that coherently captures human style across different skill levels and directly captures how people improve. Recognizing the complex, non-linear nature of human learning, we introduce a skill-aware attention mechanism to dynamically integrate players' strengths with encoded chess positions, enabling our model to be sensitive to evolving player skill. Our experimental results demonstrate that this unified framework significantly enhances the alignment between AI and human players across a diverse range of expertise levels, paving the way for deeper insights into human decision-making and AI-guided teaching tools.

人机对齐棋类智能技能建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。