几何感知位置编码提升信念估计,但不必然增强对战表现。
Do Geometry-Aware Positional Encodings Help Transformers in Spatial Imperfect-Information Games?

- 用六边形网格设计四层基准测试,验证几何感知编码效果。
- 在小样本模仿学习中,信念误差降低0.329,动作准确率提升4.63个百分点。
- 适合关注推理精度与数据效率的研究者,不推荐盲目依赖编码提升博弈能力。
将Transformer应用于空间不完美信息博弈时,需同时表示地图几何结构并追踪隐藏实体。本文探究几何感知位置编码是否提升此类能力,未提出新编码方式。构建基于六边形海军追捕游戏的四级基准:可控几何拓扑探测、精确贝叶斯隐目标追踪任务、1k和10k局离线策略模仿学习,以及7200局固定种子对三类旧对手的对抗测试。在相同Transformer骨干网络下,HexRoPE相较于无位置编码,在D6变换测试轨道上信念后验交叉熵降低0.278,在更大地图上降低0.329;两者分层自助置信区间均不包含零,且霍尔姆校正p值均低于0.001。在1000局模仿中,动作准确率比无编码高4.63个百分点,比矩形相对偏差高2.05点;10000局时分别降至1.55和0.41点。然而,其对整体对战胜率无提升:与无编码相比,配对效应为-1.56个百分点(95% CI [-4.50, 1.17])。矩形相对偏差在半径3到半径4外推时骤降,图结构偏差仅带来微弱阻塞边增益。结果表明,几何归纳偏置能改善信念估计与数据高效模仿,但表征优势不自动转化为闭环博弈更强表现。
原文摘要 · Abstract (English)
Transformers applied to spatial imperfect-information games must represent map geometry while tracking hidden entities through time. We ask whether geometry-aware positional encodings improve these capabilities, without claiming a new positional encoding. We construct a four-level benchmark on a hexagonal naval pursuit game: controlled geometry and topology probes, an exact-Bayes hidden-target tracking task, offline policy imitation at 1k and 10k games, and 7,200 fixed-seed games against three legacy opponents. Across matched Transformer backbones, HexRoPE reduces exact-belief posterior cross-entropy relative to no positional encoding by 0.278 on D6-transformed test orbits and 0.329 on a larger map; both hierarchical-bootstrap confidence intervals exclude zero, and both Holm-adjusted p-values are below 0.001. At 1k games, HexRoPE improves policy action accuracy by 4.63 percentage points over no encoding and 2.05 points over rectangular relative bias; the gains shrink to 1.55 and 0.41 points at 10k games. However, HexRoPE does not improve aggregate gameplay win rate: its paired effect over no encoding is -1.56 percentage points (95% CI [-4.50, 1.17]). Rectangular relative bias is strongest on D6 belief consistency but fails sharply when extrapolating from radius 3 to radius 4, while graph bias provides only a small blocked-edge gain. The results show that geometric inductive bias improves belief estimation and data-efficient imitation, but those representation gains do not automatically produce stronger closed-loop play.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。