用分数迭代估算《节奏光剑》地图难度和玩家水平,效果优于现有方法。
BiRating -- Iterative averaging on a bipartite graph of Beat Saber scores, player skills, and map difficulties
- 在玩家与地图构成的二分图中,通过分数交叉迭代优化难度与技能估计。
- 算法在多数地图上误差低,对传统方法难以评估的地图提升明显。
- 适合游戏平衡性研究者,或需要客观难度排序的社区运营人员。
《节奏光剑》地图难度估计是一个有趣的数据分析问题,对竞技场景有重要价值。本文提出一种仅依赖分数输入的简单算法:在由玩家与地图构成的二分图中,通过迭代平均玩家技能与地图难度估计值,利用不同玩家对同一地图的得分、同一玩家对不同地图的得分之间的关系,同时优化两者估计。尽管尚未能证明或刻画理论收敛性,但实际实现表现出收敛行为,所有实例均达到低估计误差,结果准确。一次非正式定性评估显示,算法输出的难度与资深玩家主观认知及其他已有方法高度一致。在若干典型难估地图上,该方法显著优于现有手段;但在数据不足或存在优化得分的特定地图族上,估计仍不理想。算法存在数据质量、领域假设及理论收敛性等局限。未来工作需深入理解《节奏光剑》中难度的多维量化方式,包括技能与难度的多维度特性,以及分数数据中的系统性偏差。
原文摘要 · Abstract (English)
Difficulty estimation of Beat Saber maps is an interesting data analysis problem and valuable to the Beat Saber competitive scene. We present a simple algorithm that iteratively averages player skill and map difficulty estimations in a bipartite graph of players and maps, connected by scores, using scores only as input. This approach simultaneously estimates player skills and map difficulties, exploiting each of them to improve the estimation of the other, exploitng the relation of multiple scores by different players on the same map, or on different maps by the same player. While we have been unable to prove or characterize theoretical convergence, the implementation exhibits convergent behaviour to low estimation error in all instances, producing accurate results. An informal qualitative evaluation involving experienced Beat Saber community members was carried out, comparing the difficulty estimations output by our algorithm with their personal perspectives on the difficulties of different maps. There was a significant alignment with player perceived perceptions of difficulty and with other existing methods for estimating difficulty. Our approach showed significant improvement over existing methods in certain known problematic maps that are not typically accurately estimated, but also produces problematic estimations for certain families of maps where the assumptions on the meaning of scores were inadequate (e.g. not enough scores, or scores over optimized by players). The algorithm has important limitations, related to data quality and meaningfulness, assumptions on the domain problem, and theoretical convergence of the algorithm. Future work would significantly benefit from a better understanding of adequate ways to quantify map difficulty in Beat Saber, including multidimensionality of skill and difficulty, and the systematic biases present in score data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。