arXiv:2608.09902cs.AIcs.NE2026-08

DSLE为黑暗之魂22个首领战提供可复现的强化学习测试环境。

DSLE: A Learning Environment for Dark Souls Boss Encounters

论文配图:DSLE: A Learning Environment for Dark Souls Boss Encounters
图 1 · 摘自论文原文
  • 构建容器化游戏环境,支持智能体通过视觉输入实时对抗
  • 五位首领子集评估显示各算法均未战胜除教程怪外的敌人
  • 首次系统报告失败案例中的生存时长与伤害数据,超越单纯胜率

我们提出黑暗之魂学习环境(DSLE),一个容器化平台,将《黑暗之魂:重制版》全部22个首领战转化为基于Gymnasium风格接口的游戏代理基准测试。DSLE融合实时战斗、高维视觉输入与稀疏终局奖励,每个环境步对应一次真实游戏操作。为支持可控比较,定义了包含五个典型战斗场景的DSLE-5子集:近战、空间受限、环境威胁、多目标及快速最终首领战,推荐作为新代理的起点。在DSLE-5上评估随机策略、专家系统、进化基线以及从视觉输入训练的PPO和DQN代理。专家系统与进化基线分别在教程首领阿斯林恶魔处达到63%与43%峰值胜率,但无一能击败其余四个首领;PPO与DQN在预算已耗时数十小时的前提下表现极差(教程怪最高0.33%,其余全为0%)。更广泛的实验在全等级50优势下运行进化基线,仅额外战胜少数早期首领,其余仍无法通关。失败情形包括几秒内死亡的紧凑多目标战,以及持续数分钟却几乎不造成伤害的僵局,我们通过生存时间与伤害量而非仅胜率报告失败模式。

原文摘要 · Abstract (English)

We introduce the Dark Souls Learning Environment (DSLE), a containerized platform that presents all 22 boss encounters of Dark Souls: Remastered as game-playing agent benchmarks through a Gymnasium-style interface. DSLE combines real-time combat, high-dimensional visual input, and sparse terminal rewards, with each environment step being a real action executed against the running game. To support controlled comparison, we define DSLE-5, a representative five-boss subset, spanning a melee fight, a spatially constrained arena, an environmental-hazard fight, a multi-target fight, and a fast final-boss fight, that we recommend as the starting suite for agents built on DSLE. On DSLE-5 we evaluate a random policy, an expert system, an evolutionary baseline, and PPO and DQN agents trained from visual input. The expert system and the evolutionary baseline each defeat the Asylum Demon, the game's tutorial boss (63% and 43% peak win rates), but none of the five methods defeats the other four DSLE-5 bosses; PPO and DQN show no measurable learning (at most 0.33% win rate on the tutorial boss, 0% elsewhere) within a budget that already costs tens of wall-clock hours per run. A broader study running the evolutionary baseline across all 22 encounters under advantaged all level-50 stats yields wins on only a handful of additional early-game bosses and leaves the rest unwon. The failure cases range from sub-10-second deaths in cramped, multi-target encounters to minute-long stalemates that inflict almost no damage, and we report them through survival time and damage dealt rather than win rate alone.

强化学习游戏智能体基准测试生存分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。