arXiv:2601.14232cs.LGcs.AI2026-01

提出可分解视觉变化的基准,快速评估强化学习在视觉迁移下的表现。

KAGE-Bench: Fast Known-Axis Visual Generalization Evaluation for Reinforcement Learning

  • 构建可独立控制视觉维度的JAX平台环境,分离视觉变化因素。
  • 6个配置集34组训练-测试对,发现背景与光照变化最影响性能。
  • 单卡每秒处理3300万步,支持快速可复现的实验迭代。

基于像素的强化学习智能体在纯视觉分布偏移下常失效,但现有基准混杂多种偏移源,阻碍系统分析。我们提出KAGE-Env,一个原生JAX的2D平台游戏环境,将观察过程分解为可独立控制的视觉轴,同时保持底层控制问题不变。通过构造,改变某一视觉轴仅通过像素策略的状态条件动作分布影响性能,提供清晰的视觉泛化抽象。在此基础上,定义KAGE-Bench,包含6个已知轴套件、共34组训练-评估配置对,分别隔离单一视觉偏移。使用标准PPO-CNN基线,观察到显著的轴依赖性失败:背景和光照变化常导致性能崩溃,而代理外观变化相对温和。部分偏移虽保留前进运动,却破坏任务完成,表明回报本身可能掩盖泛化失败。最终,完全向量化实现使单卡每秒可达3300万环境步,支持快速且可复现的视觉因子扫查。代码:https://avanturist322.github.io/KAGEBench/。

原文摘要 · Abstract (English)

Pixel-based reinforcement learning agents often fail under purely visual distribution shift even when latent dynamics and rewards are unchanged, but existing benchmarks entangle multiple sources of shift and hinder systematic analysis. We introduce KAGE-Env, a JAX-native 2D platformer that factorizes the observation process into independently controllable visual axes while keeping the underlying control problem fixed. By construction, varying a visual axis affects performance only through the induced state-conditional action distribution of a pixel policy, providing a clean abstraction for visual generalization. Building on this environment, we define KAGE-Bench, a benchmark of six known-axis suites comprising 34 train-evaluation configuration pairs that isolate individual visual shifts. Using a standard PPO-CNN baseline, we observe strong axis-dependent failures, with background and photometric shifts often collapsing success, while agent-appearance shifts are comparatively benign. Several shifts preserve forward motion while breaking task completion, showing that return alone can obscure generalization failures. Finally, the fully vectorized JAX implementation enables up to 33M environment steps per second on a single GPU, enabling fast and reproducible sweeps over visual factors. Code: https://avanturist322.github.io/KAGEBench/.

强化学习视觉泛化基准测试JAX

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。