统一解释世界模型的接口,让不同架构的可解释性分析通用化。
One Lens, Many Worlds : A Capability-Typed Interface for World-Model Interpretability
- 设计能力类型接口,抽象出编码、转移等四类核心方法。
- 支持多种模型(如Dreamer、IRIS、I-JEPA)的统一分析与干预。
- 适合研究可解释性或强化学习模型的开发者使用。
世界模型基于不同的计算结构:如PlaNet和Dreamer系列采用潜空间递归模型,将观测压缩为递归状态;IRIS等基于标记的模型将观测量化为学习码本,并用Transformer自回归预测;I-JEPA则在无像素解码器的潜空间中进行预测。现有可解释性方法(探针、激活补丁、稀疏自编码器、意外分析)虽共享基本范式,但因现有钩子与缓存工具仅针对带动作、环境步数和想象回放的Transformer语言模型而被重复实现。我们指出,这种碎片化源于工具而非模型本身。世界模型共享的结构可通过一个小型能力类型接口捕捉。本文提出WorldModelLens,一个开源可解释性基座,围绕能力类型适配器构建:每个模型需实现四类必选方法(encode, transition, initial state, sample),并通过显式能力描述声明可选头(decode, reward, continue, actor, critic),使强化学习与自监督模型均作为第一类存在,无需彼此模仿。单一钩子与缓存层即可暴露时间索引激活、想象回放及干预重播,使得每种分析只需编写一次。
原文摘要 · Abstract (English)
World models are now built on substantially different computational substrates. Latent recurrent state-space models such as PlaNet and the Dreamer family compress observations into recurrent states; token-based models such as IRIS quantize observations into a learned codebook and predict autoregressively with a transformer; and joint-embedding predictive architectures such as I-JEPA predict in a learned latent space with no pixel decoder. The interpretability methods applied to these models, including probing, activation patching, sparse autoencoders, and surprise analysis, share a common set of primitives, yet they are re-implemented from scratch for each architecture because existing hook-and-cache tooling assumes a transformer language model with no notion of actions, environment steps, or imagined rollouts. We argue that this fragmentation reflects the tooling rather than the models, and that the shared structure of world models is captured by a small typed interface. We present WorldModelLens, an open-source interpretability substrate organized around a capability-typed adapter: every model implements four required methods (encode, transition, initial state, sample) and declares a set of optional heads (decode, reward, continue, actor, critic) through an explicit capability descriptor, so that reinforcement-learning and self-supervised world models are first-class without either imitating the other. A single hook and cache layer exposes time-indexed activations, imagination rollouts, and intervention replay over this interface, allowing each analysis to be written once.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。