用向量符号架构构建可泛化的世界模型,提升推理与抗噪能力。
Geometric Priors for Generalizable World Models via Vector Symbolic Architecture
- 基于傅里叶全息表示的向量空间编码状态与动作
- 零样本准确率达87.5%,20步预测精度提升53.6%
- 适合需要可解释性与强泛化的规划任务
人工智能与神经科学中的核心挑战是理解神经系统如何学习捕捉世界底层动态的表征。现有世界模型多采用无结构的神经网络表示转移函数,限制了可解释性、样本效率及对未见状态或动作组合的泛化能力。本文提出一种基于向量符号架构(VSA)几何先验的可泛化世界模型。通过可学习的傅里叶全息简化表示(FHRR)编码器,将状态与动作映射至高维复数向量空间,并利用元素级复数乘法建模转移。我们形式化了该框架的群论基础,证明训练具有近似不变性的结构化表征能实现潜空间中强多步组合与优异泛化。在离散网格世界环境中,模型在未见状态-动作对上达到87.5%的零样本准确率,20步前向滚动预测准确率提升53.6%,对噪声的鲁棒性比MLP基线高出4倍。结果表明,学习潜在群结构可实现数据高效、可解释且可泛化的世界模型,为真实世界的规划与推理提供原理性路径。
原文摘要 · Abstract (English)
A key challenge in artificial intelligence and neuroscience is understanding how neural systems learn representations that capture the underlying dynamics of the world. Most world models represent the transition function with unstructured neural networks, limiting interpretability, sample efficiency, and generalization to unseen states or action compositions. We address these issues with a generalizable world model grounded in Vector Symbolic Architecture (VSA) principles as geometric priors. Our approach utilizes learnable Fourier Holographic Reduced Representation (FHRR) encoders to map states and actions into a high dimensional complex vector space with learned group structure and models transitions with element-wise complex multiplication. We formalize the framework's group theoretic foundation and show how training such structured representations to be approximately invariant enables strong multi-step composition directly in latent space and generalization performances over various experiments. On a discrete grid world environment, our model achieves 87.5% zero shot accuracy to unseen state-action pairs, obtains 53.6% higher accuracy on 20-timestep horizon rollouts, and demonstrates 4x higher robustness to noise relative to an MLP baseline. These results highlight how training to have latent group structure yields generalizable, data-efficient, and interpretable world models, providing a principled pathway toward structured models for real-world planning and reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。