用类人物理直觉训练智能体玩多款游戏,泛化能力更强。
Learning to Play Video Games with Intuitive Physics Priors
- 基于物体的输入表征模拟人类学习方式
- 在有限经验下学会多款游戏,对陌生物体泛化好
- 适合研究具身智能与人类学习机制的学者
视频游戏是算法决策能力测试的理想领域,无需承担现实后果。现有方法依赖图像输入以避免手动设计状态空间表示,但这种做法偏离了人类真实的学习路径。本文设计了一种物体基础的输入表示,可在多种视频游戏中良好泛化。利用这些表示,我们评估了智能体在类似婴儿的学习模式下——仅具备有限世界经验,依赖来自现实世界的物理直觉归纳偏置——的表现。通过构建物体类别表征并用于Q-learning算法,我们检验其如何基于观察到的物体功能学习玩游戏。结果表明,采用类人物体交互设定的智能体能够有效掌握多款游戏,并在面对不熟悉物体时表现出更优的泛化能力。进一步探索此类方法将使机器以更贴近人类的方式学习,从而获得更多类人学习优势。
原文摘要 · Abstract (English)
Video game playing is an extremely structured domain where algorithmic decision-making can be tested without adverse real-world consequences. While prevailing methods rely on image inputs to avoid the problem of hand-crafting state space representations, this approach systematically diverges from the way humans actually learn to play games. In this paper, we design object-based input representations that generalize well across a number of video games. Using these representations, we evaluate an agent's ability to learn games similar to an infant - with limited world experience, employing simple inductive biases derived from intuitive representations of physics from the real world. Using such biases, we construct an object category representation to be used by a Q-learning algorithm and assess how well it learns to play multiple games based on observed object affordances. Our results suggest that a human-like object interaction setup capably learns to play several video games, and demonstrates superior generalizability, particularly for unfamiliar objects. Further exploring such methods will allow machines to learn in a human-centric way, thus incorporating more human-like learning benefits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。