arXiv:2410.12372cs.CVcs.SY2024-10

用GAN从第一视角生成环境的俯视图,帮助智能体构建完整空间认知。

GAN Based Top-Down View Synthesis in Reinforcement Learning Environments

  • 通过GAN将智能体的局部视角转化为逐步完善的俯视地图。
  • 初期仅生成部分俯视图,随探索推进逐渐补全完整环境结构。
  • 适合研究环境表征学习与视觉导航的学者参考。

人类行为基于对环境的心理感知。即使环境并非完全可见,人类仍能凭借过往经验形成的抽象时空表征,将部分可见场景推演为完整连贯的视图。在强化学习环境中,人工智能体同样可通过经验学习环境表征,获得非直接观测的视角信息,辅助制定更优策略或预测未来状态。本项目探索利用生成对抗网络(GAN)从智能体的第一人称视角观测中学习环境的俯视图。俯视图可构建环境的完整地图,提供物体尺寸、形状及其相对位置等信息。初始时,因仅可观测部分环境,生成的俯视图亦不完整;随着智能体执行一系列动作持续探索,生成的俯视图逐步完善。该生成的俯视图有助于智能体做出更优决策。本研究聚焦于学习环境的俯视表示,不涉及具体的强化学习任务。

原文摘要 · Abstract (English)

Human actions are based on the mental perception of the environment. Even when all the aspects of an environment are not visible, humans have an internal mental model that can generalize the partially visible scenes to fully constructed and connected views. This internal mental model uses learned abstract representations of spatial and temporal aspects of the environments encountered in the past. Artificial agents in reinforcement learning environments also benefit by learning a representation of the environment from experience. It provides the agent with viewpoints that are not directly visible to it, helping it make better policy decisions. It can also be used to predict the future state of the environment. This project explores learning the top-down view of an RL environment based on the artificial agent's first-person view observations with a generative adversarial network(GAN). The top-down view is useful as it provides a complete overview of the environment by building a map of the entire environment. It provides information about the objects' dimensions and shapes along with their relative positions with one another. Initially, when only a partial observation of the environment is visible to the agent, only a partial top-down view is generated. As the agent explores the environment through a set of actions, the generated top-down view becomes complete. This generated top-down view can assist the agent in deducing better policy decisions. The focus of the project is to learn the top-down view of an RL environment. It doesn't deal with any Reinforcement Learning task.

生成模型环境建模强化学习空间表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。