arXiv:2508.14893cs.CVcs.CL2025-08被引 11

构建开放世界平台,研究人与机器人共处的社会智能。

Virtual Community: An Open World for Humans, Robots, and Society

  • 基于真实3D场景与物理引擎的多智能体仿真平台。
  • 支持大规模真实世界社区生成与多角色交互行为建模。
  • 适合研究人机协作、社会推理及开放世界任务规划的团队。

人工智能与机器人技术的快速发展可能引发深刻的社会变革,使人与机器人在共享社区中共存,带来机遇与挑战。为探索这一未来,我们提出Virtual Community——一个面向人类、机器人与社会的开放世界平台,基于通用物理引擎并扎根于真实世界的3D场景。该平台旨在实现大规模具身社会智能的研究。Virtual Community具备:1)开源的多智能体物理模拟器,支持机器人、人类及其社会互动;2)大规模、与现实对齐的社区生成流程,涵盖广阔的户外空间、多样化的室内场景,以及具有丰富角色特征与外观的实体代理群体。基于此平台,我们提出两项新挑战:社区规划挑战,评估多智能体在开放世界中的推理与规划能力,如协作完成日常任务并高效连接其他个体;社区机器人挑战要求多种异构机器人协同完成复杂开放世界任务。我们在这些任务上评估了多种基线方法,揭示了在高层开放世界任务规划与底层协作控制方面仍存在显著挑战。我们期望Virtual Community能推动开放世界环境中人机共存的深入研究。

原文摘要 · Abstract (English)

The rapid progress in AI and Robotics may lead to a profound societal transformation, as humans and robots begin to coexist within shared communities, introducing both opportunities and challenges. To explore this future, we present Virtual Community-an open-world platform for humans, robots, and society-built on a universal physics engine and grounded in real-world 3D scenes. With Virtual Community, we aim to enable the study of embodied social intelligence at scale. To support these, Virtual Community features: 1) An open-source multi-agent physics simulator that supports robots, humans, and their interactions within a society; 2) A large-scale, real-world aligned community generation pipeline, including vast outdoor space, diverse indoor scenes, and a community of grounded agents with rich characters and appearances. Leveraging Virtual Community, we propose two novel challenges. The Community Planning Challenge evaluates multi-agent reasoning and planning ability in open-world settings, such as cooperating to help agents with daily activities and efficiently connecting other agents. The Community Robot Challenge requires multiple heterogeneous robots to collaborate in solving complex open-world tasks. We evaluate various baselines on these tasks and demonstrate the challenges in both high-level open-world task planning and low-level cooperation controls. We hope that Virtual Community will unlock further study of human-robot coexistence within open-world environments.

人机共存开放世界多智能体社会智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。