TongSIM是一个通用智能体仿真平台,支持从导航到协作的多场景训练。
TongSIM: A General Platform for Simulating Intelligent Machines
- 构建高保真通用仿真环境,覆盖百种室内场景与开放户外城镇。
- 支持多智能体社会模拟与人机协作,可评估感知、决策等综合能力。
- 适合研究具身智能、人机协同及复杂任务的通用平台设计者。
随着人工智能快速发展,尤其在多模态大语言模型领域,研究重点正从单模态文本处理转向更复杂的多模态与具身智能。具身智能强调在真实感仿真环境中通过物理交互和动作反馈训练智能体,而非依赖传统标注数据集。然而,现有仿真平台大多功能单一,缺乏通用性。为填补这一空白,我们提出TongSIM——一个高保真、通用的具身智能体训练与评估平台。TongSIM提供超过100种多样化的多房间室内场景,以及开放式、互动丰富的室外城镇仿真环境,确保广泛适用性。其完整的评估框架与基准测试可精确衡量智能体在感知、认知、决策、人机协作、空间与社会推理等方面的能力。平台具备自定义场景、任务自适应保真度、多种智能体类型及动态环境模拟等特性,为研究人员提供灵活性与可扩展性,成为推动通用具身智能发展的统一平台。
原文摘要 · Abstract (English)
As artificial intelligence (AI) rapidly advances, especially in multimodal large language models (MLLMs), research focus is shifting from single-modality text processing to the more complex domains of multimodal and embodied AI. Embodied intelligence focuses on training agents within realistic simulated environments, leveraging physical interaction and action feedback rather than conventionally labeled datasets. Yet, most existing simulation platforms remain narrowly designed, each tailored to specific tasks. A versatile, general-purpose training environment that can support everything from low-level embodied navigation to high-level composite activities, such as multi-agent social simulation and human-AI collaboration, remains largely unavailable. To bridge this gap, we introduce TongSIM, a high-fidelity, general-purpose platform for training and evaluating embodied agents. TongSIM offers practical advantages by providing over 100 diverse, multi-room indoor scenarios as well as an open-ended, interaction-rich outdoor town simulation, ensuring broad applicability across research needs. Its comprehensive evaluation framework and benchmarks enable precise assessment of agent capabilities, such as perception, cognition, decision-making, human-robot cooperation, and spatial and social reasoning. With features like customized scenes, task-adaptive fidelity, diverse agent types, and dynamic environmental simulation, TongSIM delivers flexibility and scalability for researchers, serving as a unified platform that accelerates training, evaluation, and advancement toward general embodied intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。