DVS实现虚实同步,支持移动机器人动态任务仿真与真实部署。
Demonstrating DVS: Dynamic Virtual-Real Simulation Platform for Mobile Robotic Tasks
- 通过虚拟现实同步机制,动态模拟行人行为与场景编辑。
- 支持路径规划、抓取等任务,实测验证虚实数据一致性。
- 适合人机协作与实时反馈算法研究,兼容真实机器人部署。
随着具身人工智能的发展,机器人研究日益聚焦于复杂任务。现有仿真平台常受限于理想化环境、简单任务场景及数据不互通,制约任务分解与多任务学习。同时,当前平台在动态行人建模、场景可编辑性及虚实资产同步方面存在挑战,阻碍真实机器人部署与反馈。为此,我们提出DVS(Dynamic Virtual-Real Simulation Platform),一个面向移动机器人任务的动态虚实同步平台。DVS集成随机行人行为建模插件与大规模可定制室内场景,生成带标注训练数据;配备光学动作捕捉系统,实现虚拟与真实世界中物体位姿与坐标的同步,支持动态任务基准测试。实验验证表明,DVS可有效支撑行人轨迹预测、机器人路径规划及机械臂抓取等任务,具备仿真与真实部署潜力。DVS不仅是一个多功能机器人平台,更推动了人机协同执行任务与虚实融合环境中的实时反馈算法研究。更多信息见 https://immvlab.github.io/DVS/。
原文摘要 · Abstract (English)
With the development of embodied artificial intelligence, robotic research has increasingly focused on complex tasks. Existing simulation platforms, however, are often limited to idealized environments, simple task scenarios and lack data interoperability. This restricts task decomposition and multi-task learning. Additionally, current simulation platforms face challenges in dynamic pedestrian modeling, scene editability, and synchronization between virtual and real assets. These limitations hinder real world robot deployment and feedback. To address these challenges, we propose DVS (Dynamic Virtual-Real Simulation Platform), a platform for dynamic virtual-real synchronization in mobile robotic tasks. DVS integrates a random pedestrian behavior modeling plugin and large-scale, customizable indoor scenes for generating annotated training datasets. It features an optical motion capture system, synchronizing object poses and coordinates between virtual and real world to support dynamic task benchmarking. Experimental validation shows that DVS supports tasks such as pedestrian trajectory prediction, robot path planning, and robotic arm grasping, with potential for both simulation and real world deployment. In this way, DVS represents more than just a versatile robotic platform; it paves the way for research in human intervention in robot execution tasks and real-time feedback algorithms in virtual-real fusion environments. More information about the simulation platform is available on https://immvlab.github.io/DVS/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。