arXiv:2410.15343cs.AI2024-10

用人体姿态估计实现虚拟角色同步动作,替代健身环操作设备。

POSE: Pose estimation Of virtual Sync Exhibit system

  • 通过AI人体姿态估计识别真实动作,驱动虚拟角色
  • 多进程架构降低系统延迟,提升交互响应速度
  • 免外设操控,适合希望低成本沉浸式健身的用户

本工作实现了一种便携式元宇宙应用,利用AI进行3D姿态估计,使虚拟角色能够同步真人动作并与环境互动。研究动机源于使用手柄和传感器操控健身环时的不便。为替代传统输入设备并降低成本,我们开发了基于姿态估计的平台,可识别真实人体动作以控制虚拟角色,并引入多进程设计实现模块化,有效降低整体延迟。

原文摘要 · Abstract (English)

This work is a portable MetaVerse implementation, and we use 3D pose estimation with AI to make virtual avatars do synchronized actions and interact with the environment. The motivation is that we find it inconvenient to use joysticks and sensors when playing with fitness rings. In order to replace joysticks and reduce costs, we developed a platform that can control virtual avatars through pose estimation to identify the movements of real people, and we also implemented a multi-process to achieve modularization and reduce the overall latency.

姿态估计元宇宙虚拟交互健身应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。