arXiv:2512.22690cs.MMcs.CV2025-12

用15个廉价传感器+手机实现低成本实时动捕,浏览器里就能用。

Mesquite MoCap: Democratizing Real-Time Motion Capture with Affordable, Bodyworn IoT Sensors and WebXR SLAM

  • 15个可穿戴惯性传感器+手机定位,通过网页实时处理数据。
  • 误差仅2-5度,成本仅为商用系统的5%,帧率30fps延迟低于15ms。
  • 开源软硬件,适合娱乐、医疗、人机交互等场景快速部署。

动作捕捉仍因成本高、部署复杂而局限于实验室。本文提出Mesquite,一个开源、低成本的惯性动作捕捉系统,由15个可穿戴IMU传感器节点与髋部佩戴的安卓手机组成,用于位置追踪。低功耗无线链路将四元数姿态数据传输至中央USB网卡和基于浏览器的应用程序,实现实时可视化与录制。系统基于现代网页技术——使用WebGL渲染、WebXR实现SLAM、WebSerial与WebSockets处理设备与网络输入、渐进式Web应用打包——可在全平台浏览器中运行。在与商用光学系统对比测试中,平均关节角误差为2-5度,成本约为其1/20。系统在标准室内环境下维持30帧每秒,端到端延迟低于15毫秒,包传输率不低于99.7%。通过融合物联网理念、边缘计算与网页原生技术,Mesquite显著降低了动作捕捉的门槛,适用于娱乐、生物力学、健康监测、人机交互及虚拟现实等领域。硬件设计、固件与软件均以GNU GPL开源协议发布。

原文摘要 · Abstract (English)

Motion capture remains costly and complex to deploy, limiting use outside specialized laboratories. We present Mesquite, an open-source, low-cost inertial motion-capture system that combines a body-worn network of 15 IMU sensor nodes with a hip-worn Android smartphone for position tracking. A low-power wireless link streams quaternion orientations to a central USB dongle and a browser-based application for real-time visualization and recording. Built on modern web technologies -- WebGL for rendering, WebXR for SLAM, WebSerial and WebSockets for device and network I/O, and Progressive Web Apps for packaging -- the system runs cross-platform entirely in the browser. In benchmarks against a commercial optical system, Mesquite achieves mean joint-angle error of 2-5 degrees while operating at approximately 5% of the cost. The system sustains 30 frames per second with end-to-end latency under 15ms and a packet delivery rate of at least 99.7% in standard indoor environments. By leveraging IoT principles, edge processing, and a web-native stack, Mesquite lowers the barrier to motion capture for applications in entertainment, biomechanics, healthcare monitoring, human-computer interaction, and virtual reality. We release hardware designs, firmware, and software under an open-source license (GNU GPL).

动作捕捉物联网网页端低成本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。