arXiv:2509.21242cs.RO2025-09被引 4

FSGlove用惯性传感器实现48自由度手部追踪并自动生成个性化手形。

FSGlove: An Inertial-Based Hand Tracking System with Shape-Aware Calibration

  • 通过可微分优化的DiffHCal方法,联合校准关节运动与手部形状。
  • 关节角度误差低于2.7度,手形重建和接触拟真度优于商用方案。
  • 适合需要高精度手部动作捕捉的机器人、虚拟现实研究者使用。

精确的手部运动捕捉对机器人、虚拟现实和生物力学应用至关重要,但现有系统在高自由度关节运动捕捉和个性化手形建模方面存在局限。商用数据手套最多支持21个自由度,难以满足复杂操作需求,且忽略对手形差异的建模,影响接触任务的准确性。本文提出FSGlove,一种基于惯性传感器的系统,可同时追踪高达48个自由度,并通过DiffHCal新校准方法重建个性化手形。每个手指关节及手背均配备惯性测量单元(IMU),实现高分辨率运动感知。DiffHCal结合可微分优化与参数化MANO模型,一次性求解关节运动学、手形参数及传感器偏移。系统在与Nokov光学动捕对比中表现优异,关节角误差小于2.7度,显著提升手形重建与接触保真度。其开源软硬件设计兼容当前VR与机器人生态,能捕捉指尖摩擦等细微动作,弥合人类灵巧性与机器人模仿之间的差距。

原文摘要 · Abstract (English)

Accurate hand motion capture (MoCap) is vital for applications in robotics, virtual reality, and biomechanics, yet existing systems face limitations in capturing high-degree-of-freedom (DoF) joint kinematics and personalized hand shape. Commercial gloves offer up to 21 DoFs, which are insufficient for complex manipulations while neglecting shape variations that are critical for contact-rich tasks. We present FSGlove, an inertial-based system that simultaneously tracks up to 48 DoFs and reconstructs personalized hand shapes via DiffHCal, a novel calibration method. Each finger joint and the dorsum are equipped with IMUs, enabling high-resolution motion sensing. DiffHCal integrates with the parametric MANO model through differentiable optimization, resolving joint kinematics, shape parameters, and sensor misalignment during a single streamlined calibration. The system achieves state-of-the-art accuracy, with joint angle errors of less than 2.7 degree, and outperforms commercial alternatives in shape reconstruction and contact fidelity. FSGlove's open-source hardware and software design ensures compatibility with current VR and robotics ecosystems, while its ability to capture subtle motions (e.g., fingertip rubbing) bridges the gap between human dexterity and robotic imitation. Evaluated against Nokov optical MoCap, FSGlove advances hand tracking by unifying the kinematic and contact fidelity. Hardware design, software, and more results are available at: https://sites.google.com/view/fsglove.

手部追踪惯性传感个性化建模机器人仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。