用智能布料实现舒适贴身的下肢动作捕捉,无需校准且保护隐私。
VersaPants: A Loose-Fitting Textile Capacitive Sensing System for Lower-Body Motion Capture
- 在裤子中嵌入导电织物和采集模块,通过电容信号感知动作
- 对11人3.7小时数据测试,关节位置误差11.96厘米,角度误差12.3度
- 模型参数少22倍、计算量少18倍,可在智能手表实时运行
我们提出VersaPants,首个松身式、基于织物的电容传感下肢动作捕捉系统,构建于开放硬件平台VersaSens。通过将导电织物贴片与紧凑采集单元集成至一条裤子,系统在不牺牲舒适性的情况下重建下肢姿态。与需用户定制适配的惯性测量单元(IMU)系统或侵犯隐私的摄像头方法不同,本方案无需调整贴合度且保障隐私。VersaPants为定制智能服装,每条腿设6个电容通道。采用轻量级Transformer深度学习模型,将电容信号映射为关节角度,支持边缘设备嵌入。我们采集了11名参与者执行16种日常及运动动作的约3.7小时数据。模型在髋、膝、踝关节上达到均值关节点位置误差(MPJPE)11.96 cm,均值关节点角度误差(MPJAE)12.3度,表明其对未见用户和动作具有泛化能力。与现有织物基深度学习架构对比显示,本模型性能相当,但参数量最多减少22倍,浮点运算量(FLOPs)减少18倍,可在无量化条件下实现42 FPS实时推理,部署于商用智能手表。该结果推动了面向健身、医疗与健康领域的可扩展、舒适且嵌入式动作捕捉解决方案的发展。
原文摘要 · Abstract (English)
We present VersaPants, the first loose-fitting, textile-based capacitive sensing system for lower-body motion capture, built on the open-hardware VersaSens platform. By integrating conductive textile patches and a compact acquisition unit into a pair of pants, the system reconstructs lower-body pose without compromising comfort. Unlike IMU-based systems that require user-specific fitting or camera-based methods that compromise privacy, our approach operates without fitting adjustments and preserves user privacy. VersaPants is a custom-designed smart garment featuring 6 capacitive channels per leg. We employ a lightweight Transformer-based deep learning model that maps capacitance signals to joint angles, enabling embedded implementation on edge platforms. To test our system, we collected approximately 3.7 hours of motion data from 11 participants performing 16 daily and exercise-based movements. The model achieves a mean per-joint position error (MPJPE) of 11.96 cm and a mean per-joint angle error (MPJAE) of 12.3 degrees across the hip, knee, and ankle joints, indicating the model's ability to generalize to unseen users and movements. A comparative analysis of existing textile-based deep learning architectures reveals that our model achieves competitive reconstruction performance with up to 22 times fewer parameters and 18 times fewer FLOPs, enabling real-time inference at 42 FPS on a commercial smartwatch without quantization. These results position VersaPants as a promising step toward scalable, comfortable, and embedded motion-capture solutions for fitness, healthcare, and wellbeing applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。