arXiv:2601.01360cs.CVcs.HC2026-01

让松身衣物上的传感器也能精准捕捉动作,无需紧贴身体。

Garment Inertial Denoiser (GID): Endowing Accurate Motion Capture via Loose IMU Denoiser

  • 用分区域专家网络分离处理衣物动态与整体运动
  • 仅需单用户数据训练,就能跨人、跨动作、跨服装通用
  • 可直接替换现有系统,适合日常穿戴式动捕

可穿戴惯性动捕(MoCap)提供便携、无遮挡、保隐私的替代方案,但精度依赖传感器紧贴身体——这在日常使用中不舒适。将惯性测量单元(IMU)嵌入松身衣物是理想选择,但传感器与身体的相对位移会引入严重、结构化且位置相关的干扰,破坏传统惯性处理流程。本文提出GID(Garment Inertial Denoiser),一种轻量级、即插即用的Transformer模型,将松身动捕分解为三阶段:(i) 位置特异性去噪,(ii) 自适应跨部位融合,(iii) 通用姿态预测。GID采用位置感知的专家架构,共享时空主干网络建模全局运动,每个IMU配备专用头学习局部衣物动态,辅以轻量融合模块保证跨部位一致性。这种归纳偏置支持从有限配对的松紧数据中稳定训练。我们还构建了GarMoCap数据集,包含公开和新采集的数据,覆盖多样用户、动作和衣物类型。实验表明,GID能实现高精度实时去噪,仅需单用户训练即可泛化至未见用户、动作和衣物类型,作为即插即用模块持续提升现有惯性动捕方法性能。

原文摘要 · Abstract (English)

Wearable inertial motion capture (MoCap) provides a portable, occlusion-free, and privacy-preserving alternative to camera-based systems, but its accuracy depends on tightly attached sensors - an intrusive and uncomfortable requirement for daily use. Embedding IMUs into loose-fitting garments is a desirable alternative, yet sensor-body displacement introduces severe, structured, and location-dependent corruption that breaks standard inertial pipelines. We propose GID (Garment Inertial Denoiser), a lightweight, plug-and-play Transformer that factorizes loose-wear MoCap into three stages: (i) location-specific denoising, (ii) adaptive cross-wear fusion, and (iii) general pose prediction. GID uses a location-aware expert architecture, where a shared spatio-temporal backbone models global motion while per-IMU expert heads specialize in local garment dynamics, and a lightweight fusion module ensures cross-part consistency. This inductive bias enables stable training and effective learning from limited paired loose-tight IMU data. We also introduce GarMoCap, a combined public and newly collected dataset covering diverse users, motions, and garments. Experiments show that GID enables accurate, real-time denoising from single-user training and generalizes across unseen users, motions, and garment types, consistently improving state-of-the-art inertial MoCap methods when used as a drop-in module.

动捕惯性传感器去噪衣物穿戴

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。