arXiv:2607.18361cs.LGcs.AI2026-07

用物理规律替代标签,实现无监督的惯性传感器精准感知

Physical Self-Supervised Learning: IMU Sensing without Manual Labels

论文配图:Physical Self-Supervised Learning: IMU Sensing without Manual Labels
图 1 · 摘自论文原文
  • 用可自适应的物理方程替代传统解码器,强制模型符合运动规律
  • 在复杂场景下追踪误差降低5倍,全身动作捕捉误差降低4倍
  • 适合需要低成本部署、跨设备通用的智能穿戴与动作识别场景

深度神经网络在基于惯性测量单元(IMU)的感知中展现出巨大潜力,但其可扩展性受限于昂贵的人工标注数据以及对异构设备、佩戴位置和用户之间的鲁棒性差。现有无监督和自监督方法虽减轻了标注依赖,但仍需标注数据进行领域适配,并忽视了已知的物理结构。本文提出物理自监督学习,一种无需标签的自编码器范式。将传统神经解码器替换为可自适应的物理解码器——一个可学习的运动学方程族,在保持显式物理结构的同时适应不同环境;采用混合双阶段IMU编码器,在结构化隐空间中重建以抑制传感器噪声。框架进一步引入概率频率-空间约束以分离传感器与物体运动,设计多视角运动学树以利用稀疏的物理自监督信号,并采用不确定性感知公式处理IMU推断中的固有歧义。在公开数据集和真实部署中评估惯性追踪与全身动作捕捉任务,该方法在挑战性泛化场景下追踪误差降低5倍,动作捕捉误差降低4倍,且无需任何标签,持续优于最先进的监督与自监督基线。代码已开源。

原文摘要 · Abstract (English)

Deep neural networks have become a promising approach for IMU-based sensing, but their scalability is fundamentally limited by costly labeled data and poor robustness to heterogeneous devices, placements, and users. Existing unsupervised and self-supervised methods reduce but do not remove this dependence, still requiring labeled data for domain adaptation and largely ignoring known physical structure. We propose physical self-supervised learning, an autoencoder-style paradigm for label-free IMU sensing. We replace the conventional neural decoder with an auto-adaptive physics decoder, a learnable family of kinematic equations that enforces explicit physical structure while adapting across environments, and adopt a hybrid two-stage IMU encoder with reconstruction in a structured latent space to mitigate sensor noise. Our framework further introduces probabilistic frequency-spatial constraints to disentangle sensor and object motion, a multi-view kinematic tree to exploit sparse physical self-supervised signals, and an uncertainty-aware formulation to handle the inherent ambiguity of IMU inference. Evaluated on inertial tracking and full-body motion capture over public datasets and realistic deployments, physical self-supervised learning reduces errors by up to 5x for tracking and 4x for motion capture in challenging generalization scenarios, consistently outperforming state-of-the-art supervised and self-supervised baselines without any labels. Our code is available at https://github.com/YuyangLeng/physical-ssl-imu-label-free

自监督学习惯性传感物理模型动作捕捉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。