用人体运动学约束提升惯性定位精度,实现无摄像头的高鲁棒人体追踪。
MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry

- 基于人体运动学学习IMU姿态先验,增强运动一致性约束。
- 在Nymeria数据集上位置漂移降低36%,长时性能提升42%。
- 融合磁力计、气压计等轻量传感器,适合消费级AR眼镜部署。
仅使用惯性测量单元(IMUs)的惯性里程计(IO)为增强现实(AR)和可穿戴设备中的人体运动追踪提供了轻量级解决方案。近年来,基于学习的IO方法通过大规模人体运动数据集预训练提升了泛化能力,但因未显式建模人体运动动力学,仍易受漂移与噪声影响,尤其在日常活动数据集Nymeria上表现不佳。本文提出将惯性里程计建立在人体运动学基础上,通过学习的IMU推断姿态先验,引入物理一致的运动约束。我们将该先验融入现有IO架构,在挑战性更强的Nymeria数据集上将位置漂移降低36%,该数据集规模是先前研究使用的5倍。进一步通过融合商业AR眼镜已有的轻量传感器信号——包括磁力计、气压计和辅助IMU——构建多模态传感融合框架,使位置漂移最多减少42%,显著提升在多样运动条件下的鲁棒性与泛化能力。本工作统一了人体运动学与多模态感知,为无相机人体追踪树立新基准。
原文摘要 · Abstract (English)
Inertial odometry (IO) using only Inertial Measurement Units (IMUs) provides a lightweight solution for human motion tracking in augmented reality (AR) and wearable devices. Recent learning-based IO methods have improved the generalizability of inertial localization through large-scale pretraining on human motion datasets. However, these approaches remain prone to drift and noise because they do not explicitly capture human motion dynamics, especially on daily activity datasets such as Nymeria. In this work, we propose to ground inertial odometry in human kinematics through a learned IMU-inferred pose prior, which promotes physically consistent motion constraints. We integrate this pose prior into existing IO architectures and reduce positional drift by up to 36% on the challenging Nymeria dataset, which is 5x larger than datasets used in prior work. We further improve long-term performance with a sensor-fusion framework that incorporates auxiliary signals from lightweight sensors already available on commercial AR glasses, including magnetometers, barometers, and secondary IMUs. With this fusion strategy, positional drift is reduced by up to 42%, improving robustness and generalization across diverse motion conditions. Together, our results introduce a new paradigm for inertial and lightweight odometry by unifying human motion kinematics with multimodal sensing, setting a new benchmark for accurate and robust camera-less human tracking. Our website is available at https://spice-lab.org/projects/MARIO/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。