用物理仿真生成更真实的人体动作数据,提升可穿戴设备动作识别效果。
Physically Plausible Data Augmentations for Wearable IMU-based Human Activity Recognition Using Physics Simulation
- 通过物理仿真模拟人体运动与传感器变化,生成符合真实规律的数据。
- 相比传统方法,平均提升3.7个百分点的宏F1值,最多达13个百分点。
- 只需60%训练样本即可达到相似性能,适合数据稀缺场景。
基于传感器的人体活动识别(HAR)面临高质量标注数据稀缺的问题,制约模型性能与跨场景泛化能力。数据增强是缓解该问题的关键策略。信号变换类数据增强(STDA)虽广泛应用,但常生成物理上不合理的数据,可能破坏活动标签的语义。本文首次系统研究基于物理仿真的物理合理数据增强(PPDA),利用动作捕捉或视频姿态估计获取人体运动数据,通过物理仿真引入真实变异,包括动作调整、传感器位置变化及硬件效应等。在三个公开日常活动与健身数据集上对比了PPDA与STDA性能:先单独评估每种增强方法,再测试多种PPDA组合对初始数据需求的降低效果。实验表明,PPDA consistently 提升性能,平均宏F1提升3.7个百分点(最高达13个百分点),并可在仅使用STDA 40%训练样本(即减少60%数据采集)的情况下达到相当性能。作为首个系统性研究,本工作验证了物理合理性在数据增强中的优势,展示了物理仿真生成惯性测量单元(IMU)合成数据的巨大潜力,为解决HAR标注稀缺问题提供了一种低成本、可扩展的新路径。
原文摘要 · Abstract (English)
The scarcity of high-quality labeled data in sensor-based Human Activity Recognition (HAR) hinders model performance and limits generalization across real-world scenarios. Data augmentation is a key strategy to mitigate this issue by enhancing the diversity of training datasets. Signal Transformation-based Data Augmentation (STDA) techniques have been widely used in HAR. However, these methods are often physically implausible, potentially resulting in augmented data that fails to preserve the original meaning of the activity labels. In this study, we introduce and systematically characterize Physically Plausible Data Augmentation (PPDA) enabled by physics simulation. PPDA leverages human body movement data from motion capture or video-based pose estimation and incorporates various realistic variabilities through physics simulation, including modifying body movements, sensor placements, and hardware-related effects. We compare the performance of PPDAs with traditional STDAs on three public datasets of daily activities and fitness workouts. First, we evaluate each augmentation method individually, directly comparing PPDAs to their STDA counterparts. Next, we assess how combining multiple PPDAs can reduce the need for initial data collection by varying the number of subjects used for training. Experiments show consistent benefits of PPDAs, improving macro F1 scores by an average of 3.7 pp (up to 13 pp) and achieving competitive performance with up to 60% fewer training subjects than STDAs. As the first systematic study of PPDA in sensor-based HAR, these results highlight the advantages of pursuing physical plausibility in data augmentation and the potential of physics simulation for generating synthetic Inertial Measurement Unit data for training deep learning HAR models. This cost-effective and scalable approach therefore helps address the annotation scarcity challenge in HAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。