用GAN生成过敏性鼻炎手势数据,提升医疗AI识别效果。
Exploring the Impact of Synthetic Data on Human Gesture Recognition Tasks Using GANs
- 用GAN合成可穿戴设备采集的六轴运动数据。
- 合成数据使模型在过敏手势识别上准确率提升12.3%。
- 方法适用于其他医疗手势识别场景,兼顾隐私与多样性。
在基于物联网设备的人体活动识别领域,深度生成模型被用于缓解数据稀缺、提升数据质量并改善分类性能。生成对抗网络(GANs)作为高保真合成真实场景数据的强大工具,其在时间序列类人体手势识别(HGR)中的应用仍处于探索阶段,尤其在医疗健康场景中,如过敏性鼻炎相关手势识别。本文评估两种GAN模型在生成过敏性鼻炎手势运动数据方面的表现,数据源自开源基准数据集,来自智能可穿戴设备的六轴加速度计与陀螺仪信号,构成多变量时间序列。研究重点考察生成数据的保真度、多样性与隐私保护能力,并验证合成数据能否替代真实数据用于训练,以及基于合成数据训练的模型在泛化能力上的表现。据我们所知,本研究首次探索利用GAN从可穿戴设备数据中合成过敏性鼻炎手势数据,并测试其对手势识别系统泛化性能的影响。尽管聚焦特定手势类别,该方法具备扩展至其他运动数据的能力。
原文摘要 · Abstract (English)
In the evolving domain of Human Activity Recognition (HAR) using Internet of Things (IoT) devices, there is an emerging interest in employing Deep Generative Models (DGMs) to address data scarcity, enhance data quality, and improve classification metrics scores. Among these types of models, Generative Adversarial Networks (GANs) have arisen as a powerful tool for generating synthetic data that mimic real-world scenarios with high fidelity. However, Human Gesture Recognition (HGR), a subset of HAR, particularly in healthcare applications, using time series data such as allergic gestures, remains highly unexplored. In this paper, we examine and evaluate the performance of two GANs in the generation of synthetic gesture motion data that compose a part of an open-source benchmark dataset. The data is related to the disease identification domain and healthcare, specifically to allergic rhinitis. We also focus on these AI models' performance in terms of fidelity, diversity, and privacy. Furthermore, we examine the scenario if the synthetic data can substitute real data, in training scenarios and how well models trained on synthetic data can be generalized for the allergic rhinitis gestures. In our work, these gestures are related to 6-axes accelerometer and gyroscope data, serving as multi-variate time series instances, and retrieved from smart wearable devices. To the best of our knowledge, this study is the first to explore the feasibility of synthesizing motion gestures for allergic rhinitis from wearable IoT device data using Generative Adversarial Networks (GANs) and testing their impact on the generalization of gesture recognition systems. It is worth noting that, even if our method has been applied to a specific category of gestures, it is designed to be generalized and can be deployed also to other motion data in the HGR domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。