随机裁剪提升手势识别性能,增强模型泛化能力
AugmentGest: Can Random Data Cropping Augmentation Boost Gesture Recognition Performance?
- 引入随机裁剪等几何变换,保留时空完整性
- 每样本生成3个新样本,数据量扩大4倍
- 在3个模型上均达最优,适合真实场景应用
数据增强对骨架数据集等小样本任务至关重要。本文提出综合数据增强框架,集成几何变换、随机裁剪、旋转、缩放及亮度对比度调整,模拟真实世界变化。随机裁剪在保持时空结构的同时缓解视角偏差与遮挡问题。每个样本生成3个增强版本,使数据集规模扩大至4倍,丰富手势表征多样性。在多流端到端e2eET、基于点云的手势识别FPPR-PCD和轻量级骨架动作识别DD-Net三种模型上测试,使用DHG14/28、SHREC'17和JHMDB等基准数据集。e2eET在DHG14/28和SHREC'17上为当前最佳;FPPR-PCD在SHREC'17上排名第二,擅长点云手势识别;DD-Net在SHREC'17和人类运动数据库JHMDB上评估。结果表明该增强策略显著提升模型泛化性与鲁棒性,适用于多种模型与数据集,为实际应用场景中的手势识别与动作识别提供可扩展解决方案。代码已开源。
原文摘要 · Abstract (English)
Data augmentation is a crucial technique in deep learning, particularly for tasks with limited dataset diversity, such as skeleton-based datasets. This paper proposes a comprehensive data augmentation framework that integrates geometric transformations, random cropping, rotation, zooming and intensity-based transformations, brightness and contrast adjustments to simulate real-world variations. Random cropping ensures the preservation of spatio-temporal integrity while addressing challenges such as viewpoint bias and occlusions. The augmentation pipeline generates three augmented versions for each sample in addition to the data set sample, thus quadrupling the data set size and enriching the diversity of gesture representations. The proposed augmentation strategy is evaluated on three models: multi-stream e2eET, FPPR point cloud-based hand gesture recognition (HGR), and DD-Network. Experiments are conducted on benchmark datasets including DHG14/28, SHREC'17, and JHMDB. The e2eET model, recognized as the state-of-the-art for hand gesture recognition on DHG14/28 and SHREC'17. The FPPR-PCD model, the second-best performing model on SHREC'17, excels in point cloud-based gesture recognition. DD-Net, a lightweight and efficient architecture for skeleton-based action recognition, is evaluated on SHREC'17 and the Human Motion Data Base (JHMDB). The results underline the effectiveness and versatility of the proposed augmentation strategy, significantly improving model generalization and robustness across diverse datasets and architectures. This framework not only establishes state-of-the-art results on all three evaluated models but also offers a scalable solution to advance HGR and action recognition applications in real-world scenarios. The framework is available at https://github.com/NadaAbodeshish/Random-Cropping-augmentation-HGR
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。