用联邦学习实现工业场景下隐私保护的动作识别,效果优于集中式训练。
Federated Action Recognition for Smart Worker Assistance Using FastPose
- 基于修改的FastPose和联邦学习框架,实现跨用户动作识别。
- 联邦集成学习在新客户端上比集中训练高58.3个百分点。
- 适合注重隐私与泛化能力的智能制造安全监控场景。
在智能制造环境中,准确实时地识别工人动作对生产效率、安全及人机协作至关重要。基于骨骼的人体动作识别(HAR)对光照、视角和背景变化具有鲁棒性,但现有方法多依赖集中式数据集,在敏感工业场景中不切实际。本文提出一种基于定制骨骼数据集的联邦学习(FL)框架,该数据集包含八种工业相关上肢动作,由五名参与者采集并使用改进的FastPose模型处理。在四种范式(集中式、本地、加权平均联邦学习、联邦集成学习)下训练并评估了LSTM和Transformer两种时序骨干网络。在全局测试集上,联邦学习Transformer相比集中训练提升12.4个百分点,联邦集成学习更达+16.3个百分点。在未见过的外部客户端上,联邦学习和联邦集成学习分别超过集中训练52.6和58.3个百分点。结果表明,联邦学习不仅保护隐私,还显著提升跨用户泛化能力,是异构工业环境下可扩展、隐私友好的动作识别实用方案。
原文摘要 · Abstract (English)
In smart manufacturing environments, accurate and real-time recognition of worker actions is essential for productivity, safety, and human-machine collaboration. While skeleton-based human activity recognition (HAR) offers robustness to lighting, viewpoint, and background variations, most existing approaches rely on centralized datasets, which are impractical in privacy-sensitive industrial scenarios. This paper presents a federated learning (FL) framework for pose-based HAR using a custom skeletal dataset of eight industrially relevant upper-body gestures, captured from five participants and processed using a modified FastPose model. Two temporal backbones, an LSTM and a Transformer encoder, are trained and evaluated under four paradigms: centralized, local (per-client), FL with weighted federated averaging (FedAvg), and federated ensemble learning (FedEnsemble). On the global test set, the FL Transformer improves over centralized training by +12.4 percentage points, with FedEnsemble delivering a +16.3 percentage points gain. On an unseen external client, FL and FedEnsemble exceed centralized accuracy by +52.6 and +58.3 percentage points, respectively. These results demonstrate that FL not only preserves privacy but also substantially enhances cross-user generalization, establishing it as a practical solution for scalable, privacy-aware HAR in heterogeneous industrial settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。