用动作识别让机器人远程协助老人日常活动,操作更自然。
Leveraging GCN-based Action Recognition for Teleoperation in Daily Activity Assistance
- 通过简化时空图卷积网络识别动作,匹配预设机器人轨迹
- 实验显示操作者无需同步动作,机器人执行准确率高
- 适合居家养老辅助、远程照护系统开发人员参考
老年人照护是全球性挑战,许多老人倾向于居家养老,但家庭支持难以覆盖广域地区。远程操控机器人可提供解决方案,但传统运动映射方式使操作者动作不自然,易疲劳且可用性差。本文提出一种基于动作识别的新型远程操控框架,采用简化的时空图卷积网络(S-ST-GCN)识别人体动作,并执行对应预设机器人轨迹,无需直接运动同步。引入有限状态机(FSM)过滤误判动作,提升可靠性。实验表明,该框架使操作者动作轻松,机器人执行准确。本概念验证研究展示了动作识别驱动的远程操控在老人日常生活活动(ADLs)支持中的潜力。未来工作将优化S-ST-GCN识别精度与泛化能力,融合先进运动规划以增强机器人自主性,并开展用户研究评估系统的远程沉浸感与控制便捷性。
原文摘要 · Abstract (English)
Caregiving of older adults is an urgent global challenge, with many older adults preferring to age in place rather than enter residential care. However, providing adequate home-based assistance remains difficult, particularly in geographically vast regions. Teleoperated robots offer a promising solution, but conventional motion-mapping teleoperation imposes unnatural movement constraints on operators, leading to muscle fatigue and reduced usability. This paper presents a novel teleoperation framework that leverages action recognition to enable intuitive remote robot control. Using our simplified Spatio-Temporal Graph Convolutional Network (S-ST-GCN), the system recognizes human actions and executes corresponding preset robot trajectories, eliminating the need for direct motion synchronization. A finite-state machine (FSM) is integrated to enhance reliability by filtering out misclassified actions. Our experiments demonstrate that the proposed framework enables effortless operator movement while ensuring accurate robot execution. This proof-of-concept study highlights the potential of teleoperation with action recognition for enabling caregivers to remotely assist older adults during activities of daily living (ADLs). Future work will focus on improving the S-ST-GCN's recognition accuracy and generalization, integrating advanced motion planning techniques to further enhance robotic autonomy in older adult care, and conducting a user study to evaluate the system's telepresence and ease of control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。