实时半监督分解运动微动作,精度速度双突破。
SSSUMO: Real-Time Semi-Supervised Submovement Decomposition
- 用合成数据+无标签人类数据迭代训练,降低标注依赖
- 在噪声环境下仍保持高精度,单秒输入耗时<1毫秒
- 适合人机交互、康复医疗等需实时动作分析的场景
本文提出SSSUMO,一种用于微动作分解的半监督深度学习方法,在准确性和速度上均达到当前最优。尽管微动作分析能揭示运动控制机制,但现有方法受限于标注数据难获取,普遍存在重建精度低、计算成本高和验证困难的问题。我们采用半监督学习框架,先以最小努力原则生成合成数据,再通过与无标签人类运动数据的迭代适应进行优化。所提出的全卷积架构结合可微重建,在合成数据和多样人体运动数据集上均显著优于现有方法,即使在高噪声条件下也表现稳健。模型可在实时运行(每秒输入耗时小于1毫秒),远超基于优化的方法。该性能推动了人机交互、康复医学及运动控制研究中的新应用。我们在转向、旋转、指认、物体移动、书写及鼠标游戏等多类任务中验证了模型有效性,尤其在传统方法失效的挑战性数据集上表现突出。训练与基准代码及预训练权重已公开于https://github.com/dolphin-in-a-coma/sssumo。
原文摘要 · Abstract (English)
This paper introduces a SSSUMO, semi-supervised deep learning approach for submovement decomposition that achieves state-of-the-art accuracy and speed. While submovement analysis offers valuable insights into motor control, existing methods struggle with reconstruction accuracy, computational cost, and validation, due to the difficulty of obtaining hand-labeled data. We address these challenges using a semi-supervised learning framework. This framework learns from synthetic data, initially generated from minimum-jerk principles and then iteratively refined through adaptation to unlabeled human movement data. Our fully convolutional architecture with differentiable reconstruction significantly surpasses existing methods on both synthetic and diverse human motion datasets, demonstrating robustness even in high-noise conditions. Crucially, the model operates in real-time (less than a millisecond per input second), a substantial improvement over optimization-based techniques. This enhanced performance facilitates new applications in human-computer interaction, rehabilitation medicine, and motor control studies. We demonstrate the model's effectiveness across diverse human-performed tasks such as steering, rotation, pointing, object moving, handwriting, and mouse-controlled gaming, showing notable improvements particularly on challenging datasets where traditional methods largely fail. Training and benchmarking source code, along with pre-trained model weights, are made publicly available at https://github.com/dolphin-in-a-coma/sssumo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。