无需校准,实时检测手指弯曲动作,提升假肢控制精度。
SonoRank: Towards Calibration-Free Real-Time Finger Flexion Detection from Forearm Ultrasound Sequences

- 通过对比超声序列运动幅度进行配对排序,学习肌肉活动特征。
- 在12人数据集上,F1分数相比基线提升28%。
- 适合开发免校准的智能假肢系统,尤其关注实用性部署。
功能受限的假肢手常被用户放弃,主要因为当前设备依赖表面肌电(sEMG)且控制自由度有限。超声肌电图(Sonomyography)因其可实时观察肌肉活动并控制更多自由度而成为有前景的替代方案。然而,现有方法需针对每位用户单独调校,阻碍商业化进程。本文提出 SonoRank,迈向从前臂超声视频实现免校准手指屈曲检测的重要一步。SonoRank 首先学习对每根手指的两段超声序列按运动幅度大小进行排序;随后利用操作开始时采集的静息参考信号,微调模型以判断各指是否主动屈曲。在包含12名受试者的同步运动学数据集上,采用12折留一被试交叉验证,相较于跳过排序阶段的直接分类基线,SonoRank 的 F1 分数提升28%。结果表明,成对排序是一种有效的无监督预训练信号,推动超声假肢向实际、免校准部署更进一步。
原文摘要 · Abstract (English)
Powered prosthetic hands are frequently abandoned, largely due to the limited functionality of current devices that rely on surface electromyography (sEMG). Sonomyography (ultrasound) has emerged as a promising alternative, owing to its ability to observe muscle activity in real time and control a greater number of degrees of freedom. Yet, existing ultrasound-based methods require per-user fine-tuning, limiting their commercialization. We propose SonoRank, an important step towards calibration-free finger flexion detection from forearm ultrasound video. SonoRank first learns to rank pairs of ultrasound sequences by their relative motion magnitude for each of the five fingers. The learned representations are then fine-tuned to classify whether each finger is actively flexing, using a rest reference that is captured at the beginning of the operation. Under 12-fold leave-one-subject-out cross-validation on a dataset of twelve subjects with synchronized kinematics, SonoRank achieves a 28% improvement in F1 score over direct classification baselines that skip the ranking stage. These results establish pairwise ranking as an effective pretraining signal for subject-independent control, bringing ultrasound-based prosthetics closer to practical, calibration-free deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。