arXiv:2504.03681eess.SPcs.LG2025-04被引 1

直接用原始fNIRS信号实时评估双手操作技能,准确率达94%

End-to-End Deep Learning for Real-Time Neuroimaging-Based Assessment of Bimanual Motor Skills

  • 端到端深度学习直接处理原始fNIRS信号,省去复杂预处理
  • 在三个手术任务中平均分类准确率93.9%,跨被试验证达94.1%
  • 对神经血管耦合饱和有鲁棒性,适合长时间训练评估

实时评估复杂运动技能在手术培训与康复领域面临挑战。近年来,功能近红外光谱(fNIRS)技术可高精度客观评估此类技能,但受限于提取神经生物标志物所需的繁复预处理。本研究提出一种新型端到端深度学习框架,直接处理原始fNIRS信号,无需中间预处理步骤。模型在三个不同双侧手操作任务——缝合、图案切割和气管插管(ETI)——的数据集上进行评估,使用训练集和保留集的性能指标。在未见过的技能保留数据集上,平均分类准确率为93.9%(标准差4.4),泛化准确率为92.6%(标准差1.9),留一被试交叉验证准确率达94.1%(标准差3.6)。对侧前额叶皮层激活具有任务特异性判别力,而运动皮层激活始终有助于准确分类。模型还表现出对抗长时间任务导致神经血管耦合饱和的鲁棒性,在各试验中保持稳定性能。对比分析表明,该端到端模型表现与优化后的全处理数据基线模型相当或更优,预测准确率统计上无显著差异(p<0.05)或更高。通过消除复杂信号预处理需求,本工作为医疗培训环境中的实时、非侵入式双侧手技能评估提供了基础,潜在应用于机器人、康复及体育领域。

原文摘要 · Abstract (English)

The real-time assessment of complex motor skills presents a challenge in fields such as surgical training and rehabilitation. Recent advancements in neuroimaging, particularly functional near-infrared spectroscopy (fNIRS), have enabled objective assessment of such skills with high accuracy. However, these techniques are hindered by extensive preprocessing requirements to extract neural biomarkers. This study presents a novel end-to-end deep learning framework that processes raw fNIRS signals directly, eliminating the need for intermediate preprocessing steps. The model was evaluated on datasets from three distinct bimanual motor tasks--suturing, pattern cutting, and endotracheal intubation (ETI)--using performance metrics derived from both training and retention datasets. It achieved a mean classification accuracy of 93.9% (SD 4.4) and a generalization accuracy of 92.6% (SD 1.9) on unseen skill retention datasets, with a leave-one-subject-out cross-validation yielding an accuracy of 94.1% (SD 3.6). Contralateral prefrontal cortex activations exhibited task-specific discriminative power, while motor cortex activations consistently contributed to accurate classification. The model also demonstrated resilience to neurovascular coupling saturation caused by extended task sessions, maintaining robust performance across trials. Comparative analysis confirms that the end-to-end model performs on par with or surpasses baseline models optimized for fully processed fNIRS data, with statistically similar (p<0.05) or improved prediction accuracies. By eliminating the need for extensive signal preprocessing, this work provides a foundation for real-time, non-invasive assessment of bimanual motor skills in medical training environments, with potential applications in robotics, rehabilitation, and sports.

fNIRS技能评估端到端实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。