用原始脑信号跨任务评估操作技能,准确率超88%。
An Interpretable Transformer-Based Foundation Model for Cross-Procedural Skill Assessment Using Raw fNIRS Signals
- 基于自监督预训练的Transformer模型,直接处理原始fNIRS信号。
- 在新任务上仅需30样本即可达到AUC>87%,ETI任务准确率>88%。
- 通过通道注意力机制实现可解释性,识别关键脑区与认知状态变化。
高风险操作环境中对客观技能的评估需要能解码认知与运动过程且跨任务、跨个体、跨情境泛化的模型。尽管功能性近红外光谱(fNIRS)已展现评估认知-运动表现的潜力,现有方法多依赖特定任务、繁复预处理,且对新流程缺乏鲁棒性。本文提出一种可解释的Transformer基础模型,基于最小预处理的fNIRS信号进行跨程序技能评估。该模型在腹腔镜手术与气管插管(ETI)数据上通过自监督学习预训练,在所有任务中分类准确率超过88%,在ETI任务上马修斯相关系数超过0.91。在新应急气道操作——环甲膜穿刺中,仅用不到30个标注样本和轻量级适配器(参数少于2000),即实现AUC大于87%。通过专为fNIRS设计的新通道注意力机制实现可解释性,识别出功能一致的前额叶子网络,并经消融实验验证。时间注意力模式与任务关键阶段吻合,捕捉压力引起的神经变异性变化,揭示动态认知状态。
原文摘要 · Abstract (English)
Objective skill assessment in high-stakes procedural environments requires models that not only decode underlying cognitive and motor processes but also generalize across tasks, individuals, and experimental contexts. While prior work has demonstrated the potential of functional near-infrared spectroscopy (fNIRS) for evaluating cognitive-motor performance, existing approaches are often task-specific, rely on extensive preprocessing, and lack robustness to new procedures or conditions. Here, we introduce an interpretable transformer-based foundation model trained on minimally processed fNIRS signals for cross-procedural skill assessment. Pretrained using self-supervised learning on data from laparoscopic surgical tasks and endotracheal intubation (ETI), the model achieves greater than 88% classification accuracy on all tasks, with Matthews Correlation Coefficient exceeding 0.91 on ETI. It generalizes to a novel emergency airway procedure--cricothyrotomy--using fewer than 30 labeled samples and a lightweight (less than 2k parameter) adapter module, attaining an AUC greater than 87%. Interpretability is achieved via a novel channel attention mechanism--developed specifically for fNIRS--that identifies functionally coherent prefrontal sub-networks validated through ablation studies. Temporal attention patterns align with task-critical phases and capture stress-induced changes in neural variability, offering insight into dynamic cognitive states.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。