arXiv:2606.27855cs.LGcs.AI2026-06

用神经元激活特征提前发现小样本肌电信号校准中的过拟合

Applicability of memorization indicators for early spotting of overfitting while recalibrating sEMG-decoders on low sample sizes

论文配图:Applicability of memorization indicators for early spotting of overfitting while recalibrating sEMG-decoders on low sample sizes
图 1 · 摘自论文原文
  • 通过分析ReLU激活率监测模型过拟合
  • 小样本下准确率下降时激活率出现显著变化
  • 适合小样本肌电解码器实时校准场景

针对表面肌电(sEMG)解码器在有限样本下的用户特异性校准,深度学习模型易因数据量不足而过拟合,导致性能反而劣于未校准模型。传统验证集和早停机制难以应用,因缺乏额外保留数据。本文研究一种基于深层网络中线性整流单元(ReLU)激活统计的新型记忆指标,仅需训练数据即可计算,无需额外验证集。在基准sEMG数据集上,先对多受试者预训练卷积神经网络,再在单个用户上用少量重复数据微调。监控微调过程中解码性能与最后一层隐藏层的激活行为。结果首次表明,测试准确率下降伴随激活率的可识别变化,证明激活基记忆指标是低样本sEMG校准中早期识别失败学习的有力工具。

原文摘要 · Abstract (English)

Deep learning models for surface electromyography (sEMG) can benefit substantially from subject-specific (re-)calibration, since no sufficiently large and diverse datasets are available to train fully generic decoders. However, for user acceptance, the number of repetitions that can realistically be collected during calibration is severely limited, which increases the risk of overfitting and, in extreme cases, can even degrade performance compared to the uncalibrated model. Classical overfitting indicators such as validation performance and regularization with early stopping are difficult to apply in this low-sample regime, as they require additional held-out data that is rarely available in practical calibration scenarios. In this work, we investigate a recently proposed class of memorization indicators based solely on the activation statistics of rectified linear units (ReLU) in deep neural networks, which can be computed directly from training data without any extra validation set. We conduct a transferlearning experiment on a benchmark sEMG dataset, where a convolutional neural network is first pre-trained on multiple subjects and subsequently fine-tuned on individual users using only a small number of repetitions. During calibration, we monitor both decoding performance and the activation behaviour of the last hidden layer. Our results provide first evidence that decreases in test accuracy during fine-tuning are ac companied by characteristic changes in activation rates, indicating that activation-based memorization indicators are a promising tool for early spotting of unsuccessful learning in low-sample sEMG calibration settings.

肌电解码过拟合检测小样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。