对fNIRS分类中激活函数的性能进行系统评估,发现对称型函数更优。
Toward Improving fNIRS Classification: A Study on Activation Functions in Deep Neural Architectures
- 对比多种激活函数在fNIRS网络中的表现,聚焦对称性影响。
- Tanh和Abs(x)在多个架构上优于ReLU,最高提升达12.3%。
- 适合脑信号处理、深度学习初学者及神经工程研究者参考。
激活函数对深度神经网络性能至关重要,尤其在功能近红外光谱(fNIRS)领域,非线性、信噪比低及信号波动带来建模挑战。然而,激活函数对fNIRS深度学习性能的影响尚未得到系统研究。本研究在单一听觉任务数据集上,评估了多种传统与领域特定激活函数在fNIRSNet、AbsoluteNet、MDNN和shallowConvNet(基线)等模型中的表现。所有模型采用标准化预处理和一致训练参数以确保公平比较。结果表明,对称型激活函数如Tanh和绝对值函数Abs(x)在不同架构中可优于常用ReLU函数。进一步通过改进的绝对函数MAF分析对称性作用,结果支持对称激活函数带来的性能提升。研究强调选择与fNIRS信号特性匹配的激活函数的重要性。
原文摘要 · Abstract (English)
Activation functions are critical to the performance of deep neural networks, particularly in domains such as functional near-infrared spectroscopy (fNIRS), where nonlinearity, low signal-to-noise ratio (SNR), and signal variability poses significant challenges to model accuracy. However, the impact of activation functions on deep learning (DL) performance in the fNIRS domain remains underexplored and lacks systematic investigation in the current literature. This study evaluates a range of conventional and field-specific activation functions for fNIRS classification tasks using multiple deep learning architectures, including the domain-specific fNIRSNet, AbsoluteNet, MDNN, and shallowConvNet (as the baseline), all tested on a single dataset recorded during an auditory task. To ensure fair a comparison, all networks were trained and tested using standardized preprocessing and consistent training parameters. The results show that symmetrical activation functions such as Tanh and the Absolute value function Abs(x) can outperform commonly used functions like the Rectified Linear Unit (ReLU), depending on the architecture. Additionally, a focused analysis of the role of symmetry was conducted using a Modified Absolute Function (MAF), with results further supporting the effectiveness of symmetrical activation functions on performance gains. These findings underscore the importance of selecting proper activation functions that align with the signal characteristics of fNIRS data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。