提出统一框架比较脑电几何嵌入,揭示其对训练稳定性和分类精度的影响。
A Unified SPD Token Transformer Framework for EEG Classification: Systematic Comparison of Geometric Embeddings
- 构建统一Transformer框架,系统对比三种脑电几何嵌入方法
- Log-Euclidean嵌入在36名受试者上达最优,56通道ERP数据提升26%准确率
- 理论证明BWSPD保持流形距离,适合高维脑电信号处理
脑电信号的空间协方差矩阵为对称正定(SPD)且位于黎曼流形上,但嵌入几何与优化动态之间的理论关联尚未明确。本文首次形式化分析嵌入选择对SPD流形梯度条件和数值稳定性的影响,得出三个理论结论:(1) 在高维输入(d ≥ 22)下,BWSPD的√κ梯度条件优于Log-Euclidean的κ,该优势随维度降低(d ≤ 8)而减弱,因特征分解开销占主导;(2) 嵌入空间批归一化(BN-Embed)近似黎曼归一化,误差为O(ε²),在56通道ERP数据上提升+26%准确率,而在8通道SSVEP数据上效果不显著,符合通道数依赖预测;(3) 双李普希茨边界证明BWSPD令牌仅由条件比κ决定距离失真。通过统一Transformer框架,在三种脑电范式(运动想象、事件相关电位、稳态视觉诱发电位)及36名受试者上完成1500+次实验验证,结果表明:基于Log-Euclidean的Transformer在所有数据集上达到当前最优性能,显著超越传统黎曼分类器与近期SPD基线,而BWSPD在相近训练时间下表现相当。
原文摘要 · Abstract (English)
Spatial covariance matrices of EEG signals are Symmetric Positive Definite (SPD) and lie on a Riemannian manifold, yet the theoretical connection between embedding geometry and optimization dynamics remains unexplored. We provide a formal analysis linking embedding choice to gradient conditioning and numerical stability for SPD manifolds, establishing three theoretical results: (1) BWSPD's $\sqrtκ$ gradient conditioning (vs $κ$ for Log-Euclidean) via Daleckii-Kre\uın matrices provides better gradient conditioning on high-dimensional inputs ($d \geq 22$), with this advantage reducing on low-dimensional inputs ($d \leq 8$) where eigendecomposition overhead dominates; (2) Embedding-Space Batch Normalization (BN-Embed) approximates Riemannian normalization up to $O(\varepsilon^2)$ error, yielding $+26\%$ accuracy on 56-channel ERP data but negligible effect on 8-channel SSVEP data, matching the channel-count-dependent prediction; (3) bi-Lipschitz bounds prove BWSPD tokens preserve manifold distances with distortion governed solely by the condition ratio $κ$. We validate these predictions via a unified Transformer framework comparing BWSPD, Log-Euclidean, and Euclidean embeddings within identical architecture across 1,500+ runs on three EEG paradigms (motor imagery, ERP, SSVEP; 36 subjects). Our Log-Euclidean Transformer achieves state-of-the-art performance on all datasets, substantially outperforming classical Riemannian classifiers and recent SPD baselines, while BWSPD offers competitive accuracy with similar training time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。