用物理启发的结构提升脑电模型对睡眠状态的可解释性
The RG-Flow Transformer: Encoding Scale-Free Dynamics in Scarce EEG

- 引入重整化群思想,让模型显式建模脑电信号的尺度不变特性
- 在数据稀缺时仍能准确恢复脑电谱指数β,而普通模型无法做到
- 适合关注脑状态动态机制与模型可解释性的神经科学与医学研究者
脑场电位具有无尺度特性:其功率谱遵循$1/f^β$规律,其中非周期性指数$β$反映皮层状态,尤其与睡眠深度相关。本文提出一种带有显式重整化群归纳偏置的Transformer——RG-Flow Transformer,将标准自注意力与一个具备可学习反常维度$γ$、块自旋粗粒化和熵门同步桥的尺度感知流耦合。在严格按受试者隔离的PhysioNet Sleep-EDF数据集上,我们(i)在5类AASM睡眠分期任务中对比了RG-Flow与参数匹配的普通Transformer及仅保留层次结构的消融模型;(ii)扫描每受试者的数据量以检验数据稀缺时归纳偏置的优势;(iii)测试模型学习的$γ$是否能外样本追踪实测的谱指数$β$。在5名受试者、5次随机种子下,采用留一受试者交叉验证,RG-Flow与普通Transformer在5类分期准确率上无显著差异(77.3% vs 77.0%;配对p=0.294),且未观察到预测的数据稀缺优势拐点:普通模型在所有数据受限条件下均表现更优。但关键区别在于可解释性:RG-Flow在外样本成功恢复连续谱指数(β-恢复R²=0.416),这是普通架构不具备的能力。
原文摘要 · Abstract (English)
Brain field potentials are scale-free: their power spectra follow a $1/f^β$ law whose aperiodic exponent $β$ tracks cortical state, and sleep depth in particular is a shift in $β$. We ask whether a transformer endowed with an explicit renormalization-group (RG) inductive bias the RG-Flow Transformer, which couples ordinary self-attention to a scale-aware stream with a learnable anomalous dimension $γ$, block-spin coarse-graining, and an entropy-gated synchronization bridge has an advantage over a parameter-matched vanilla transformer on \emph{real, scarce} EEG. Using the PhysioNet Sleep-EDF corpus with a strict leakage-free by-subject hold-out, we (i) benchmark RG-Flow against a param-matched vanilla transformer and a hierarchy-only ablation on 5-class AASM sleep staging, (ii) sweep the per-subject data budget to look for the inductive-bias crossover predicted when data are scarce, and (iii) test whether RG-Flow's learned $γ$ tracks the measured spectral exponent $β$ out-of-sample a quantity the vanilla model does not possess. Across $5$ subjects and $5$ seeds under leave-one-subject-out cross-validation, RG-Flow and the vanilla transformer are statistically indistinguishable on 5-class staging (77.3\% vs 77.0\% accuracy; paired $p=0.294$), and the predicted scarce-data crossover does not appear: vanilla is numerically ahead at every data-limited budget. What does separate the models is interpretability RG-Flow recovers the continuous spectral exponent out-of-sample ($β$-recovery $R^2 = 0.416$), a capability the vanilla architecture has no analogue for.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。