arXiv:2605.13133cs.LGeess.SP2026-05被引 1

用动态拓扑对齐脑电与语义,融合医学知识提升解码性能

KAST-BAR: Knowledge-Anchored Semantically-Dynamic Topology Brain Autoregressive Modeling for Universal Neural Interpretation

论文配图:KAST-BAR: Knowledge-Anchored Semantically-Dynamic Topology Brain Autoregressive Modeling for Universal Neural Interpretation
图 1 · 摘自论文原文
  • 构建双流分层注意力模型,捕捉脑区非欧几里得时空拓扑
  • 通过专家语义锚点生成文本表征,驱动脑电信号动态重构
  • 在21个数据集预训练,6项任务均表现更优,适合临床神经解码

尽管脑电(EEG)基础模型在跨任务通用神经解码中展现出巨大潜力,但其发展仍受限于复杂时空拓扑建模不足,以及低层次生理信号与高层次语义之间的固有模态鸿沟。为此,我们提出知识锚定的语义动态拓扑脑自回归模型(KAST-BAR),可动态对齐多层级脑拓扑产生的生理表征与专家级语义空间。具体而言,设计双流分层注意力(DSHA)编码器,通过建模局部时序动态与全局空间上下文,精确捕捉大脑内在的非欧几里得拓扑结构。在此基础上,提出知识锚定语义剖析器(KASP),生成具物理依据和实例级别的文本描述,并由语义文本感知重构器(STAR)利用潜在专家查询动态重构脑电信号。通过在21个多样化数据集上进行大规模预训练,构建基础模型,KAST-BAR有效将专家级医学知识融入脑电信号表示,在六项下游任务中持续取得优异表现。

原文摘要 · Abstract (English)

While EEG foundation models have shown significant potential in universal neural decoding across tasks, their advancement remains constrained by the inadequacy modeling of complex spatiotemporal topology, as well as the inherent modality gap between low-level physiological signals and high-level textual semantics. To address these challenges, we propose a Knowledge-Anchored Semantically-Dynamic Topology Brain Autoregressive Model (KAST-BAR), which dynamically aligns physiological representations derived from multi-level brain topology with an expert-level semantic space. Specifically, we design a Dual-Stream Hierarchical Attention (DSHA) encoder that accurately captures the brain's intrinsic non-Euclidean topology by modeling local temporal dynamics with global spatial contexts. On this basis, a Knowledge-Anchored Semantic Profiler (KASP) is proposed to synthesize physically-grounded and instance-level textual profiles, which subsequently drive a Semantic Text-Aware Refiner (STAR) to dynamically reconstruct EEG representations using Latent Expert Queries. By conducting large-scale pre-training on 21 diverse datasets to build a foundation model, KAST-BAR effectively integrates expert-level medical knowledge into EEG signal representations, consistently achieving superior performance across six downstream tasks. Our code is available at https://github.com/KAST-BAR/KAST-BAR

脑电解码知识融合动态拓扑自回归建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。