用少量数据高效校准跨人脑视觉解码模型,提升个性化精度。
MindAdapter: Few-Shot Parameter-Efficient Residual Calibration of Cross-Subject Brain-to-Visual Decoding Models

- 冻结预训练主干,轻量残差适配器实现细粒度校准
- 仅需少量共享刺激即可显著提升重建与检索准确率
- 适合资源受限的个性化脑机接口应用
由于个体间差异导致系统性功能错位,跨被试脑-视觉解码仍是脑机接口的核心挑战。为此,我们提出MindAdapter,一种参数高效的少样本校准框架,用于预训练脑-视觉解码模型。该方法通过冻结预训练显式脑功能对齐主干(粗粒度)并引入轻量非线性残差适配器(细粒度),解耦全局跨被试对应关系与被试特异性残差修正,实现空间与语义层面的精细校准。为保持全局表征稳定性,设计拓扑锚定双流流形约束:少量共享刺激作为拓扑锚点,在体素级有监督下对齐;语义流则通过冻结的视觉-语言解码器在无配对脑数据上强制一致性。实验表明,仅用少量共享刺激,MindAdapter在自然场景数据集(NSD)上显著提升跨被试视觉重建与检索准确率,为个性化脑-视觉解码提供了高效实用的解决方案。
原文摘要 · Abstract (English)
Cross-subject brain-to-visual decoding remains a core challenge in brain-computer interfaces due to severe inter-individual variability that induces systematic subject-specific functional misalignment. To address this issue, we propose MindAdapter, a parameter-efficient few-shot calibration framework for pretrained brain-to-visual decoding models. MindAdapter adopts a decoupled linear-residual cascade alignment paradigm by freezing a pretrained explicit brain functional alignment backbone (coarse) and introducing a lightweight nonlinear residual adapter (fine), thereby disentangling global cross-subject correspondence from subject-specific residual corrections for fine-grained spatial and semantic calibration. To further preserve global representational stability, we design a topology-anchored dual-stream manifold constraint, where a small set of shared stimuli serves as topological pins with voxel-level paired supervision, while a semantic stream enforces consistency through a frozen vision-language decoder on unpaired brain data. Together, MindAdapter efficiently injects subject-specific corrections while maintaining the global representational geometry learned during pretraining. Experiments on the Natural Scenes Dataset (NSD) demonstrate that MindAdapter substantially improves cross-subject visual reconstruction and retrieval accuracy using only a few shared stimuli, offering a practical and data-efficient solution for personalized brain-to-visual decoding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。