用双曲空间融合脑图与文献,提升小样本神经影像元分析精度
MNM : Multi-level Neuroimaging Meta-analysis with Hyperbolic Brain-Text Representations
- 基于双曲几何建模脑图与文本的层级关系
- 在2个公开数据集上显著优于传统方法
- 适合神经科学与跨模态表征研究者
多种神经影像研究受限于小样本问题,影响结果可靠性。元分析通过整合多篇研究发现一致的脑区活动模式以缓解此问题。然而,传统基于关键词检索或线性映射的方法常忽略脑结构的丰富层级特性。本文提出一种新框架,利用双曲几何将神经科学文献与脑激活图关联起来。通过洛伦兹模型,将研究论文文本与对应脑图像嵌入共享双曲空间,同时捕捉语义相似性与层级组织。该方法在双曲空间中实现多层级神经影像元分析(MNM),包括:1)对齐脑图与文本嵌入以实现语义对应;2)引导文本与脑激活间的层级关系;3)保持脑激活模式内部的层级结构。实验表明,本模型在两个公开数据集上均超越基线方法,提供一种鲁棒且可解释的多层级神经影像元分析范式。
原文摘要 · Abstract (English)
Various neuroimaging studies suffer from small sample size problem which often limit their reliability. Meta-analysis addresses this challenge by aggregating findings from different studies to identify consistent patterns of brain activity. However, traditional approaches based on keyword retrieval or linear mappings often overlook the rich hierarchical structure in the brain. In this work, we propose a novel framework that leverages hyperbolic geometry to bridge the gap between neuroscience literature and brain activation maps. By embedding text from research articles and corresponding brain images into a shared hyperbolic space via the Lorentz model, our method captures both semantic similarity and hierarchical organization inherent in neuroimaging data. In the hyperbolic space, our method performs multi-level neuroimaging meta-analysis (MNM) by 1) aligning brain and text embeddings for semantic correspondence, 2) guiding hierarchy between text and brain activations, and 3) preserving the hierarchical relationships within brain activation patterns. Experimental results demonstrate that our model outperforms baselines, offering a robust and interpretable paradigm of multi-level neuroimaging meta-analysis via hyperbolic brain-text representation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。