用时频图和去噪扩散模型生成更逼真的脑成像数据
T2I-Diff: fMRI Signal Generation via Time-Frequency Image Transform and Classifier-Free Denoising Diffusion Models
- 将脑信号转为时频谱图,捕捉动态变化特征
- 生成的fMRI数据在脑网络分类中准确率提升
- 适合需要高质量合成数据的研究者
功能磁共振成像(fMRI)通过测量血氧水平依赖(BOLD)信号的动态变化,实现对大脑活动的深入分析。然而,fMRI数据采集成本高,限制了高保真样本的获取。尽管现代生成模型可合成fMRI数据,但常因忽略BOLD信号的非平稳性和非线性动态而表现不佳。为此,我们提出T2I-Diff框架,利用BOLD信号的时频表示与无分类器去噪扩散模型。首先,通过时变傅里叶变换将BOLD信号转化为窗化谱图,以捕捉时序动态与频谱演化;随后,训练无分类器扩散模型生成类别条件频谱图,并通过逆傅里叶变换还原为BOLD信号。实验表明,该方法在下游脑网络分类任务中显著提升了准确率与泛化能力。
原文摘要 · Abstract (English)
Functional Magnetic Resonance Imaging (fMRI) is an advanced neuroimaging method that enables in-depth analysis of brain activity by measuring dynamic changes in the blood oxygenation level-dependent (BOLD) signals. However, the resource-intensive nature of fMRI data acquisition limits the availability of high-fidelity samples required for data-driven brain analysis models. While modern generative models can synthesize fMRI data, they often underperform because they overlook the complex non-stationarity and nonlinear BOLD dynamics. To address these challenges, we introduce T2I-Diff, an fMRI generation framework that leverages time-frequency representation of BOLD signals and classifier-free denoising diffusion. Specifically, our framework first converts BOLD signals into windowed spectrograms via a time-dependent Fourier transform, capturing both the underlying temporal dynamics and spectral evolution. Subsequently, a classifier-free diffusion model is trained to generate class-conditioned frequency spectrograms, which are then reverted to BOLD signals via inverse Fourier transforms. Finally, we validate the efficacy of our approach by demonstrating improved accuracy and generalization in downstream fMRI-based brain network classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。