用傅里叶基引导扩散模型,提升4D医学影像时间插值精度。
FB-Diff: Fourier Basis-guided Diffusion for Temporal Interpolation of 4D Medical Imaging
- 从频率角度建模呼吸运动,引入生理先验提取傅里叶基。
- 在起始与终止帧条件下,生成中间帧时保持良好时间一致性。
- 适合需要高精度呼吸运动模拟的临床影像分析场景。
4D医学影像的时间插值在呼吸运动建模的临床应用中至关重要。现有方法多基于简化线性运动假设,采用光流模型进行中间帧插值,但真实呼吸运动具有非线性和准周期性特征,且具有特定频率。受此启发,本文从频率视角出发,提出一种傅里叶基引导的扩散模型(FB-Diff)。由于呼吸运动具有规律性,引入生理运动先验以描述时间数据分布的一般特性;并设计傅里叶运动算子,在变分自编码器的特征空间中融合生理先验与个体特异性频谱信息,提取傅里叶基。经充分训练的傅里叶基可更准确地模拟具有特定频率的呼吸运动模式。在给定起始与终止帧条件下,扩散模型通过基交互算子利用已学习的傅里叶基,以生成方式完成时间插值。大量实验表明,FB-Diff在感知质量上达到当前最优(SOTA),同时保持良好的时间一致性与重建指标。代码已公开。
原文摘要 · Abstract (English)
The temporal interpolation task for 4D medical imaging, plays a crucial role in clinical practice of respiratory motion modeling. Following the simplified linear-motion hypothesis, existing approaches adopt optical flow-based models to interpolate intermediate frames. However, realistic respiratory motions should be nonlinear and quasi-periodic with specific frequencies. Intuited by this property, we resolve the temporal interpolation task from the frequency perspective, and propose a Fourier basis-guided Diffusion model, termed FB-Diff. Specifically, due to the regular motion discipline of respiration, physiological motion priors are introduced to describe general characteristics of temporal data distributions. Then a Fourier motion operator is elaborately devised to extract Fourier bases by incorporating physiological motion priors and case-specific spectral information in the feature space of Variational Autoencoder. Well-learned Fourier bases can better simulate respiratory motions with motion patterns of specific frequencies. Conditioned on starting and ending frames, the diffusion model further leverages well-learned Fourier bases via the basis interaction operator, which promotes the temporal interpolation task in a generative manner. Extensive results demonstrate that FB-Diff achieves state-of-the-art (SOTA) perceptual performance with better temporal consistency while maintaining promising reconstruction metrics. Codes are available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。