用流匹配提升医学图像分割效率,无需迭代采样
MedFlowSeg: Flow Matching for Medical Image Segmentation with Frequency-Aware Attention

- 将分割任务建模为时变向量场的连续传输过程
- 在多模态数据上优于现有最优方法,边界更清晰
- 通过频域感知注意力融合结构先验,提升细节一致性
流匹配作为一种原则性框架,可学习连续时间传输映射,实现无需依赖随机扩散过程的高效常微分方程采样。尽管生成建模在医学图像分割中展现出捕捉不确定性与复杂解剖变异的潜力,但现有方法主要基于扩散模型,需迭代采样且计算开销大。本文提出MedFlowSeg,一种条件流匹配框架,将医学图像分割建模为将简单先验分布传输至目标分割分布的时变向量场学习过程。相比扩散方法,该框架通过求解常微分方程实现更高效的推理,同时保持生成建模的灵活性。为有效融入条件信息,我们引入双条件机制:提出双分支空间注意力模块注入多频结构先验,以及频域感知注意力模块,通过差异感知融合与时间依赖调制建模空间与谱表示间的交互。这些组件增强了噪声中间状态与干净语义特征间的对齐,显著提升结构一致性与边界划分能力。我们在多个医学影像模态上进行了广泛实验,结果表明MedFlowSeg在各项指标上持续优于现有最先进基线,包括基于扩散和流的方法。
原文摘要 · Abstract (English)
Flow matching has recently emerged as a principled framework for learning continuous-time transport maps, enabling efficient ODE-based sampling without relying on stochastic diffusion processes. While generative modeling has shown promise for medical image segmentation, particularly in capturing uncertainty and complex anatomical variability, existing approaches are predominantly based on diffusion models, which require iterative sampling and incur substantial computational overhead. In this work, we propose MedFlowSeg, a conditional flow matching framework that formulates medical image segmentation as learning a time-dependent vector field that transports a simple prior distribution to the target segmentation distribution. Compared to diffusion-based methods, our formulation enables more efficient inference through solving an ordinary differential equation, while preserving the flexibility of generative modeling. To effectively incorporate conditional information, we introduce a dual-conditioning mechanism. Specifically, we propose a Dual-Branch Spatial Attention (DB-SA) module to inject multi-frequency structural priors, and a Frequency-Aware Attention (FA-Attention) module to model interactions between spatial and spectral representations via discrepancy-aware fusion and time-dependent modulation. These components improve the alignment between noisy intermediate states and clean semantic features, leading to better structural consistency and boundary delineation. We conduct extensive experiments across multiple medical imaging modalities, where MedFlowSeg consistently outperforms prior state-of-the-art (SOTA) baselines, including diffusion-based and flow-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。