用流匹配统一解决细结构分割与生成,提升连续性与跨域泛化。
FMS$^2$: Unified Flow Matching for Segmentation and Synthesis of Thin Structures
- 将分割建模为图像到掩码的连续传输,通过轨迹监督增强细结构连通性。
- 在5个基准上分割性能提升17.2%(IoU达0.599),拓扑误差降低37.3%。
- 生成带可控结构变化的像素对齐数据,适合小样本与跨域场景。
细结构(如裂缝、血管)分割受拓扑敏感几何、高标注成本和跨域泛化差等问题困扰。现有方法孤立应对这些问题。本文提出FMS²,一个包含两个模块的流匹配框架:(1) SegFlow 是一个296万参数的分割模型,基于标准编码器-解码器结构,将预测重构为图像→掩码的连续传输过程。它通过流匹配回归损失学习时间索引速度场,并通过常微分方程积分输出掩码,而非仅监督终态逻辑值。该轨迹级监督提升了细结构连续性与锐度,相比调优后的拓扑感知基线,无需辅助拓扑头、后处理或多目标损失设计。 (2) SynFlow 是一个掩码条件生成器,可生成像素对齐的合成图像-掩码对。它在多尺度注入掩码几何信息,并通过边缘感知门控强调边界区域;同时可控掩码生成器扩展了稀疏性、宽度与分支范围。在五个裂缝与血管基准测试中,SegFlow单独使用即超越强基线(CNN、Transformer、Mamba、生成模型),体积度量(平均IoU)从0.511提升至0.599(+17.2%),拓扑度量(贝蒂匹配误差)从82.145降至51.524(-37.3%)。在有限标注下,结合SynFlow生成对进行训练,仅需25%真实标注即可恢复接近全量性能,且跨域平均IoU提升0.11。与传统数据增强不同,SynFlow提供带有可控结构偏移(如稀疏性、宽度、分支)的像素对齐配对监督,在领域偏移下尤为有效。
原文摘要 · Abstract (English)
Segmenting thin structures like infrastructure cracks and anatomical vessels is a task hampered by topology-sensitive geometry, high annotation costs, and poor generalization across domains. Existing methods address these challenges in isolation. We propose FMS$^2$, a flow-matching framework with two modules. (1) SegFlow is a 2.96M-parameter segmentation model built on a standard encoder-decoder backbone that recasts prediction as continuous image $\rightarrow$ mask transport. It learns a time-indexed velocity field with a flow-matching regression loss and outputs the mask via ODE integration, rather than supervising only end-state logits. This trajectory-level supervision improves thin-structure continuity and sharpness, compared with tuned topology-aware loss baselines, without auxiliary topology heads, post-processing, or multi-term loss engineering. (2) SynFlow is a mask-conditioned mask $\rightarrow$ image generator that produces pixel-aligned synthetic image-mask pairs. It injects mask geometry at multiple scales and emphasizes boundary bands via edge-aware gating, while a controllable mask generator expands sparsity, width, and branching regimes. On five crack and vessel benchmarks, SegFlow alone outperforms strong CNN, Transformer, Mamba, and generative baselines, improving the volumetric metric (mean IoU) from 0.511 to 0.599 (+17.2%) and reducing the topological metric (Betti matching error) from 82.145 to 51.524 (-37.3%). When training with limited labels, augmenting SegFlow with SynFlow-generated pairs recovers near-full performance using 25% of real annotations and improves cross-domain IoU by 0.11 on average. Unlike classical data augmentation that promotes invariance via label-preserving transforms, SynFlow provides pixel-aligned paired supervision with controllable structural shifts (e.g., sparsity, width, branching), which is particularly effective under domain shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。