arXiv:2608.15452cs.CV2026-08

让图像生成的噪声分布具备空间结构,提升局部编辑与结构保持能力

Spatially-Grounded Flow Matching: Structured Source Distributions for Image Generation

论文配图:Spatially-Grounded Flow Matching: Structured Source Distributions for Image Generation
图 1 · 摘自论文原文
  • 用共享噪声成分让局部像素具有一致噪声,构建有空间结构的源分布
  • 实现更精细的局部编辑、边界保持和语义平滑插值,优于传统方法
  • 可轻量融入大模型,适用于图文生成、分类条件等多场景

当前流匹配模型从独立同分布的高斯噪声映射到自然图像分布,但该噪声无空间结构。而图像本质是局部相关的,相邻像素强关联。独立采样噪声使模型训练时倾向于利用较干净邻域作为上下文,间接绕过学习真实局部结构,违背图像领域的归纳偏置。为此,我们提出 StructFlow,通过在小区域内共享同一噪声成分,将空间局部性直接编码进源分布。该结构化源分布生成的传输路径与图像区域几何对齐,带来通用流匹配难以实现的特性:细粒度局部编辑自然尊重边界、结构鲁棒保持、图像间平滑语义插值。实验表明这些优势也适用于大型预训练模型,甚至可通过轻量后训练阶段集成。在多个数据集上,覆盖无条件、类别及文本条件设置,使用不同扩散变换器架构,验证了 StructFlow 在图像生成质量上具有竞争力,并显著提升局部可控重合成性能。

原文摘要 · Abstract (English)

Current flow matching models learn to transport the source i.i.d. Gaussian noise into the target distribution of natural images, yet this source distribution carries no notion of spatial structure. Images however are fundamentally local since nearby pixels are strongly correlated. By sampling the noise independently, we hypothesize that models are implicitly encouraged to exploit less noisy neighbors as context during training, partially bypassing the need to properly learn the true local structure of images. The source distribution, in other words, works against the inductive bias of the image domain. To ameliorate this design discrepancy, we propose StructFlow which encodes spatial locality directly into the source by having the pixels within a small region share a common noise component. This structured source produces transport paths that are geometrically aligned with image regions - enabling properties that generic flow matching struggles to provide: fine-grained local editing that naturally respects boundaries, robust structure preservation, and smooth semantic interpolation between images. We show that these benefits also extend to large pre-trained models, demonstrating that StructFlow can even be incorporated through a lightweight post-training phase. Comprehensive experiments on multiple datasets, in unconditional, class and text-conditioned regimes, using different diffusion transformer architectures confirm that StructFlow not only offers competitive image generation quality, but also significantly improves localized controllable re-synthesis.

图像生成流匹配空间结构局部编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。