用重整化群思想实现高效且全局一致的生成建模。
Renormalization Group Flow Matching for Scalable Local Generative Modeling

- 基于重整化群流构建跨尺度生成路径,从长波到短波逐步生成数据。
- 局部计算仅需约 $\ln L$ 大小的补丁,计算成本近似线性增长。
- 在图像和一维分布上均显著优于传统局部生成方法。
尽管生成模型在建模复杂数据方面取得显著成功,但仍面临根本性权衡:全局方法虽能保持整体结构一致性,但计算成本高;局部模型效率高,却难以再现长程相关性和全局连贯性。重整化群(RG)通过无缝连接不同尺度的空间结构,在每一步保留准局部描述的同时维持长程相关性。本文提出重整化群流匹配(RGFM),一种系统化跨尺度生成数据的框架。通过使用精确的RG流作为概率路径,RGFM从长波到短波逐步生成数据。为兼顾可扩展性与全局结构,利用了RG的两个关键性质:准局域性和尺度分离。严格证明了RGFM的概率流可由作用于 $O(Λ^{-1}[\ \ln L+\ln(1/\varepsilon)])$ 空间范围内的局部速度场准确逼近,其中 $Λ$ 为RG波数尺度,$L$ 为系统线性尺寸,$\varepsilon$ 为预设误差容限。该性质使得局部生成建模只需大小为 $O(\ln L)$ 的补丁,计算成本几乎随系统体积线性增长。数值实验表明,局部RGFM在代表性一维分布中能有效重现远超其感受野的长程相关性,而传统局部流匹配在长距离上存在显著误差。在FFHQ图像上,RGFM在64×64和256×256分辨率下生成的样本比局部流匹配更连贯、质量更高。结果表明,基于RG引导的概率流是实现高效、捕捉长程结构的生成建模的有力途径。
原文摘要 · Abstract (English)
Despite their remarkable success in modeling complex data, generative models face a fundamental tradeoff. Global approaches can capture full structural coherence but suffer from high computational costs, while local models are efficient but often fail to reproduce long-range correlations and global coherence. The renormalization group (RG) bridges this gap by seamlessly connecting spatial structures across different length scales, retaining quasi-local descriptions at each step while preserving long-range correlations. We introduce renormalization group flow matching (RGFM), a generative framework that systematically structures data generation across different spatial scales. By using an exact RG flow as the probability path, RGFM progressively generates data from long- to short-wavelength structures. To reconcile scalability with global structure, we exploit two key properties of the RG: quasi-locality and scale separation. We rigorously show that the RGFM probability flow can be accurately approximated by local velocity fields acting over a spatial range $O(Λ^{-1}[\ln L+\ln(1/\varepsilon)])$ for RG wavenumber scale $Λ$, linear system size $L$, and prescribed error tolerance $\varepsilon$. This property enables local generative modeling with patches of size $O(\ln L)$ and a computational cost that scales nearly linearly with the system volume. We numerically demonstrate that local RGFM reproduces long-range correlations far beyond its receptive field in representative one-dimensional distributions, while conventional local flow matching exhibits substantial errors at long distances. On FFHQ images, RGFM yields far more coherent and higher-quality samples than local flow matching at 64x64 and 256x256. Our results establish RG-guided probability flows as a promising route toward scalable generative modeling that captures long-range structure using only local computation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。