用生物同步机制生成有方向性的图像,如指纹和纹理。
Kuramoto Orientation Diffusion Models
- 基于柯拉托莫振荡器模型构建周期性扩散过程,引入相位同步作为先验。
- 在指纹与纹理数据集上生成质量显著提升,优于传统方法。
- 适合需要结构化方向特征生成的研究者或应用如安防、材料分析。
具有丰富方向信息的图像(如指纹和纹理)常表现出一致的角向模式,传统基于各向同性欧氏扩散的生成方法难以建模。受生物系统中相位同步的启发,我们提出一种基于周期域的基于得分的生成模型,利用扩散过程中随机柯拉托莫动力学。在神经与物理系统中,柯拉托莫模型可捕捉耦合振荡器间的同步现象——我们将其重新用于图像生成的归纳偏置。在前向过程中,通过全局或局部耦合振荡器相互作用及向全局参考相位吸引,实现相位变量的同步,逐步将数据坍缩为低熵冯·米塞斯分布。反向过程则进行去同步,通过学习的得分函数逆向动态生成多样化图案。该方法实现了结构化破坏与分层生成,逐步从全局一致性细化到细节。我们采用环面高斯转移核与周期感知网络以适应圆形几何。实验表明,该方法在通用图像基准上表现良好,在指纹与纹理等方向密集数据集上生成质量显著提升。本工作展示了生物启发的同步动力学作为生成建模中结构先验的潜力。
原文摘要 · Abstract (English)
Orientation-rich images, such as fingerprints and textures, often exhibit coherent angular directional patterns that are challenging to model using standard generative approaches based on isotropic Euclidean diffusion. Motivated by the role of phase synchronization in biological systems, we propose a score-based generative model built on periodic domains by leveraging stochastic Kuramoto dynamics in the diffusion process. In neural and physical systems, Kuramoto models capture synchronization phenomena across coupled oscillators -- a behavior that we re-purpose here as an inductive bias for structured image generation. In our framework, the forward process performs \textit{synchronization} among phase variables through globally or locally coupled oscillator interactions and attraction to a global reference phase, gradually collapsing the data into a low-entropy von Mises distribution. The reverse process then performs \textit{desynchronization}, generating diverse patterns by reversing the dynamics with a learned score function. This approach enables structured destruction during forward diffusion and a hierarchical generation process that progressively refines global coherence into fine-scale details. We implement wrapped Gaussian transition kernels and periodicity-aware networks to account for the circular geometry. Our method achieves competitive results on general image benchmarks and significantly improves generation quality on orientation-dense datasets like fingerprints and textures. Ultimately, this work demonstrates the promise of biologically inspired synchronization dynamics as structured priors in generative modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。