arXiv:2510.12220cs.LG2025-10NeurIPS被引 3

让扩散模型一键生成图像,还能看清每一步变化过程。

Hierarchical Koopman Diffusion: Fast Generation with Interpretable Diffusion Trajectory

  • 用数学变换将图像生成过程转为线性动态,实现一步到位
  • 生成速度比传统方法快,且中间状态可读可调
  • 适合需要解释性和可控性的图像生成场景

扩散模型在高质量图像生成中表现卓越,但采样过程因迭代去噪而缓慢。现有一步法虽加速推理,却牺牲了扩散过程的可解释性与精细控制能力。为此,我们提出「分层库普曼扩散」(Hierarchical Koopman Diffusion),结合库普曼算子理论,将非线性扩散过程映射到潜空间,使演化由全局线性算子支配,从而获得闭式轨迹解。该方法不仅消除迭代采样,还完整暴露中间状态,支持人工干预。针对图像多尺度特性,设计分层架构,通过各尺度专属的库普曼子空间解耦生成动态,系统捕捉从粗到细的细节。实验表明,该方法在保持一步生成竞争力的同时,可通过谱分析解释并操控生成过程。本框架弥合了快速采样与可解释性之间的鸿沟,推动生成模型向可解释方向发展。

原文摘要 · Abstract (English)

Diffusion models have achieved impressive success in high-fidelity image generation but suffer from slow sampling due to their inherently iterative denoising process. While recent one-step methods accelerate inference by learning direct noise-to-image mappings, they sacrifice the interpretability and fine-grained control intrinsic to diffusion dynamics, key advantages that enable applications like editable generation. To resolve this dichotomy, we introduce \textbf{Hierarchical Koopman Diffusion}, a novel framework that achieves both one-step sampling and interpretable generative trajectories. Grounded in Koopman operator theory, our method lifts the nonlinear diffusion dynamics into a latent space where evolution is governed by globally linear operators, enabling closed-form trajectory solutions. This formulation not only eliminates iterative sampling but also provides full access to intermediate states, allowing manual intervention during generation. To model the multi-scale nature of images, we design a hierarchical architecture that disentangles generative dynamics across spatial resolutions via scale-specific Koopman subspaces, capturing coarse-to-fine details systematically. We empirically show that the Hierarchical Koopman Diffusion not only achieves competitive one-step generation performance but also provides a principled mechanism for interpreting and manipulating the generative process through spectral analysis. Our framework bridges the gap between fast sampling and interpretability in diffusion models, paving the way for explainable image synthesis in generative modeling.

扩散模型可解释性图像生成加速采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。