arXiv:2608.02575cs.LGstat.ML2026-08

随机流的结构可被扩散模型学习,影响生成质量。

Pseudorandom Streams within Diffusion Models Act as Learnable Inputs That Affect Generation Quality

论文配图:Pseudorandom Streams within Diffusion Models Act as Learnable Inputs That Affect Generation Quality
图 1 · 摘自论文原文
  • 将伪随机流视为可学习输入,而非单纯噪声
  • 不同随机源导致MNIST和CIFAR-10生成质量差异显著
  • 适合关注生成模型隐性依赖与训练机制的研究者

数字学习系统使用具体的伪随机数值,而非抽象的随机变量。这些数值在训练中进入实际损失及其梯度。若伪随机流包含模型可访问的结构,该结构就可能成为学习内容。我们证明这种效应足以改变扩散模型的生成质量。对于扩散噪声预测,存在两种降低损失的路径:模型可学习真实数据的规律以推断添加的噪声,也可利用噪声源自身的规律从含噪输入中恢复真实噪声。随机角色消融实验表明,主导效应来自扩散噪声角色。即使移除可复用的真实图像结构,探测器仍表现出明显的源依赖噪声预测学习,其源排序与真实数据扩散训练高度一致。不同伪随机源在MNIST和CIFAR-10上产生显著的生成质量差异。进一步实验显示,相同源结构也可在独立的下一个值预测任务中被学习,尽管这不是扩散模型使用的机制。改变探测器的干净参考保留了大部分源排序,但改变了数值响应,形成干净参考依赖的幂律关系。总体而言,结果表明伪随机流不仅是随机性来源,其具体结构也可作为可学习输入,其影响取决于学习系统。

原文摘要 · Abstract (English)

Digital learning systems consume concrete pseudorandom values rather than abstract random variables. These values enter the realized loss and its gradient during training. If a pseudorandom stream contains structure that is accessible to the model, this structure can therefore become part of what the learning system learns. We show that this effect can be strong enough to change generation quality in diffusion models. For diffusion noise prediction, there are two related routes by which the loss can be reduced. The model can learn regularities of the clean data and use them to infer the added noise. It can also exploit regularities of the noise source itself to recover the realized noise from the noisy input. Random-role ablation shows that the dominant source-dependent effect in our experiments is associated with the diffusion-noise roles. A diffusion probe that removes reusable real-image structure still shows clear source-dependent noise-prediction learning, and its source ordering closely matches that of real-data diffusion training. Different pseudorandom sources also produce large differences in generation quality on MNIST and CIFAR-10. Further experiments show that the same source structure can also be learned in an independent next-value prediction task, although this is not the learning mechanism used by the diffusion model. Changing the probe clean reference preserves much of the source ordering while changing the numerical response, producing clean-reference-dependent power-law relations. Overall, the results show that a pseudorandom stream is not only a source of stochastic variation: its concrete structure can act as a learnable input whose effect depends on the learning system.

扩散模型随机流生成质量可学习输入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。