arXiv:2607.02375cs.CV2026-07被引 2

通过匹配特征分布,实现单步图像生成的新方法。

Representation Distribution Matching for One-Step Visual Generation

论文配图:Representation Distribution Matching for One-Step Visual Generation
图 1 · 摘自论文原文
  • 用修正后的MMD方法在冻结编码器下匹配生成与真实特征分布。
  • 最佳批量大小超2048,显著高于常规设置,提升生成质量。
  • 联合14个编码器评估,防止模型被误导,适合追求高质单步生成的场景。

我们剖析了表示分布匹配(RDM)的设计空间,这是一种通过在冻结预训练编码器下匹配生成与参考特征分布来训练单步图像生成器的范式。通过控制两个设计维度——分布比较方式和比较所用表示——得出三个发现:首先,经典MMD在正确估计后成为强大且可扩展的目标;其次,生成批次大小最优值超过2048,远超常规;第三,单一表示易被操纵,因此采用涵盖14个编码器的综合评估策略,使用不依赖训练损失的切片沃瑟斯坦距离SW_r14进行验证。结合优选方案得改进RDM(iRDM),在ImageNet上以SW_r14 1.30达到单步生成新基准,且在人类偏好代理PickScore中优于前代模型71.2%。该方法还可将四步模型FLUX.2后训练为单步生成器,在GenEval(0.826 vs 0.794)和PickScore(22.76 vs 22.58)上均超越原版本,仅耗时90 H200 GPU小时。

原文摘要 · Abstract (English)

We elucidate the design space of Representation Distribution Matching (RDM), our name for the paradigm that trains a one-step image generator by matching generated and reference feature distributions under frozen pretrained encoders. We identify two design axes, how the distributions are compared and the representations they are compared in, and controlled studies along them yield three findings. First, the classical MMD, which could not train convincing generators a decade ago, becomes a strong and scalable objective once estimated right. Second, the generated batch is then the operative variable, with an optimum above 2048, far beyond customary batch sizes. Third, any single representation can be gamed, driven below the real score while images stay visibly fake, so we match against a balanced battery of encoders and evaluate with SW_r14, a Sliced-Wasserstein distance over 14 encoders that is independent of the training loss and resists gaming. Combining the preferred choices yields improved RDM (iRDM): it sets the one-step state of the art on ImageNet at SW_r14 1.30, corroborated by PickScore, a human-preference proxy our objective never optimizes, which prefers it over the prior best one-step generator on 71.2% of matched samples. The same recipe post-trains the four-step FLUX.2 [klein] into a one-step generator, surpassing the four-step version on GenEval, 0.826 to 0.794, and on PickScore, 22.76 to 22.58, in 90 H200 GPU-hours. Project page: https://alan-lanfeng.github.io/rdm/.

单步生成分布匹配图像生成RDM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。