arXiv:2608.03316cs.LGcs.CV2026-08被引 1

让不同模型家族的生成器也能互相教学,突破传统方法的兼容性限制。

Any-OPD: Heterogeneous On-Policy Distillation for Flow-Matching Models via Representation-Space Bridging

论文配图:Any-OPD: Heterogeneous On-Policy Distillation for Flow-Matching Models via Representation-Space Bridging
图 1 · 摘自论文原文
  • 通过统一视觉表征空间连接师生模型,无需共享潜变量或架构
  • 在不匹配的模型间实现有效训练,使小模型性能接近大模型
  • 适合需要轻量化部署且有强教师模型的生成任务

在策略蒸馏中,教师模型需与学生模型使用相同的语言:一致的VAE潜变量、匹配的架构和共同的时间步网格。当最强教师与目标学生来自不同模型家族时,现有方法失效:教师潜变量无法作为异构坐标系下的目标,逐像素损失因教师随机重绘局部细节而退化为模糊或发散,时间步索引在不匹配的时间调度中失去意义。我们提出Any-OPD,据知是首个支持任意潜流生成器对之间进行在策略蒸馏的框架。Any-OPD将教师视为纯黑箱采样器,仅在一点连接两模型:一个冻结的、与模型无关的视觉表征空间,在此空间中比较独立解码的输出,规避了对潜变量、特征或架构的假设。通过匹配连续噪声水平而非步骤索引恢复轨迹对应关系,并引入短暂锚定阶段——用学生自身的VAE重新编码教师样本——确保梯度反映样本质量而非域差异。将12B FLUX.1-dev蒸馏至2.5B SD3.5-Medium,Any-OPD使学生模型的PickScore从0.846提升至0.884,HPSv3从9.12提升至10.97,性能媲美教师模型,仅为教师大小的五分之一,而直接潜变量回归完全无法训练。

原文摘要 · Abstract (English)

On-policy distillation, in which a teacher corrects samples that the student itself generates, presupposes that the two models speak the same language: identical VAE latents, matching architectures, and a common timestep grid. We ask what happens when none of this holds, as when the strongest teacher available and the student one wishes to deploy come from different model families, and find that the standard recipes have no answer: teacher latents cannot serve as targets in a foreign coordinate system, per-pixel losses against a teacher that stochastically re-draws local detail degenerate into blur or divergence, and timestep indices lose their meaning across mismatched schedules. We present Any-OPD, to our knowledge the first framework for on-policy distillation between arbitrary pairs of latent flow-matching generators. Any-OPD treats the teacher purely as a black-box sampler and connects the two models at exactly one point: a frozen, model-agnostic vision representation in which their independently decoded outputs are compared, sidestepping every assumption about latents, features, or architecture. Trajectory correspondence is recovered by matching continuous noise levels instead of step indices, and a brief anchoring phase, in which teacher samples are re-encoded through the student's own VAE, ensures the on-policy gradient measures sample quality rather than domain mismatch. Distilling the 12B FLUX.1-dev into the 2.5B SD3.5-Medium, Any-OPD lifts the student's PickScore from 0.846 to 0.884 and HPSv3 from 9.12 to 10.97, rivaling the teacher at a fifth of its size, where direct latent regression fails to train at all.

生成模型模型蒸馏流匹配跨模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。