将多个不同风格的文生图模型优势融合进一个可切换的小型模型。
Poly-OPD: Heterogeneous Multi-Teacher On-Policy Distillation for Capability-Selectable Flow Models

- 通过像素桥和冻结DINOv2空间实现异构模型间的直接能力迁移。
- 在GenEval上从67.3提升至73.3,DrawBench HPSv3达11.35,超越原大模型。
- 支持开关式选择不同能力,适合需要多场景适配的应用场景。
主流开源文生图模型各具优势:有的在美学对齐上表现更好,有的更忠实遵循组合指令。然而,它们在自编码器和噪声调度上的差异导致难以跨模型转移能力。本文提出Poly-OPD框架,可将异构教师模型的互补优势凝聚为单一紧凑的流匹配学生模型。为弥合不同教师间不兼容的潜在空间,Poly-OPD采用基于像素桥的在线策略蒸馏:学生生成图像由选定教师的编码器重新编码,并在与教师噪声调度匹配的噪声水平下进行精细化修正。最终目标在冻结的DINOv2空间中与学生匹配,实现跨不兼容潜在空间的监督。为保留互补能力并避免教师间干扰,Poly-OPD使用梯度兼容性诊断来组织适配器:注意力LoRA模块跨教师共享,前馈适配器则保持教师专属。蒸馏过程中,基于差距感知的课程安排优先训练学生仍落后的组合类别,随差距缩小逐步转向剩余差距更大的类别。通过将FLUX.1-dev和Z-Image蒸馏至2.5B的SD3.5-Medium学生模型,Poly-OPD使GenEval从67.3提升至73.3,超过两个更大教师模型;DrawBench HPSv3从9.34升至11.35,成功在可切换模型中整合双重优势。
原文摘要 · Abstract (English)
Leading open text-to-image models often carry complementary strengths: one may lead on preference-aligned aesthetics while another follows compositional instructions more faithfully. However, differences in their autoencoders and noise schedules make it difficult to transfer these strengths across models. In this paper, we present Poly-OPD, a framework that can consolidate complementary strengths of heterogeneous teachers into a single compact flow-matching student. To bridge the incompatible latent spaces of different teachers, Poly-OPD performs on-policy distillation through a pixel bridge. Each student-generated image is re-encoded by a selected teacher's encoder and refined from a noise level matched by magnitude under the teacher's noise schedule. The resulting target is further matched to the student in frozen DINOv2 space, enabling supervision across incompatible latent spaces. To retain complementary capabilities without cross-teacher interference, Poly-OPD uses a gradient compatibility diagnostic to organize its adapters: attention LoRA modules are shared across teachers, whereas feed-forward adapters remain teacher-specific. During distillation, a gap-aware curriculum devotes more training to compositional categories where the student still falls short of the teacher. As each gap narrows, training shifts toward categories with larger remaining gaps. By distilling FLUX.1-dev and Z-Image into a 2.5B SD3.5-Medium student, Poly-OPD improves GenEval from 67.3 to 73.3, surpassing both larger teachers, and raises DrawBench HPSv3 from 9.34 to 11.35, consolidating both strengths within a switchable model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。