分散式扩散模型生成质量由专家与数据的匹配度决定,而非采样稳定性。
Expert-Data Alignment Governs Generation Quality in Decentralized Diffusion Models
- 通过稀疏路由选择与当前状态匹配的专家,提升生成质量。
- 稀疏路由FID达22.6,优于全集成路由的47.9。
- 适合关注生成质量而非数值稳定性的模型部署者。
去中心化扩散模型(DDMs)将去噪过程分配给在独立数据簇上训练的专家,这些专家的预测可能严重分歧。生成质量由何决定?我们首次系统性地探究此问题。直觉认为最小化去噪轨迹敏感性应决定生成质量,但实证表明稳定性与质量脱节:全集成路由虽最稳定且收敛最好,生成质量却最差(FID 47.9),而稀疏Top-2路由仅需两个专家即获更优结果(FID 22.6)。我们发现,专家-数据对齐才是核心机制:生成质量取决于是否将输入路由至训练分布覆盖当前去噪状态的专家。在两种不同DDM系统中验证:(i) 数据簇距离分析显示稀疏路由优先选择最接近当前状态的专家;(ii) 专家级分析表明被选专家预测更准确;(iii) 专家分歧增大时质量下降。因此,部署时应优先考虑专家-数据对齐,而非数值稳定性。
原文摘要 · Abstract (English)
Decentralized Diffusion Models (DDMs) route denoising through experts trained independently on disjoint data clusters, which can strongly disagree in their predictions. What governs the quality of generations in such systems? We present the first ever systematic investigation of this question. A priori, the expectation is that minimizing denoising trajectory sensitivity -- minimizing how perturbations amplify during sampling -- should govern generation quality. We demonstrate this hypothesis is incorrect: a stability-quality dissociation. Full ensemble routing, which combines all expert predictions at each step, achieves the most stable sampling dynamics and best numerical convergence while producing the worst generation quality (FID 47.9 vs. 22.6 for sparse Top-2 routing). Instead, we identify expert-data alignment as the governing principle: generation quality depends on routing inputs to experts whose training distribution covers the current denoising state. Across two distinct DDM systems, we validate expert-data alignment using (i) data-cluster distance analysis, confirming sparse routing selects experts with data clusters closest to the current denoising state, and (ii) per-expert analysis, showing selected experts produce more accurate predictions than non-selected ones, and (iii) expert disagreement analysis, showing quality degrades when experts disagree. For DDM deployment, our findings establish that routing should prioritize expert-data alignment over numerical stability metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。