arXiv:2606.14756cs.CVcs.AI2026-06中稿 · ICML

让多个扩散模型公平协作生成图像,避免彼此抢功或冲突。

Divide-and-Denoise: A Game-Theoretic Method for Fairly Composing Diffusion Models

论文配图:Divide-and-Denoise: A Game-Theoretic Method for Fairly Composing Diffusion Models
图 1 · 摘自论文原文
  • 用博弈论分配每个模型的处理区域,实现任务公平划分。
  • 在GenEval等评测中表现优于基线,解决漏物和属性错配问题。
  • 适合需要多模型协同的高质量图像生成场景。

预训练扩散模型的丰富为组合生成提供了可能,但直接组合易导致某模型主导或模型间意见冲突。本文提出Divide-and-Denoise方法,在采样过程中协调多个预训练扩散模型。该方法借鉴专业化团队管理思想,通过分配机制定义各模型对噪声样本各区域的责任。每一步中,先求解公平分配博弈,将样本划分为最大化总效用且满足公平约束的区域;再引导各模型在其分配区域内进行去噪。这一过程形成去噪与分工同步演进的新机制。在条件图像生成任务上评估显示,该方法在多项质量指标(包括GenEval基准)上超越基线,有效解决缺物、属性不匹配等常见失败问题。实验表明,Divide-and-Denoise能充分利用各模型专长,不忽略任何一方。

原文摘要 · Abstract (English)

The abundance of pre-trained diffusion models provides an opportunity for composition. Combining several models, however, runs the risk of one model dominating or models disagreeing with each other. Here, we propose Divide-and-Denoise, a method for coordinating multiple pre-trained diffusion models during sampling. Much like managing a specialized workforce, our method creates a fair but efficient division of labor across models. Central to our method is the notion of an allocation which defines the responsibility of each model to every region of the noisy sample. At every timestep, we then denoise by (i) updating the allocation by solving a fair division game, where we divide the sample into regions that maximize total utility under fairness constraints, and (ii) aligning the models with this allocation, where we guide each model to denoise within its assigned region. This leads to a new composite denoising process that evolves in tandem with a division process. We evaluate Divide-and-Denoise on conditional image generation. Across several quality metrics, including the GenEval benchmark, our method outperforms baselines and resolves common failures including missing objects and mismatched attributes. Experiments show that Divide-and-Denoise utilizes each model's expertise without neglecting any other model.

扩散模型图像生成公平协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。