arXiv:2505.06761cs.LGcs.MA2025-05中稿 · AAMAS2025 Internat…

用多智能体图网络提升扩散模型生成适应性,让不同阶段的图像生成更精准。

Learning Graph Representation of Agent Diffusers

  • 将生成过程视为可交互的多智能体系统,通过图神经网络建模协作关系。
  • 在多个基准上优于传统扩散模型,生成图像更准确且多样性更好。
  • 适合需要动态调整生成策略的复杂视觉任务,如跨域图像合成。

基于扩散的生成模型在文本到图像合成方面取得了显著进展,展现出强大的文本理解与零样本泛化能力。这些模型从随机噪声逐步优化图像,初始阶段依赖文本输入,后期则更注重视觉保真度。这一转变表明,静态模型参数可能无法最优应对生成的不同阶段。我们提出LGR-AD(Learning Graph Representation of Agent Diffusers),一种新型多智能体系统,旨在提升动态计算机视觉任务中的适应性。LGR-AD将生成过程建模为一组相互作用的智能体构成的分布式系统,每个智能体代表一个专家子模型。这些智能体根据环境变化动态调整,并通过图神经网络编码彼此的关系与性能指标。方法采用基于top-k最大生成树的协调机制,优化生成流程。每个智能体的决策由一个元模型引导,以最小化一种新设计的损失函数,平衡准确性与多样性。理论分析与大量实证评估表明,LGR-AD在多个基准上超越传统扩散模型,展现了其在复杂图像生成任务中可扩展、灵活的潜力。代码已开源:https://github.com/YousIA/LGR_AD

原文摘要 · Abstract (English)

Diffusion-based generative models have significantly advanced text-to-image synthesis, demonstrating impressive text comprehension and zero-shot generalization. These models refine images from random noise based on textual prompts, with initial reliance on text input shifting towards enhanced visual fidelity over time. This transition suggests that static model parameters might not optimally address the distinct phases of generation. We introduce LGR-AD (Learning Graph Representation of Agent Diffusers), a novel multi-agent system designed to improve adaptability in dynamic computer vision tasks. LGR-AD models the generation process as a distributed system of interacting agents, each representing an expert sub-model. These agents dynamically adapt to varying conditions and collaborate through a graph neural network that encodes their relationships and performance metrics. Our approach employs a coordination mechanism based on top-$k$ maximum spanning trees, optimizing the generation process. Each agent's decision-making is guided by a meta-model that minimizes a novel loss function, balancing accuracy and diversity. Theoretical analysis and extensive empirical evaluations show that LGR-AD outperforms traditional diffusion models across various benchmarks, highlighting its potential for scalable and flexible solutions in complex image generation tasks. Code is available at: https://github.com/YousIA/LGR_AD

扩散模型多智能体图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。