让生成的多张图既多样又高质量,避免重复。
Scaling Group Inference for Diverse and High-Quality Generation
- 将多图生成建模为优化问题,兼顾质量与多样性。
- 在4-8张图的组中,多样性提升显著,质量不下降。
- 适用于文生图、图生图等任务,适合需要多方案探索的场景。
生成模型通常独立采样输出,近期方法聚焦于提升单个样本质量。但在实际应用中,用户常需针对同一提示生成4-8张图像,独立采样易导致结果冗余,限制选择并阻碍创意探索。本文提出一种可扩展的群体推理方法,同时提升一组输出的多样性和质量。将群体生成建模为二次整数分配问题:候选输出作为图节点,通过优化样本质量(一元项)和组内多样性(二元项)来选择子集。为提升效率,利用中间预测逐步剪枝候选集,使方法可扩展至大规模候选集合。大量实验表明,相比独立采样基线及近期推理算法,本方法在多样性和质量上均有显著提升。该框架广泛适用于文本到图像、图像到图像、图像提示及视频生成等任务,使生成模型能将多个输出视为连贯整体而非独立样本。
原文摘要 · Abstract (English)
Generative models typically sample outputs independently, and recent inference-time guidance and scaling algorithms focus on improving the quality of individual samples. However, in real-world applications, users are often presented with a set of multiple images (e.g., 4-8) for each prompt, where independent sampling tends to lead to redundant results, limiting user choices and hindering idea exploration. In this work, we introduce a scalable group inference method that improves both the diversity and quality of a group of samples. We formulate group inference as a quadratic integer assignment problem: candidate outputs are modeled as graph nodes, and a subset is selected to optimize sample quality (unary term) while maximizing group diversity (binary term). To substantially improve runtime efficiency, we progressively prune the candidate set using intermediate predictions, allowing our method to scale up to large candidate sets. Extensive experiments show that our method significantly improves group diversity and quality compared to independent sampling baselines and recent inference algorithms. Our framework generalizes across a wide range of tasks, including text-to-image, image-to-image, image prompting, and video generation, enabling generative models to treat multiple outputs as cohesive groups rather than independent samples.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。