提升二值自回归图像生成的多样性,兼顾画质与创意
DiverseAR: Boosting Diversity in Bitwise Autoregressive Image Generation
- 动态调整二值输出分布尖锐度,增强生成多样性
- 采样时避开低置信度像素,避免画质下降
- 适用于需要丰富多样图像的生成任务
本文研究二值自回归生成模型中样本多样性的不足问题。分析发现两个关键限制:(1) 二值建模本质导致预测空间受限;(2) 过于尖锐的逻辑斯蒂分布引发采样坍缩。为此提出DiverseAR,通过自适应分布缩放机制,在采样过程中动态调节二值输出的尖锐度,实现更平滑的预测与更高多样性。为防止分布平滑带来的保真度损失,进一步设计基于能量的生成路径搜索算法,避开低置信度标记,有效保持高质量图像生成。大量实验表明,DiverseAR显著提升了二值自回归图像生成的样本多样性。
原文摘要 · Abstract (English)
In this paper, we investigate the underexplored challenge of sample diversity in autoregressive (AR) generative models with bitwise visual tokenizers. We first analyze the factors that limit diversity in bitwise AR models and identify two key issues: (1) the binary classification nature of bitwise modeling, which restricts the prediction space, and (2) the overly sharp logits distribution, which causes sampling collapse and reduces diversity. Building on these insights, we propose DiverseAR, a principled and effective method that enhances image diversity without sacrificing visual quality. Specifically, we introduce an adaptive logits distribution scaling mechanism that dynamically adjusts the sharpness of the binary output distribution during sampling, resulting in smoother predictions and greater diversity. To mitigate potential fidelity loss caused by distribution smoothing, we further develop an energy-based generation path search algorithm that avoids sampling low-confidence tokens, thereby preserving high visual quality. Extensive experiments demonstrate that DiverseAR substantially improves sample diversity in bitwise autoregressive image generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。