用分形维数提升生成图像多样性,兼顾画质与丰富性。
FGM-HD: Boosting Generation Diversity of Fractal Generative Models through Hausdorff Dimension Induction
- 引入分形维数作为多样性指标,动态优化生成过程。
- 在ImageNet上使输出多样性提升39%,画质无明显下降。
- 适合关注生成多样性与理论创新的研究者。
在保持高质量的同时提升图像生成的多样性仍是关键挑战。分形生成模型(FGMs)虽能高效生成高质量图像,但其固有的自相似性限制了输出多样性。为此,本文提出基于豪斯多夫维数(Hausdorff Dimension, HD)的新方法,该指标用于量化结构复杂度,有助于提升生成多样性。我们设计了一种可学习的HD估计方法,直接从图像嵌入预测HD,缓解计算成本问题。然而,仅将HD引入混合损失不足以提升多样性,因会降低画质且改善有限。因此,在训练中采用基于HD的损失,并结合单调动量调度策略逐步优化超参数,实现多样性与画质的平衡;推理时使用HD引导的拒绝采样,筛选几何更丰富的输出。在ImageNet上的大量实验表明,相比原始FGM,本框架在输出多样性上提升39%,同时保持相当的图像质量。据我们所知,这是首个将豪斯多夫维数引入分形生成模型的工作,有效提升了生成多样性,并为FGM发展提供理论支撑。
原文摘要 · Abstract (English)
Improving the diversity of generated results while maintaining high visual quality remains a significant challenge in image generation tasks. Fractal Generative Models (FGMs) are efficient in generating high-quality images, but their inherent self-similarity limits the diversity of output images. To address this issue, we propose a novel approach based on the Hausdorff Dimension (HD), a widely recognized concept in fractal geometry used to quantify structural complexity, which aids in enhancing the diversity of generated outputs. To incorporate HD into FGM, we propose a learnable HD estimation method that predicts HD directly from image embeddings, addressing computational cost concerns. However, simply introducing HD into a hybrid loss is insufficient to enhance diversity in FGMs due to: 1) degradation of image quality, and 2) limited improvement in generation diversity. To this end, during training, we adopt an HD-based loss with a monotonic momentum-driven scheduling strategy to progressively optimize the hyperparameters, obtaining optimal diversity without sacrificing visual quality. Moreover, during inference, we employ HD-guided rejection sampling to select geometrically richer outputs. Extensive experiments on the ImageNet dataset demonstrate that our FGM-HD framework yields a 39\% improvement in output diversity compared to vanilla FGMs, while preserving comparable image quality. To our knowledge, this is the very first work introducing HD into FGM. Our method effectively enhances the diversity of generated outputs while offering a principled theoretical contribution to FGM development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。