用归一化流设计新评估指标,更高效准确判断生成图像真实度。
Normalizing Flow-Based Metric for Image Generation
- 基于归一化流计算图像似然距离,直接衡量生成图像与真实分布匹配程度。
- 仅需几百张图像即可稳定评估,远少于FID所需的数万张。
- 模型参数量小于Inception-V3一个数量级,适合新领域快速部署。
我们提出两种基于归一化流的图像生成质量评估新指标:更简单高效的流似然距离(FLD)和更精确的双流似然距离(D-FLD)。由于归一化流可计算精确似然,所提指标能有效评估生成图像与真实图像分布的接近程度。相比广泛使用的FID及其他近期指标,该方法具有明显优势:首先,仅需数百张图像即可实现均值收敛,而FID需数万张,其他指标至少需数千张,因此可对训练过程中的小批量生成图像进行可靠评估;其次,所用网络参数量比FID中使用的Inception-V3少一个数量级,计算更高效。对于新领域(如X光图像)的评估,理想情况下应使用真实图像重新训练模型以建模其分布,此时小规模模型的优势更为突出。大量实验表明,所提指标与各类图像退化程度之间具有理想的单调关系。
原文摘要 · Abstract (English)
We propose two new evaluation metrics to assess realness of generated images based on normalizing flows: a simpler and efficient flow-based likelihood distance (FLD) and a more exact dual-flow based likelihood distance (D-FLD). Because normalizing flows can be used to compute the exact likelihood, the proposed metrics assess how closely generated images align with the distribution of real images from a given domain. This property gives the proposed metrics a few advantages over the widely used Fréchet inception distance (FID) and other recent metrics. Firstly, the proposed metrics need only a few hundred images to stabilize (converge in mean), as opposed to tens of thousands needed for FID, and at least a few thousand for the other metrics. This allows confident evaluation of even small sets of generated images, such as validation batches inside training loops. Secondly, the network used to compute the proposed metric has over an order of magnitude fewer parameters compared to Inception-V3 used to compute FID, making it computationally more efficient. For assessing the realness of generated images in new domains (e.g., x-ray images), ideally these networks should be retrained on real images to model their distinct distributions. Thus, our smaller network will be even more advantageous for new domains. Extensive experiments show that the proposed metrics have the desired monotonic relationships with the extent of image degradation of various kinds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。