arXiv:2604.03064cs.CV2026-04

提出新图像真实感评估指标,捕捉纹理级细节差异。

Gram-MMD: A Texture-Aware Metric for Image Realism Assessment

  • 用预训练模型特征图的格拉姆矩阵捕捉纹理相关性
  • 在多个数据集上优于传统语义级度量,保持真实图像优先排序
  • 适合关注生成图像细节真实性的研究人员

生成图像的真实感评估仍是生成建模中的核心挑战。现有分布度量如FID和CLIP-MMD(CMMD)在语义层面比较特征分布,可能忽略对区分真实与生成图像至关重要的细粒度纹理信息。本文提出Gram-MMD(GMMD),利用预训练主干网络中间激活的格拉姆矩阵捕捉特征图间的相关性。通过提取对称格拉姆矩阵的上三角部分,并计算真实图像锚定分布与待评估分布之间的最大均值差异(MMD),GMMD生成一个编码更细粒度纹理与结构特性的表示。为确定度量超参数,采用基于可控退化(应用至MS-COCO图像)的元度量协议,通过斯皮尔曼等级相关系数和肯德尔和谐系数衡量单调性。在KADID-10k数据库和RAISE真实感评估数据集上,使用DINOv2、DC-AE、Stable Diffusion的VAE编码器、VGG19及LPIPS中的AlexNet等多类主干网络进行实验。此外,在跨域驾驶场景(KITTI / Virtual KITTI / Stanford Cars)中,显示CMMD因语义偏差可能将真实图像误判为不如合成图像真实,而GMMD能维持正确排序。结果表明,GMMD捕获了与现有语义级度量互补的信息。

原文摘要 · Abstract (English)

Evaluating the realism of generated images remains a fundamental challenge in generative modeling. Existing distributional metrics such as the Frechet Inception Distance (FID) and CLIP-MMD (CMMD) compare feature distributions at a semantic level but may overlook fine-grained textural information that can be relevant for distinguishing real from generated images. We introduce Gram-MMD (GMMD), a realism metric that leverages Gram matrices computed from intermediate activations of pretrained backbone networks to capture correlations between feature maps. By extracting the upper-triangular part of these symmetric Gram matrices and measuring the Maximum Mean Discrepancy (MMD) between an anchor distribution of real images and an evaluation distribution, GMMD produces a representation that encodes textural and structural characteristics at a finer granularity than global embeddings. To select the hyperparameters of the metric, we employ a meta-metric protocol based on controlled degradations applied to MS-COCO images, measuring monotonicity via Spearman's rank correlation and Kendall's tau. We conduct experiments on both the KADID-10k database and the RAISE realness assessment dataset using various backbone architectures, including DINOv2, DC-AE, Stable Diffusion's VAE encoder, VGG19, and the AlexNet backbone from LPIPS, among others. We also demonstrate on a cross-domain driving scenario (KITTI / Virtual KITTI / Stanford Cars) that CMMD can incorrectly rank real images as less realistic than synthetic ones due to its semantic bias, while GMMD preserves the correct ordering. Our results suggest that GMMD captures complementary information to existing semantic-level metrics.

图像评估纹理感知生成质量度量学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。