arXiv:2503.18462cs.LGcs.AI2025-03

提出PALATE方法,高效评估生成模型的保真度、多样性与新颖性。

PALATE: Peculiar Application of the Law of Total Expectation to Enhance the Evaluation of Deep Generative Models

  • 基于全期望定律重构数据分布评估框架
  • 结合MMD与DINOv2,在大规模数据上表现更优
  • 适合需要高效评估生成模型泛化能力的研究者

深度生成模型(DGMs)在图像生成、自然语言处理等领域带来范式变革,但对生成样本保真度、多样性和新颖性的综合评估仍具挑战。现有方法如特征似然差异(FLD)虽理论完备,却存在计算瓶颈。本文提出PALATE,通过奇异应用全期望定律于可访问真实数据随机变量,结合MMD基准指标与DINOv2特征提取器,构建一个全面、高效的评估框架。实验表明,该方法在保持或超越当前最优性能的同时,显著提升计算效率与大规模数据可扩展性,尤其擅长检测样本记忆现象并评估模型泛化能力。

原文摘要 · Abstract (English)

Deep generative models (DGMs) have caused a paradigm shift in the field of machine learning, yielding noteworthy advancements in domains such as image synthesis, natural language processing, and other related areas. However, a comprehensive evaluation of these models that accounts for the trichotomy between fidelity, diversity, and novelty in generated samples remains a formidable challenge. A recently introduced solution that has emerged as a promising approach in this regard is the Feature Likelihood Divergence (FLD), a method that offers a theoretically motivated practical tool, yet also exhibits some computational challenges. In this paper, we propose PALATE, a novel enhancement to the evaluation of DGMs that addresses limitations of existing metrics. Our approach is based on a peculiar application of the law of total expectation to random variables representing accessible real data. When combined with the MMD baseline metric and DINOv2 feature extractor, PALATE offers a holistic evaluation framework that matches or surpasses state-of-the-art solutions while providing superior computational efficiency and scalability to large-scale datasets. Through a series of experiments, we demonstrate the effectiveness of the PALATE enhancement, contributing a computationally efficient, holistic evaluation approach that advances the field of DGMs assessment, especially in detecting sample memorization and evaluating generalization capabilities.

生成模型评估方法深度学习特征提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。