为生成模型的不确定性量化提供新方法,提升可靠性评估
Towards Uncertainty Quantification in Generative Model Learning
- 提出生成模型不确定性量化框架,关注分布逼近中的置信度
- 合成数据实验验证聚合精确率-召回率曲线可有效捕捉不确定性
- 适合关注模型可信度与评估体系改进的研究者
尽管生成模型已在多个领域广泛应用,其可靠性仍存根本性担忧。一个关键但未被充分研究的问题是:模型在近似目标分布时的不确定性。现有评估方法主要关注学习分布与目标分布的接近程度,却忽略了测量本身的不确定性。本文正式提出生成模型学习中的不确定性量化问题,探讨包括基于集成的精确率-召回率曲线在内的研究方向。在合成数据上的初步实验表明,聚合的精确率-召回率曲线能有效捕捉模型逼近的不确定性,实现不同模型架构在不确定性特征上的系统性比较。
原文摘要 · Abstract (English)
While generative models have become increasingly prevalent across various domains, fundamental concerns regarding their reliability persist. A crucial yet understudied aspect of these models is the uncertainty quantification surrounding their distribution approximation capabilities. Current evaluation methodologies focus predominantly on measuring the closeness between the learned and the target distributions, neglecting the inherent uncertainty in these measurements. In this position paper, we formalize the problem of uncertainty quantification in generative model learning. We discuss potential research directions, including the use of ensemble-based precision-recall curves. Our preliminary experiments on synthetic datasets demonstrate the effectiveness of aggregated precision-recall curves in capturing model approximation uncertainty, enabling systematic comparison among different model architectures based on their uncertainty characteristics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。