提出新评估方法,精准检测合成胸片与真实影像的分布差异。
Assessing the Distributional Fidelity of Synthetic Chest X-rays using the Embedded Characteristic Score
- 用特征嵌入的特征函数变换比较合成与真实胸片分布。
- 在标准数据集上发现合成图像存在临床相关的分布偏差。
- 适合医疗生成模型评估,尤其关注高风险决策场景。
胸片(CXR)是临床最常用的影像诊断手段之一。由于隐私限制,患者胸片数据难以公开,促使使用深度生成模型合成图像用于数据共享和机器学习训练。鉴于胸片应用的高风险性,评估合成图像是否准确反映真实数据分布至关重要。本文提出嵌入特征得分(ECS),一种灵活的评估方法,通过特征嵌入的特征函数变换比较合成与真实胸片样本。嵌入选择可依据临床或科研需求定制。利用特征函数在原点附近的特性,ECS对高阶矩和分布尾部差异敏感,弥补了常用指标如弗雷切特激活距离(FID)的不足。我们建立了ECS的理论性质,并提出基于简单重抽样的校准策略。通过模拟和标准基准影像数据集对比,ECS在实证中揭示了合成胸片与真实胸片间的临床相关分布差异。结果强调了在高风险决策中对合成数据进行可靠评估的重要性。
原文摘要 · Abstract (English)
Chest X-ray (CXR) images are among the most commonly used diagnostic imaging modalities in clinical practice. Stringent privacy constraints often limit the public dissemination of patient CXR images, contributing to the increasing use of synthetic images produced by deep generative models for data sharing and training machine learning models. Given the high-stakes downstream applications of CXR images, it is crucial to evaluate how faithfully synthetic images reflect the underlying target distribution. We propose the embedded characteristic score (ECS), a flexible evaluation procedure that compares synthetic and patient CXR samples through characteristic function transforms of feature embeddings. The choice of embedding can be tailored to the clinical or scientific context of interest. By leveraging the behavior of characteristic functions near the origin, ECS is sensitive to differences in higher moments and distribution tails, aspects that are often overlooked by commonly used evaluation metrics such as the Fréchet Inception Distance (FID). We establish theoretical properties of ECS and describe a calibration strategy based on a simple resampling procedure. We compare the empirical performance of ECS against FID via simulations and standard benchmark imaging datasets. Assessing synthetic CXR images with ECS uncovers clinically relevant distributional discrepancies relative to patient CXR images. These results highlight the importance of reliable evaluation of synthetic data that inform high-stakes decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。