SDB框架统一评估合成表格数据质量,提升可复现性与跨领域适用性。
Synthetic Data Blueprint (SDB): A modular framework for the statistical, structural, and graph-based evaluation of synthetic tabular data
- 模块化Python库,自动识别特征类型并量化分布与依赖关系
- 支持图结构与嵌入表征的结构保真度评分,覆盖多类数据场景
- 适用于医疗、金融、网络安全等不同领域的数据质量评估
在人工智能快速发展的背景下,合成数据被广泛用于加速创新、保护隐私并提升数据可及性。然而,合成数据的评估仍分散于异构指标、临时脚本和不完整的报告实践中。为此,我们提出Synthetic Data Blueprint(SDB),一个基于Python的模块化库,用于定量和可视化评估合成表格数据的保真度。SDB支持:(i) 自动特征类型检测,(ii) 分布与依赖级别的保真度度量,(iii) 基于图结构与嵌入的结构保留分数,(iv) 丰富的数据可视化方案。为验证SDB的广度、鲁棒性和跨领域适用性,我们在三个差异显著的真实世界用例中进行了评估:(i) 医疗诊断,(ii) 社会经济与金融建模,(iii) 网络安全与网络流量分析。这些案例涵盖从混合型临床变量到高基数分类属性及高维遥测信号的不同挑战,同时提供一致、透明且可复现的基准评估,适用于多种数据域。
原文摘要 · Abstract (English)
In the rapidly evolving era of Artificial Intelligence (AI), synthetic data are widely used to accelerate innovation while preserving privacy and enabling broader data accessibility. However, the evaluation of synthetic data remains fragmented across heterogeneous metrics, ad-hoc scripts, and incomplete reporting practices. To address this gap, we introduce Synthetic Data Blueprint (SDB), a modular Pythonic based library to quantitatively and visually assess the fidelity of synthetic tabular data. SDB supports: (i) automated feature-type detection, (ii) distributional and dependency-level fidelity metrics, (iii) graph- and embedding-based structure preservation scores, and (iv) a rich suite of data visualization schemas. To demonstrate the breadth, robustness, and domain-agnostic applicability of the SDB, we evaluated the framework across three real-world use cases that differ substantially in scale, feature composition, statistical complexity, and downstream analytical requirements. These include: (i) healthcare diagnostics, (ii) socioeconomic and financial modelling, and (iii) cybersecurity and network traffic analysis. These use cases reveal how SDB can address diverse data fidelity assessment challenges, varying from mixed-type clinical variables to high-cardinality categorical attributes and high-dimensional telemetry signals, while at the same time offering a consistent, transparent, and reproducible benchmarking across heterogeneous domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。