arXiv:2506.18499cs.LGcs.AI2025-06被引 1

让合成数据更像真实数据,提升模型鲁棒性

PuckTrick: A Library for Making Synthetic Data More Realistic

  • 用可控方式向合成数据注入缺失、噪声等真实缺陷
  • 树模型和线性模型在污染数据上表现优于纯净合成数据
  • 适合评估模型在真实数据缺陷下的稳定性

机器学习模型依赖高质量训练数据,但真实数据常因隐私、版权或不完整而难以获取。合成数据生成(SDG)成为替代方案,可保留真实数据统计特性并确保合规。然而合成数据往往过于干净,缺乏缺失值、噪声、异常值、标签错误等现实缺陷,影响模型泛化能力。为此,我们提出 PuckTrick,一个 Python 库,系统性地向合成数据注入可控错误,支持缺失、噪声、异常值、标签错分、重复和类别不平衡等多种错误类型。提供两种污染模式:对干净数据污染,或对已污染数据进一步恶化。在真实金融数据集上的实验表明,经系统污染的合成数据训练的模型,在树模型和线性模型(如 SVM、Extra Trees)上性能更优。

原文摘要 · Abstract (English)

The increasing reliance on machine learning (ML) models for decision-making requires high-quality training data. However, access to real-world datasets is often restricted due to privacy concerns, proprietary restrictions, and incomplete data availability. As a result, synthetic data generation (SDG) has emerged as a viable alternative, enabling the creation of artificial datasets that preserve the statistical properties of real data while ensuring privacy compliance. Despite its advantages, synthetic data is often overly clean and lacks real-world imperfections, such as missing values, noise, outliers, and misclassified labels, which can significantly impact model generalization and robustness. To address this limitation, we introduce Pucktrick, a Python library designed to systematically contaminate synthetic datasets by introducing controlled errors. The library supports multiple error types, including missing data, noisy values, outliers, label misclassification, duplication, and class imbalance, offering a structured approach to evaluating ML model resilience under real-world data imperfections. Pucktrick provides two contamination modes: one for injecting errors into clean datasets and another for further corrupting already contaminated datasets. Through extensive experiments on real-world financial datasets, we evaluate the impact of systematic data contamination on model performance. Our findings demonstrate that ML models trained on contaminated synthetic data outperform those trained on purely synthetic, error-free data, particularly for tree-based and linear models such as SVMs and Extra Trees.

合成数据数据污染模型鲁棒性Python库

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。