通过剪枝与列重排提升合成表格数据的监督学习性能
Towards High Supervised Learning Utility Training Data Generation: Data Pruning and Column Reordering
- 用剪枝保留高信噪比数据,改善类别分布
- 列重排使生成数据结构匹配模型需求,提升性能
- 尤其适合处理不平衡数据,提升合成数据实用性
表格数据合成在医疗、金融、零售等领域日益普及。尽管表格生成器取得进展,但使用合成数据训练的模型性能仍低于真实数据。这主要源于类别不平衡加剧及生成器忽略监督学习中的数据关系。为此,本文提出一种名为 PRRO(Pruning and ReOrdering)的新流程,融合数据中心人工智能技术。PRRO 采用数据剪枝引导生成器聚焦高信噪比样本,使合成数据类别分布更接近原始数据;同时引入列重排算法,对齐生成器与监督学习模型的数据建模结构。在 22 个公开数据集上的实验表明,使用 PRRO 生成的合成数据可使预测性能平均提升 26.74%,最高达 871.46%;在原始数据基础上附加合成数据时,平均提升 6.13%,最高达 200.32%。在六个高度不平衡数据集上,PRRO 使合成数据类别分布相似性提升 43%。该方法推动了合成数据与下游监督学习任务的无缝衔接。
原文摘要 · Abstract (English)
Tabular data synthesis for supervised learning ('SL') model training is gaining popularity in industries such as healthcare, finance, and retail. Despite the progress made in tabular data generators, models trained with synthetic data often underperform compared to those trained with original data. This low SL utility of synthetic data stems from class imbalance exaggeration and SL data relationship overlooked by tabular generator. To address these challenges, we draw inspirations from techniques in emerging data-centric artificial intelligence and elucidate Pruning and ReOrdering ('PRRO'), a novel pipeline that integrates data-centric techniques into tabular data synthesis. PRRO incorporates data pruning to guide the table generator towards observations with high signal-to-noise ratio, ensuring that the class distribution of synthetic data closely matches that of the original data. Besides, PRRO employs a column reordering algorithm to align the data modeling structure of generators with that of SL models. These two modules enable PRRO to optimize SL utility of synthetic data. Empirical experiments on 22 public datasets show that synthetic data generated using PRRO enhances predictive performance compared to data generated without PRRO. Specifically, synthetic replacement of original data yields an average improvement of 26.74% and up to 871.46% improvement using PRRO, while synthetic appendant to original data results with PRRO-generated data results in an average improvement of 6.13% and up to 200.32%. Furthermore, experiments on six highly imbalanced datasets show that PRRO enables the generator to produce synthetic data with a class distribution that resembles the original data more closely, achieving a similarity improvement of 43%. Through PRRO, we foster a seamless integration of data synthesis to subsequent SL prediction, promoting quality and accessible data analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。