智能挑选数据源组合,提升机器学习模型性能
SourceSplice: Source Selection for Machine Learning Tasks
- 基于基因拼接思想设计数据源选择机制
- 在更少尝试下找到使模型表现最优的数据组合
- 适合数据工程与模型优化人员参考
数据质量对机器学习预测性能至关重要,而现代组织面临海量数据源,传统数据发现方法多依赖元数据匹配或语义相似性,未考虑下游任务的性能需求。本文提出 SourceGrasp 与 SourceSplice 框架,旨在高效选取能最大化模型性能的最佳数据源子集。核心思想是不同数据源(或其组合)对任务效用贡献不一,需审慎选择。SourceGrasp 采用基于贪心与随机化的启发式算法;SourceSplice 则受基因拼接机制启发,模拟蛋白质合成过程进行源选择。我们在三个真实数据集和合成数据集上评估,结果表明:在显著减少子集探索次数的前提下,SourceSplice 能有效识别出带来高任务效用的数据源组合。此外,我们还研究了 SourceSplice 在多种设定下的决策敏感性。
原文摘要 · Abstract (English)
Data quality plays a pivotal role in the predictive performance of machine learning (ML) tasks - a challenge amplified by the deluge of data sources available in modern organizations. Prior work in data discovery largely focus on metadata matching, semantic similarity or identifying tables that should be joined to answer a particular query, but do not consider source quality for high performance of the downstream ML task. This paper addresses the problem of determining the best subset of data sources that must be combined to construct the underlying training dataset for a given ML task. We propose SourceGrasp and SourceSplice, frameworks designed to efficiently select a suitable subset of sources that maximizes the utility of the downstream ML model. Both the algorithms rely on the core idea that sources (or their combinations) contribute differently to the task utility, and must be judiciously chosen. While SourceGrasp utilizes a metaheuristic based on a greediness criterion and randomization, the SourceSplice framework presents a source selection mechanism inspired from gene splicing - a core concept used in protein synthesis. We empirically evaluate our algorithms on three real-world datasets and synthetic datasets and show that, with significantly fewer subset explorations, SourceSplice effectively identifies subsets of data sources leading to high task utility. We also conduct studies reporting the sensitivity of SourceSplice to the decision choices under several settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。