arXiv:2508.01325cs.LGstat.AP2025-08

提出融合采样验证方法,提升数据划分的准确与高效。

Fusion Sampling Validation in Data Partitioning for Machine Learning

  • 结合随机采样与交叉验证,优化数据划分策略
  • 在三组数据上实现更低偏差与更高收敛速度
  • 适合资源有限或大规模数据的机器学习场景

有效的数据划分对机器学习至关重要。传统K折交叉验证(KFCV)虽能增强模型鲁棒性,但因计算开销大和数据频繁打乱,常影响泛化评估。简单随机采样(SRS)虽能提供代表性样本,却易产生不平衡子集。本文提出融合采样验证(FSV)方法,融合SRS与KFCV优势,兼顾简洁性与准确性。实验使用三个规模分别为10,000、50,000、100,000的样本数据集,服从均值为0、方差为1的正态分布,种子为42。KFCV采用5折、10次重复,并引入缩放因子以确保性能估计稳健。FSV进一步引入加权因子提升表现。评估指标包括均值估计(ME)、方差估计(VE)、均方误差(MSE)、偏差、均值估计收敛率(ROC_ME)和方差估计收敛率(ROC_VE)。结果表明,FSV始终优于SRS与KFCV:ME为0.000863,VE为0.949644,MSE为0.952127,偏差为0.016288,ROC_ME为0.005199,ROC_VE为0.007137。该方法在资源受限及大规模数据环境下展现出更优的准确性和可靠性,为机器学习实践提供了有效方案。

原文摘要 · Abstract (English)

Effective data partitioning is known to be crucial in machine learning. Traditional cross-validation methods like K-Fold Cross-Validation (KFCV) enhance model robustness but often compromise generalisation assessment due to high computational demands and extensive data shuffling. To address these issues, the integration of the Simple Random Sampling (SRS), which, despite providing representative samples, can result in non-representative sets with imbalanced data. The study introduces a hybrid model, Fusion Sampling Validation (FSV), combining SRS and KFCV to optimise data partitioning. FSV aims to minimise biases and merge the simplicity of SRS with the accuracy of KFCV. The study used three datasets of 10,000, 50,000, and 100,000 samples, generated with a normal distribution (mean 0, variance 1) and initialised with seed 42. KFCV was performed with five folds and ten repetitions, incorporating a scaling factor to ensure robust performance estimation and generalisation capability. FSV integrated a weighted factor to enhance performance and generalisation further. Evaluations focused on mean estimates (ME), variance estimates (VE), mean squared error (MSE), bias, the rate of convergence for mean estimates (ROC\_ME), and the rate of convergence for variance estimates (ROC\_VE). Results indicated that FSV consistently outperformed SRS and KFCV, with ME values of 0.000863, VE of 0.949644, MSE of 0.952127, bias of 0.016288, ROC\_ME of 0.005199, and ROC\_VE of 0.007137. FSV demonstrated superior accuracy and reliability in data partitioning, particularly in resource-constrained environments and extensive datasets, providing practical solutions for effective machine learning implementations.

数据划分交叉验证采样优化机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。