提出一种工业数据增强最优样本量估算方法,提升模型性能稳定性。
IT-OSE: Exploring Optimal Sample Size for Industrial Data Augmentation
- 基于信息论构建最优样本量估算模型,理论分析关键影响因素。
- 分类任务准确率平均提升4.38%,回归任务MAPE降低18.80%,误差更小。
- 相比穷举搜索节省83.97%计算成本,适合工业场景快速部署。
在工业场景中,数据增强能有效提升模型性能,但其效果并非线性增长。目前缺乏关于数据增强最优样本量(OSS)的理论研究或可靠估计方法,也无标准指标评估其准确性或与真实值的偏差。为此,本文提出信息论最优样本量估计(IT-OSE),用于工业数据增强中的可靠OSS估算。引入区间覆盖率与偏差(ICD)评分以直观评估估计结果。理论上分析并建模了OSS与主导因素的关系,提升可解释性。实验表明,相比经验估计,IT-OSE在各类基线模型上使分类任务准确率平均提升4.38%,回归任务MAPE平均降低18.80%,下游模型性能更稳定;ICD偏差(ICDdev)平均减少49.30%。相比穷举搜索,IT-OSE达到相同效果,同时降低平均83.97%的计算成本和93.46%的数据成本。实际应用验证其在典型传感器工业场景中具备良好泛化能力。
原文摘要 · Abstract (English)
In industrial scenarios, data augmentation is an effective approach to improve model performance. However, its benefits are not unidirectionally beneficial. There is no theoretical research or established estimation for the optimal sample size (OSS) in augmentation, nor is there an established metric to evaluate the accuracy of OSS or its deviation from the ground truth. To address these issues, we propose an information-theoretic optimal sample size estimation (IT-OSE) to provide reliable OSS estimation for industrial data augmentation. An interval coverage and deviation (ICD) score is proposed to evaluate the estimated OSS intuitively. The relationship between OSS and dominant factors is theoretically analyzed and formulated, thereby enhancing the interpretability. Experiments show that, compared to empirical estimation, the IT-OSE increases accuracy in classification tasks across baseline models by an average of 4.38%, and reduces MAPE in regression tasks across baseline models by an average of 18.80%. The improvements in downstream model performance are more stable. ICDdev in the ICD score is also reduced by an average of 49.30%. The determinism of OSS is enhanced. Compared to exhaustive search, the IT-OSE achieves the same OSS while reducing computational and data costs by an average of 83.97% and 93.46%. Furthermore, practicality experiments demonstrate that the IT-OSE exhibits generality across representative sensor-based industrial scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。