用工程统计方法优化神经网络超参数,提升拳击动作识别准确率
Six Sigma For Neural Networks: Taguchi-based optimization
- 采用田口实验设计,系统测试12种超参数组合
- 达98.84%训练准确率,86.25%验证准确率,损失极低
- 揭示学习率最重要,适合需要高效调参的研究者
卷积神经网络(CNN)的超参数优化仍具挑战性且计算成本高,常依赖试错或穷举搜索。本研究将田口实验设计这一传统质量工程统计方法引入CNN超参数优化,用于专业拳击动作识别任务。使用L12(2^11)正交数组,在12组实验配置中系统评估图像尺寸、颜色模式、激活函数、学习率、缩放、打乱、垂直翻转和水平翻转共8个超参数。针对机器学习优化的多目标特性,开发了五种基于信噪比分析的方法,同步优化训练准确率、验证准确率、训练损失与验证损失。提出新型对数缩放技术,统一冲突指标,实现田口框架内的综合多质量评估。结果表明,方法3(加权准确率结合对数变换损失函数)表现最优,训练准确率达98.84%,验证准确率为86.25%,同时保持最小损失值。田口分析显示学习率是影响最大的参数,其次为图像尺寸和激活函数,为CNN超参数优先级提供清晰指导。
原文摘要 · Abstract (English)
The optimization of hyperparameters in convolutional neural networks (CNNs) remains a challenging and computationally expensive process, often requiring extensive trial-and-error approaches or exhaustive grid searches. This study introduces the application of Taguchi Design of Experiments methodology, a statistical optimization technique traditionally used in quality engineering, to systematically optimize CNN hyperparameters for professional boxing action recognition. Using an L12(211) orthogonal array, eight hyperparameters including image size, color mode, activation function, learning rate, rescaling, shuffling, vertical flip, and horizontal flip were systematically evaluated across twelve experimental configurations. To address the multi-objective nature of machine learning optimization, five different approaches were developed to simultaneously optimize training accuracy, validation accuracy, training loss, and validation loss using Signal-to-Noise ratio analysis. The study employed a novel logarithmic scaling technique to unify conflicting metrics and enable comprehensive multi-quality assessment within the Taguchi framework. Results demonstrate that Approach 3, combining weighted accuracy metrics with logarithmically transformed loss functions, achieved optimal performance with 98.84% training accuracy and 86.25% validation accuracy while maintaining minimal loss values. The Taguchi analysis revealed that learning rate emerged as the most influential parameter, followed by image size and activation function, providing clear guidance for hyperparameter prioritization in CNN optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。