用梯度下降和L1正则化，从13个化学特征中选出5个关键特征，实现高精度葡萄酒分类。
Feature Selection and Regularization in Multi-Class Classification: An Empirical Study of One-vs-Rest Logistic Regression with Gradient Descent Optimization and L1 Sparsity Constraints
- 自研梯度下降实现92.59%准确率，验证理论有效性
- L1正则使特征减少54%-69%，仅损失4.63%准确率
- 选5个特征可降本80美元/样本，支持实时质检
多类葡萄酒分类面临模型精度、特征维度与可解释性之间的权衡，这对分析化学领域的生产部署至关重要。本文针对UCI Wine数据集（178个样本，3个品种，13个化学特征）开展全面实证研究，对比了手动梯度下降与scikit-learn优化求解器的性能，并量化L1正则化对特征稀疏性的影响。手动梯度下降实现92.59%平均测试准确率且收敛平滑，验证了理论基础；而scikit-learn提供24倍训练加速，达到98.15%准确率。类别特异性分析揭示不同品种间化学特征存在异质模式，其中色泽强度在品种间差异显著（0.31至16.50）。L1正则化使特征减少54%-69%，准确率仅下降4.63%，展现出良好的可解释性与性能权衡。我们提出一个最优5特征子集，实现62%复杂度降低，估计准确率达92%-94%，可实现每样本节省80美元成本、56%时间缩减。统计验证表明模型具备稳健泛化能力，预测延迟低于2毫秒，适合实时质量控制。研究结果为资源受限环境下平衡全面化学分析与目标特征测量提供了可操作指导。
原文摘要 · Abstract (English)
Multi-class wine classification presents fundamental trade-offs between model accuracy, feature dimensionality, and interpretability - critical factors for production deployment in analytical chemistry. This paper presents a comprehensive empirical study of One-vs-Rest logistic regression on the UCI Wine dataset (178 samples, 3 cultivars, 13 chemical features), comparing from-scratch gradient descent implementation against scikit-learn's optimized solvers and quantifying L1 regularization effects on feature sparsity. Manual gradient descent achieves 92.59 percent mean test accuracy with smooth convergence, validating theoretical foundations, though scikit-learn provides 24x training speedup and 98.15 percent accuracy. Class-specific analysis reveals distinct chemical signatures with heterogeneous patterns where color intensity varies dramatically (0.31 to 16.50) across cultivars. L1 regularization produces 54-69 percent feature reduction with only 4.63 percent accuracy decrease, demonstrating favorable interpretability-performance trade-offs. We propose an optimal 5-feature subset achieving 62 percent complexity reduction with estimated 92-94 percent accuracy, enabling cost-effective deployment with 80 dollars savings per sample and 56 percent time reduction. Statistical validation confirms robust generalization with sub-2ms prediction latency suitable for real-time quality control. Our findings provide actionable guidelines for practitioners balancing comprehensive chemical analysis against targeted feature measurement in resource-constrained environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。