通过分析超参交互,让调参从盲目试错变成有方向的优化。
From Black-Box Tuning to Guided Optimization via Hyperparameters Interaction Analysis
- 用元学习和SHAP值构建可解释的超参重要性模型
- 在超100万条训练记录上验证,能精准识别关键超参与影响区间
- 适合需要高效调参的机器学习实践者和算法工程师
超参数调优是优化机器学习模型的基础步骤,但计算成本高。理解超参数间的相对重要性和交互关系对高效模型开发至关重要。本文提出MetaSHAP,一种可扩展的半自动化可解释人工智能方法,结合元学习与Shapley值分析,提供可操作且数据感知的调参洞察。该方法基于超过100万条评估过的机器学习流水线,生成可解释的重要性评分和行动建议,揭示每个超参数的影响程度、与其他超参数的交互方式以及其影响集中的取值范围。对于特定算法与数据集,MetaSHAP从历史配置中学习代理性能模型,利用基于SHAP的分析计算超参数交互,并从最具影响力的超参数中推导出可解释的调优区间。这使从业者不仅能确定优先调参项,还能理解其方向性与相互作用。我们在包含164个分类数据集和14种分类器的多样化基准上实证验证了MetaSHAP,结果表明其能生成可靠的超参数重要性排序,并在引导贝叶斯优化时表现出竞争力。
原文摘要 · Abstract (English)
Hyperparameters tuning is a fundamental, yet computationally expensive, step in optimizing machine learning models. Beyond optimization, understanding the relative importance and interaction of hyperparameters is critical to efficient model development. In this paper, we introduce MetaSHAP, a scalable semi-automated eXplainable AI (XAI) method, that uses meta-learning and Shapley values analysis to provide actionable and dataset-aware tuning insights. MetaSHAP operates over a vast benchmark of over 09 millions evaluated machine learning pipelines, allowing it to produce interpretable importance scores and actionable tuning insights that reveal how much each hyperparameter matters, how it interacts with others and in which value ranges its influence is concentrated. For a given algorithm and dataset, MetaSHAP learns a surrogate performance model from historical configurations, computes hyperparameters interactions using SHAP-based analysis, and derives interpretable tuning ranges from the most influential hyperparameters. This allows practitioners not only to prioritize which hyperparameters to tune, but also to understand their directionality and interactions. We empirically validate MetaSHAP on a diverse benchmark of 164 classification datasets and 14 classifiers, demonstrating that it produces reliable importance rankings and competitive performance when used to guide Bayesian optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。