用多指标优化需求预测模型,提升稳定性与准确性。
Hierarchical Evaluation Function: A Multi-Metric Approach for Optimizing Demand Forecasting Models
- 设计分层评估函数HEF,融合R2、RMSE、MAE三类指标。
- 在M3和M5数据集上,显著优于单一指标优化方法。
- 适用于高粒度日级需求与异构月度序列,计算成本低。
在竞争激烈、不确定的商业环境中,需求预测需突破单指标超参数优化的局限。传统方法过度依赖单一误差指标,易因指标冲突导致结果偏差。为此提出分层评估函数(HEF),整合解释力(R2)、对极端误差的敏感性(RMSE)与平均精度(MAE)的多指标框架。在Walmart、M3、M4、M5四个主流基准数据集上,采用网格搜索、粒子群优化(PSO)和Optuna进行模型优化。基于比例差异检验的统计分析表明,无论使用何种优化器,HEF均显著优于单指标参考函数,尤其在异构月度时间序列(M3)和高度细粒度的日级需求场景(M5)中表现突出。结果证明,HEF以低计算开销实现更高稳定性、泛化性与鲁棒性,强化模型选择能力,提升预测精度,助力动态竞争环境下的决策制定。
原文摘要 · Abstract (English)
Demand forecasting in competitive, uncertain business environments requires models that can integrate multiple evaluation perspectives rather than being restricted to hyperparameter optimization based on a single metric. This traditional approach tends to prioritize one error indicator, which can bias results when metrics provide contradictory signals. In this context, the Hierarchical Evaluation Function (HEF) is proposed as a multi-metric framework for hyperparameter optimization that integrates explanatory power (R2), sensitivity to extreme errors (RMSE), and average accuracy (MAE). The performance of HEF was assessed using four widely recognized benchmark datasets in the forecasting domain: Walmart, M3, M4, and M5. Prediction models were optimized through Grid Search, Particle Swarm Optimization (PSO), and Optuna, and statistical analyses based on difference-of-proportions tests confirmed that HEF delivers superior results compared to a unimetric reference function, regardless of the optimizer employed, with particular relevance for heterogeneous monthly time series (M3) and highly granular daily demand scenarios (M5). The findings demonstrate that HEF improves stability, generalization, and robustness at low computational cost, consolidating its role as a reliable evaluation framework that enhances model selection, enables more accurate demand forecasts, and supports decision-making in dynamic, competitive business environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。