arXiv:2601.14672cs.NEcs.AI2026-01

混合金鹰与遗传算法,高效优化神经网络超参数。

GEGO: A Hybrid Golden Eagle and Genetic Optimization Algorithm for Efficient Hyperparameter Tuning in Resource-Constrained Environments

  • 将遗传操作嵌入金鹰算法迭代过程,提升搜索多样性。
  • 在CEC2017测试集上优于经典算法,收敛更稳定。
  • 适合计算资源受限场景下的超参数调优任务。

超参数调优是训练神经网络中关键但计算成本高昂的步骤,尤其在高维非凸搜索空间中。本文提出黄金鹰遗传优化(GEGO)算法,融合金鹰优化(GEO)的种群迁移策略与遗传算法的选择、交叉、变异算子。其核心创新在于将遗传操作直接嵌入GEO的迭代搜索过程,而非作为独立演化阶段,从而增强种群多样性,降低早熟收敛风险,同时保留GEO的探索能力。GEGO在CEC2017标准基准函数集(包括单峰、多峰和复合函数)上持续优于其组成算法及多个经典元启发式算法,在解质量与鲁棒性方面表现更优。进一步应用于MNIST数据集上的神经网络超参数调优,GEGO实现更高分类准确率与更稳定的收敛性能,相较GEO和GA均有提升。结果表明,GEGO在探索与利用之间取得良好平衡,适用于计算资源受限环境下的超参数优化。

原文摘要 · Abstract (English)

Hyperparameter tuning is a critical yet computationally expensive step in training neural networks, particularly when the search space is high dimensional and nonconvex. Metaheuristic optimization algorithms are often used for this purpose due to their derivative free nature and robustness against local optima. In this work, we propose Golden Eagle Genetic Optimization (GEGO), a hybrid metaheuristic that integrates the population movement strategy of Golden Eagle Optimization with the genetic operators of selection, crossover, and mutation. The main novelty of GEGO lies in embedding genetic operators directly into the iterative search process of GEO, rather than applying them as a separate evolutionary stage. This design improves population diversity during search and reduces premature convergence while preserving the exploration behavior of GEO. GEGO is evaluated on standard unimodal, multimodal, and composite benchmark functions from the CEC2017 suite, where it consistently outperforms its constituent algorithms and several classical metaheuristics in terms of solution quality and robustness. The algorithm is further applied to hyperparameter tuning of artificial neural networks on the MNIST dataset, where GEGO achieves improved classification accuracy and more stable convergence compared to GEO and GA. These results indicate that GEGO provides a balanced exploration-exploitation tradeoff and is well suited for hyperparameter optimization under constrained computational settings.

超参数优化元启发式遗传算法金鹰算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。