arXiv:2501.17411cs.NEcs.AI2025-01被引 1

用遗传算法自动优化可解释的KAN网络,提升分类性能并减少参数量。

A Genetic Algorithm-Based Approach for Automated Optimization of Kolmogorov-Arnold Networks in Classification Tasks

  • 用遗传算法自动搜索最优KAN结构,无需人工调参。
  • 在5个数据集上超越传统方法,参数量显著降低。
  • 生成可读符号公式,适合需要透明模型的场景。

为解决多层感知机(MLPs)可解释性差的问题,2024年提出了柯尔莫戈罗夫-阿诺德网络(KAN)。然而,优化KAN结构通常需大量人工干预和参数调优。本文提出GA-KAN,一种基于遗传算法的自动化优化方法,首次将进化计算用于自动优化KAN,实现端到端设计。受MLPs中稀疏连接启发,GA-KAN引入稀疏结构以应对KAN庞大的参数空间。在两个模拟数据集上,GA-KAN无需手动调参即可取得最优结果;在五个分类数据集上均优于传统方法,并为Wine和Iris数据集生成可解释的符号公式,增强模型透明性。同时,相较于标准KAN,GA-KAN在所有五组数据上显著减少参数量。核心贡献包括自动化优化、新型编码策略与解码流程,共同提升准确率、可解释性并压缩参数规模。

原文摘要 · Abstract (English)

To address the issue of interpretability in multilayer perceptrons (MLPs), Kolmogorov-Arnold Networks (KANs) are introduced in 2024. However, optimizing KAN structures is labor-intensive, typically requiring manual intervention and parameter tuning. This paper proposes GA-KAN, a genetic algorithm-based approach that automates the optimization of KANs, requiring no human intervention in the design process. To the best of our knowledge, this is the first time that evolutionary computation is explored to optimize KANs automatically. Furthermore, inspired by the use of sparse connectivity in MLPs in effectively reducing the number of parameters, GA-KAN further explores sparse connectivity to tackle the challenge of extensive parameter spaces in KANs. GA-KAN is validated on two toy datasets, achieving optimal results without the manual tuning required by the original KAN. Additionally, GA-KAN demonstrates superior performance across five classification datasets, outperforming traditional methods on all datasets and providing interpretable symbolic formulae for the Wine and Iris datasets, thereby enhancing model transparency. Furthermore, GA-KAN significantly reduces the number of parameters over the standard KAN across all the five datasets. The core contributions of GA-KAN include automated optimization, a new encoding strategy, and a new decoding process, which together improve the accuracy and interpretability, and reduce the number of parameters.

KAN遗传算法可解释性自动化设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。