KAN在原始不平衡数据上表现优于MLP,但增益有限且计算成本高。
Kolmogorov Arnold Networks (KANs) for Imbalanced Data -- An Empirical Perspective
- 直接使用原始数据时,KAN比MLP更适应不平衡分类。
- 重采样和焦点损失会显著降低KAN性能,对MLP影响较小。
- 适合资源充足且无需传统数据增强的场景,当前实用性受限。
Kolmogorov Arnold Networks (KANs) 是一种基于数学理论的新型神经网络架构。本研究在十组基准数据集上对KANs在类别不平衡分类任务中的表现进行了实证评估。结果表明,KANs在未经任何重采样处理的原始不平衡数据上,能比多层感知机(MLPs)更有效地进行分类。然而,传统的不平衡处理策略(如重采样和焦点损失)与KANs的数学结构存在根本冲突,会导致其性能显著下降,而对MLPs则仅有微弱提升。更重要的是,KANs的计算开销极高,且未带来相应性能增益。统计检验显示,在多个指标上,使用不平衡技术的MLP与KANs性能差异极小(|d| < 0.08),但资源消耗远低于后者。研究揭示了KANs仅适用于资源充足、无需数据重采样的特定场景,其严重的性能-资源权衡及与标准方法的不兼容性限制了实际应用。未来应聚焦于开发适配不平衡学习的KAN结构改进、优化计算效率,并从理论上调和其与数据增强的矛盾。该工作为下一代KAN架构在不平衡分类中的发展奠定了基础。
原文摘要 · Abstract (English)
Kolmogorov Arnold Networks (KANs) are recent architectural advancement in neural computation that offer a mathematically grounded alternative to standard neural networks. This study presents an empirical evaluation of KANs in context of class imbalanced classification, using ten benchmark datasets. We observe that KANs can inherently perform well on raw imbalanced data more effectively than Multi-Layer Perceptrons (MLPs) without any resampling strategy. However, conventional imbalance strategies fundamentally conflict with KANs mathematical structure as resampling and focal loss implementations significantly degrade KANs performance, while marginally benefiting MLPs. Crucially, KANs suffer from prohibitive computational costs without proportional performance gains. Statistical validation confirms that MLPs with imbalance techniques achieve equivalence with KANs (|d| < 0.08 across metrics) at minimal resource costs. These findings reveal that KANs represent a specialized solution for raw imbalanced data where resources permit. But their severe performance-resource tradeoffs and incompatibility with standard resampling techniques currently limits practical deployment. We identify critical research priorities as developing KAN specific architectural modifications for imbalance learning, optimizing computational efficiency, and theoretical reconciling their conflict with data augmentation. This work establishes foundational insights for next generation KAN architectures in imbalanced classification scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。