混合KAN与gMLP模型,高效处理大规模金融表格数据
Beyond Tree Models: A Hybrid Model of KAN and gMLP for Large-Scale Financial Tabular Data
- 结合KAN与gMLP构建混合神经网络,提升表格式数据建模能力
- 在真实信贷评分数据集上达到顶尖性能,且数据量越大效果越优
- 提出专为数值特征设计的编码方法,显著提升金融数据预测精度
表格数据在实际金融场景中至关重要。传统上树模型主导表格式数据处理,但工业级金融数据常面临数据异构性、数值特征主导及数据规模巨大(达数千万至数亿条记录)等挑战,导致树模型出现显著内存与计算瓶颈。为此,本文提出TKGMLP——一种融合浅层Kolmogorov-Arnold网络与门控多层感知机的混合模型,充分发挥两类架构优势,提升性能与可扩展性。在真实信贷评分数据集上验证,该模型达到当前最优水平,并随数据规模增大持续提升表现。此外,我们设计了一种针对金融数据中数值特征主导问题的新型特征编码方法,集成后显著提高预测准确率。本研究不仅推动表格数据预测技术发展,也为工业界大规模数值型表格数据处理提供实用有效方案。
原文摘要 · Abstract (English)
Tabular data plays a critical role in real-world financial scenarios. Traditionally, tree models have dominated in handling tabular data. However, financial datasets in the industry often encounter some challenges, such as data heterogeneity, the predominance of numerical features and the large scale of the data, which can range from tens of millions to hundreds of millions of records. These challenges can lead to significant memory and computational issues when using tree-based models. Consequently, there is a growing need for neural network-based solutions that can outperform these models. In this paper, we introduce TKGMLP, an hybrid network for tabular data that combines shallow Kolmogorov Arnold Networks with Gated Multilayer Perceptron. This model leverages the strengths of both architectures to improve performance and scalability. We validate TKGMLP on a real-world credit scoring dataset, where it achieves state-of-the-art results and outperforms current benchmarks. Furthermore, our findings demonstrate that the model continues to improve as the dataset size increases, making it highly scalable. Additionally, we propose a novel feature encoding method for numerical data, specifically designed to address the predominance of numerical features in financial datasets. The integration of this feature encoding method within TKGMLP significantly improves prediction accuracy. This research not only advances table prediction technology but also offers a practical and effective solution for handling large-scale numerical tabular data in various industrial applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。