arXiv:2606.07582cs.LGcs.AI2026-06被引 2

用混合模型提升银行客户流失预测准确率,效果优于传统方法。

Customer Churn Prediction on Structured Data Using FT-Transformer and Stacking Ensembles

论文配图:Customer Churn Prediction on Structured Data Using FT-Transformer and Stacking Ensembles
图 1 · 摘自论文原文
  • 结合FT-Transformer与梯度提升树,通过堆叠集成捕捉复杂特征关系。
  • 在公开银行数据集上达到62.10% F1、0.861 AUC-ROC,显著优于MLP基线。
  • 方法可复现且适合需要高精度概率预测的工业场景。

客户流失预测在保险、数字银行、电商和订阅平台等数据驱动行业至关重要,保留现有客户通常比获取新客户更经济。基于结构化数据的流失预测面临类别不平衡、非线性特征交互和异质特征类型等挑战。树模型在该场景中表现稳定,常优于传统神经网络。本文提出一种经验证的混合架构:将特征分词变换器(FT-Transformer)与梯度提升树通过校准感知堆叠集成。该框架解决了以往研究中统计验证不足、概率校准缺失和可复现性差的问题。FT-Transformer利用自注意力捕捉高阶特征交互,而XGBoost则学习梯度提升决策边界,二者具备互补归纳偏置。类别不平衡通过加权损失函数处理,避免合成过采样并保留少数类分布。模型采用留出折叠(OOF)堆叠与逻辑回归元学习器集成,重新校准基模型的过度自信输出,并学习最优组合权重。在公开银行流失数据集上,该混合模型实现62.10% F1、0.861 AUC-ROC和0.647 PR-AUC,相比多层感知机(MLP)基线提升3.37 F1点和0.027 AUC,5×5交叉验证下95%置信区间已报告。消融实验表明,变压器组件与堆叠策略均对性能有显著贡献。该方法为结构化表格数据上的现代流失预测提供了可复现、可扩展的参考架构。

原文摘要 · Abstract (English)

Customer churn prediction is essential across data-driven industries such as insurance, digital banking, eCommerce, and subscription platforms, where retaining existing customers is typically more cost-effective than acquiring new ones. Predicting churn on structured datasets remains challenging due to class imbalance, nonlinear feature interactions, and heterogeneous feature types. Tree-based ensemble methods consistently demonstrate strong performance in these contexts, often outperforming conventional neural networks. This study introduces a validated hybrid architecture that integrates feature-tokenized transformers (FT-Transformer) with gradient-boosted trees through calibration-aware stacking. The proposed framework addresses persistent gaps in statistical validation, probability calibration, and reproducibility found in prior research. The FT-Transformer captures higher-order feature interactions using self-attention, while XGBoost captures gradient-boosted decision boundaries with complementary inductive biases. Class imbalance is handled using class-weighted loss functions, thereby avoiding synthetic oversampling and preserving minority-class distributions. The models are ensembled using out-of-fold (OOF) stacking with a logistic regression meta-learner, which recalibrates overconfident base model outputs and learns optimal combination weights. On a public bank churn dataset, the hybrid model achieves 62.10% F1, 0.861 AUC-ROC, and 0.647 PR-AUC, outperforming the Multi-Layer Perceptron (MLP) baseline by 3.37 F1 points and 0.027 AUC under 5x5 cross-validation with 95% confidence intervals reported. Ablation studies demonstrate that both the transformer component and stacking strategy contribute materially to performance. The proposed methodology offers a reproducible and extensible reference architecture for contemporary churn prediction on structured tabular data.

客户流失集成学习Transformer金融风控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。