arXiv:2409.10111cs.LGcs.CE2024-09被引 2

延迟标签下,批量学习比实例增量学习更优。

Evaluating the Efficacy of Instance Incremental vs. Batch Learning in Delayed Label Environments: An Empirical Study on Tabular Data Streaming for Fraud Detection

  • 对比实例与批量增量学习在延迟标签场景下的表现
  • 实证发现批量学习在准确率与效率上更胜一筹
  • 适合关注可解释性与实际部署的风控系统研究者

现实中的表格数据流场景通常涉及持续到来的数据,其分布可能随时间变化。现有文献中多数监督学习研究倾向使用实例增量算法,因其能适应数据分布变化,且避免存储观测数据(区别于批量增量)。然而,实例增量算法通常假设标签即时可用,这一假设在现实中不成立,如欺诈检测或信用评分中常存在标签延迟。因此,批量增量算法在真实任务中被广泛采用。本文针对此问题,在真实欺诈检测数据及常用生成数据集上开展全面实证研究。结果表明,在延迟标签环境下,实例增量学习并非最优选择——以自适应随机森林(ARF)为代表的先进模型,性能不及以XGBoost为代表的批量学习模型。此外,批量学习在系统可解释性方面也更具优势。

原文摘要 · Abstract (English)

Real-world tabular learning production scenarios typically involve evolving data streams, where data arrives continuously and its distribution may change over time. In such a setting, most studies in the literature regarding supervised learning favor the use of instance incremental algorithms due to their ability to adapt to changes in the data distribution. Another significant reason for choosing these algorithms is \textit{avoid storing observations in memory} as commonly done in batch incremental settings. However, the design of instance incremental algorithms often assumes immediate availability of labels, which is an optimistic assumption. In many real-world scenarios, such as fraud detection or credit scoring, labels may be delayed. Consequently, batch incremental algorithms are widely used in many real-world tasks. This raises an important question: "In delayed settings, is instance incremental learning the best option regarding predictive performance and computational efficiency?" Unfortunately, this question has not been studied in depth, probably due to the scarcity of real datasets containing delayed information. In this study, we conduct a comprehensive empirical evaluation and analysis of this question using a real-world fraud detection problem and commonly used generated datasets. Our findings indicate that instance incremental learning is not the superior option, considering on one side state-of-the-art models such as Adaptive Random Forest (ARF) and other side batch learning models such as XGBoost. Additionally, when considering the interpretability of the learning systems, batch incremental solutions tend to be favored. Code: \url{https://github.com/anselmeamekoe/DelayedLabelStream}

增量学习欺诈检测数据流延迟标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。