用自监督对比学习捕捉金融交易时序模式,提升反欺诈检测能力。
Temporal Contrastive Transformer for Financial Crime Detection: Self-Supervised Sequence Embeddings via Predictive Contrastive Coding
- 通过预测性对比编码构建时序对比变压器,自学习交易序列特征。
- 仅用学习嵌入即达AUC 0.8644,证明模型捕获了非平凡时序结构。
- 虽未超越人工特征基线,但为减少特征工程提供新方向。
我们提出时间对比变压器(TCT),一种用于捕捉金融交易序列上下文时序动态的表示学习框架。该模型通过自监督对比目标训练,生成编码行为模式的时间嵌入,以支持下游欺诈检测任务。在真实场景中,将学习到的嵌入作为梯度提升分类器的输入特征进行评估。实验结果表明,仅使用嵌入即实现有意义的预测性能(AUC 0.8644),说明模型成功捕获了非平凡的时序结构。然而,当与领域工程特征结合时,性能提升不显著(基线AUC 0.9205 vs. 融合后AUC 0.9245),表明学习表征与现有特征抽象高度重叠。这些发现将TCT定位为有前景的表示学习方法,同时揭示了在强领域特征基础上实现增量价值的挑战。当前阶段的结果反映时序表示学习在金融犯罪检测中的中间进展,激励未来在模型架构、训练目标和融合策略上的研究。在早期阶段,达到与强特征工程基线相当的性能本身已是重要成果,表明学习表征可近似领域特异性特征而无需人工设计。尽管尚未具备生产可用性,但结果指明了减少特征工程依赖的可行路径。
原文摘要 · Abstract (English)
We introduce the Temporal Contrastive Transformer (TCT), a representation learning framework designed to capture contextual temporal dynamics in sequences of financial transactions. The model is trained using a self-supervised contrastive objective to produce embeddings that encode behavioral patterns over time, with the goal of supporting downstream fraud detection tasks. We evaluate TCT in a realistic setting by using the learned embeddings as input features to a gradient boosting classifier. Experimental results show that embeddings alone achieve meaningful predictive performance (AUC 0.8644), indicating that the model captures non-trivial temporal structure. However, when combined with domain-engineered features, no measurable improvement is observed over the baseline (AUC 0.9205 vs. 0.9245), suggesting that the learned representations largely overlap with existing feature abstractions. These findings position TCT as a promising representation learning approach that captures relevant behavioral signal, while highlighting the challenges of achieving additive value over strong domain features. The results reflect an intermediate stage in the development of temporal representation learning for financial crime detection and motivate further research on model architecture, training objectives, and integration strategies. At this early stage, achieving performance comparable to a strong feature-engineered baseline is itself a meaningful outcome, indicating that learned representations approximate domain-specific features without manual engineering. While not yet production-ready, these results point to a promising direction for reducing reliance on feature engineering in financial crime detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。