用大模型理解支付交易,提升异常检测与个性化推荐效果
TREASURE: The Visa Payment Foundation Model for High-Volume Transaction Understanding
- 基于Transformer构建通用支付数据编码器,融合用户行为与网络信号
- 异常检测准确率比现有系统高111%,推荐模型性能提升104%
- 适合支付风控、智能推荐等工业级场景使用
支付网络支撑现代商业运行,每日产生海量交易记录。正确建模此类数据可实现异常行为检测与消费者级洞察,助力个性化体验并改善生活。本文提出TREASURE(TRansformer Engine As Scalable Universal transaction Representation Encoder),一个专为交易数据设计的多功能Transformer基础模型。该模型同时捕捉用户行为与支付网络信号(如响应码和系统标志),为精准推荐系统与异常行为检测提供全面信息。在工业级数据集上验证,TREASURE具备三大能力:1)包含静态与动态属性专用子模块的输入结构,提升训练与推理效率;2)针对高基数分类属性的高效有效训练范式;3)作为独立模型时,异常检测性能比生产系统提升111%;作为嵌入提供者时,推荐模型性能提升104%。通过大量消融实验、与生产模型对比及案例研究,揭示了TREASURE开发中的关键洞见。
原文摘要 · Abstract (English)
Payment networks form the backbone of modern commerce, generating high volumes of transaction records from daily activities. Properly modeling this data can enable applications such as abnormal behavior detection and consumer-level insights for hyper-personalized experiences, ultimately improving people's lives. In this paper, we present TREASURE, TRansformer Engine As Scalable Universal transaction Representation Encoder, a multipurpose transformer-based foundation model specifically designed for transaction data. The model simultaneously captures both consumer behavior and payment network signals (such as response codes and system flags), providing comprehensive information necessary for applications like accurate recommendation systems and abnormal behavior detection. Verified with industry-grade datasets, TREASURE features three key capabilities: 1) an input module with dedicated sub-modules for static and dynamic attributes, enabling more efficient training and inference; 2) an efficient and effective training paradigm for predicting high-cardinality categorical attributes; and 3) demonstrated effectiveness as both a standalone model that increases abnormal behavior detection performance by 111% over production systems and an embedding provider that enhances recommendation models by 104%. We present key insights from extensive ablation studies, benchmarks against production models, and case studies, highlighting valuable knowledge gained from developing TREASURE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。