arXiv:2601.05578cs.AIcs.CE2026-01被引 1

用强化学习训练小模型,从交易文本中自动发现新欺诈线索。

Reinforcement Learning of Large Language Models for Interpretable Credit Card Fraud Detection

  • 用强化学习+规则奖励,让语言模型从原始交易数据学判别风险。
  • 在真实支付数据上,F1分数显著提升,优于传统特征方法。
  • 适合想提升可解释性、挖掘隐蔽欺诈模式的金融安全研究者。

电商平台与支付服务商面临日益复杂的欺诈手段,涵盖身份盗用、账户劫持及利用数字交易速度与匿名性的洗钱操作。尽管大语言模型(LLMs)理论上具有潜力,但在真实金融场景中的应用仍少有验证,其对电商交易数据的实证有效性尚未明确。为此,本文提出一种新方法:使用强化学习(RL)对轻量级语言模型进行后训练,仅依赖原始交易数据完成欺诈检测任务。采用组序列策略优化(GSPO)算法结合规则奖励系统,在某中国全球支付公司提供的真实交易数据集上,对不同规模的语言模型进行微调。通过该强化学习框架,模型被鼓励探索客户信息、配送细节、商品描述和订单历史中嵌入的多样化信任与风险信号。实验结果表明,后训练模型在保留测试集上实现显著的F1分数提升,性能增长主要归因于强化学习的探索机制,使模型能够发现超越传统人工特征的新欺诈指标。

原文摘要 · Abstract (English)

E-commerce platforms and payment solution providers face increasingly sophisticated fraud schemes, ranging from identity theft and account takeovers to complex money laundering operations that exploit the speed and anonymity of digital transactions. However, despite their theoretical promise, the application of Large Language Models (LLMs) to fraud detection in real-world financial contexts remains largely unexploited, and their practical effectiveness in handling domain-specific e-commerce transaction data has yet to be empirically validated. To bridge this gap between conventional machine learning limitations and the untapped potential of LLMs in fraud detection, this paper proposes a novel approach that employs Reinforcement Learning (RL) to post-train lightweight language models specifically for fraud detection tasks using only raw transaction data. We utilize the Group Sequence Policy Optimization (GSPO) algorithm combined with a rule-based reward system to fine-tune language models of various sizes on a real-life transaction dataset provided by a Chinese global payment solution company. Through this reinforcement learning framework, the language models are encouraged to explore diverse trust and risk signals embedded within the textual transaction data, including patterns in customer information, shipping details, product descriptions, and order history. Our experimental results demonstrate the effectiveness of this approach, with post-trained language models achieving substantial F1-score improvements on held-out test data. Our findings demonstrate that the observed performance improvements are primarily attributable to the exploration mechanism inherent in reinforcement learning, which allows models to discover novel fraud indicators beyond those captured by traditional engineered features.

欺诈检测强化学习语言模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。