用大模型自动分析信用卡欺诈警报,提升调查效率与准确率。
FAA Framework: A Large Language Model-Based Approach for Credit Card Fraud Investigations
- 利用多模态大模型自动收集证据并推理欺诈案情
- 在1500次调查后F1分数提升8%,尤其擅长处理模糊警报
- 适合需要快速响应、减轻分析师负担的风控团队
信用卡欺诈防范在现代社会中至关重要。尽管检测系统不可或缺,但难以跟上不断演化的欺诈手法。因此,欺诈调查成为重要补充环节,有助于改进检测模型、发现新型欺诈模式、向利益相关方提供案件解释,并维护客户信任。然而,欺诈分析师面临海量警报,每起调查需投入大量精力、专业知识和详尽记录,导致警报疲劳。为此,我们提出首个欺诈调查助手(FIA)框架,采用多模态大语言模型自动化信用卡欺诈调查的关键步骤,并生成可解释报告。FIA利用大模型的推理、代码执行和视觉能力,高效收集逻辑一致的证据,同时保持较短的调查路径。在Sparkov和CCTD数据集上的实验表明,随着对边缘案例的持续调查,F1分数逐步提升,仅经过1500次额外调查即实现8%的提升。结果表明,基于大模型的智能体可有效辅助自动化欺诈调查流程,特别适用于处理模糊警报。
原文摘要 · Abstract (English)
Credit card fraud mitigation plays a significant role in modern society. While fraud detection systems are essential, they often struggle to keep pace with the constantly evolving fraud techniques. As a result, fraud investigation is an important complementary process required for continuously improving detection models, identifying emerging fraud patterns, providing case explanations of to stakeholders, and maintaining customers' trust. However, fraud analysts are overwhelmed with an enormous number of alerts generated by credit card transaction monitoring systems. Each alert investigation requires careful attention, domain expertise, and thorough documentation of the investigation outcomes, leading to alert fatigue. To address this challenge, we introduce the first Fraud Investigation Assistant (FIA) framework, which employs multimodal large language models (LLMs) to automate key steps of credit card fraud investigation and generate explanatory reports. FIA leverages the reasoning, code execution, and vision capabilities of LLMs to collect relevant and logically consistent evidence while maintaining relatively short investigation trajectories. Experiments with the Sparkov and CCTD datasets show that FIA gradually improves the F1 score while investigating borderline cases, reaching 8% improvement after only 1,500 additional investigations. These results suggest that LLM-based agents can assist with automating substantial parts of the fraud investigation process and may be particularly useful for resolving ambiguous alerts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。