用NLP提升支付数据实体识别准确率,最高达95.7%
Named Entity Recognition for Payment Data Using NLP
- 融合金融领域嵌入与上下文表示的混合模型
- 在5万条支付数据上实现95.7%的F1分数
- 适合金融机构做反洗钱和自动化支付系统
命名实体识别(NER)已成为自动化金融交易处理的关键技术,尤其在从非结构化支付数据中提取结构化信息方面。本文针对支付数据提取任务,全面分析了先进的NER算法,包括条件随机场(CRF)、双向长短期记忆网络结合CRF(BiLSTM-CRF)以及基于Transformer的BERT和FinBERT模型。我们在包含5万条标注支付交易的数据集上进行了大量实验,涵盖SWIFT MT103、ISO 20022及国内支付系统等多种格式。结果表明,微调后的BERT模型在实体提取上达到94.2%的F1分数,比传统CRF方法高出12.8个百分点。此外,我们提出PaymentBERT,一种结合领域特定金融嵌入与上下文表示的新型混合架构,在保持实时处理能力的同时,实现95.7%的F1分数,达到当前最优水平。研究还提供了跨格式泛化性分析、消融实验和部署建议。该工作为金融机构实施自动化制裁筛查、反洗钱(AML)合规与支付系统提供了实用参考。
原文摘要 · Abstract (English)
Named Entity Recognition (NER) has emerged as a critical component in automating financial transaction processing, particularly in extracting structured information from unstructured payment data. This paper presents a comprehensive analysis of state-of-the-art NER algorithms specifically designed for payment data extraction, including Conditional Random Fields (CRF), Bidirectional Long Short-Term Memory with CRF (BiLSTM-CRF), and transformer-based models such as BERT and FinBERT. We conduct extensive experiments on a dataset of 50,000 annotated payment transactions across multiple payment formats including SWIFT MT103, ISO 20022, and domestic payment systems. Our experimental results demonstrate that fine-tuned BERT models achieve an F1-score of 94.2% for entity extraction, outperforming traditional CRF-based approaches by 12.8 percentage points. Furthermore, we introduce PaymentBERT, a novel hybrid architecture combining domain-specific financial embeddings with contextual representations, achieving state-of-the-art performance with 95.7% F1-score while maintaining real-time processing capabilities. We provide detailed analysis of cross-format generalization, ablation studies, and deployment considerations. This research provides practical insights for financial institutions implementing automated sanctions screening, anti-money laundering (AML) compliance, and payment processing systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。