用投诉文本预测消费者能否获得赔偿,提升金融风险监测能力。
From Complaint Narratives to Monetary Relief: A Hybrid Machine Learning Framework for CFPB Consumer Complaints

- 融合文本、话题和公司信息的混合机器学习模型
- AUC-ROC从0.69提升至0.78,改善不平衡数据下的预测效果
- 可识别机构间赔偿差异,适合监管与风控人员使用
消费者金融投诉为识别金融机构服务缺陷、争议摩擦和运营不足提供了宝贵信息。本文提出一种基于消费者金融保护局(CFPB)投诉数据的混合机器学习框架,用于预测是否给予货币赔偿。将任务建模为不平衡二分类问题,将获得赔偿的投诉视为可补偿结果。框架整合了投诉文本、基于LDA的主题表示、可解释的文本工程特征以及公司、州等结构化属性。采用时间划分的训练测试集,使用早期投诉训练模型,近期投诉进行外部评估。相比TF-IDF基线,该框架显著提升预测性能,AUC-ROC从0.69增至0.78,并在类别不平衡下优化了PR-AUC。特征重要性分析表明,文本信号、潜在话题和公司身份均提供有效预测信息。尤其发现不同机构的投诉处理模式存在系统性差异。研究结果表明,消费者投诉文本可作为监测消费者损害、识别企业运营弱点及支持消费金融早期风险预警的替代数据。
原文摘要 · Abstract (English)
Consumer financial complaints provide a valuable source of information for identifying service failures, dispute frictions, and operational deficiencies in consumer-facing financial institutions. This paper proposes a hybrid machine learning framework for predicting monetary relief outcomes using Consumer Financial Protection Bureau complaint data. We formulate the task as an imbalanced binary classification problem, where complaints closed with monetary relief are treated as compensable outcomes. The proposed framework integrates multiple sources of predictive information, including complaint narrative text, LDA-based topic representations, interpretable text-engineered features, and structured categorical attributes such as company and state. An XGBoost classifier is trained using a temporal train-test split, with earlier complaints used for model development and more recent complaints reserved for out-of-sample evaluation. Compared with a TF-IDF baseline, the proposed framework substantially improves predictive performance, increasing AUC-ROC from 0.69 to 0.78 and improving PR-AUC under class imbalance. Feature importance analysis shows that textual signals, latent complaint topics, and company identity all contribute meaningful predictive information. In particular, company-level effects reveal systematic variation in complaint resolution patterns across financial institutions. These findings suggest that consumer complaint narratives can serve as alternative data for monitoring consumer harm, identifying firm-level operational weaknesses, and supporting early-stage risk surveillance in consumer finance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。