用指令微调大模型,精准预测用户消费行为。
Instruction-Based Fine-tuning of Open-Source LLMs for Predicting Customer Purchase Behaviors
- 将交易数据转为自然语言,用LoRA微调Mistral模型。
- 在生鲜、服装、加油站三类上F1分数显著更高。
- 适合做个性化营销的金融场景研究者参考。
本研究评估了多种预测模型(包括概率基线、CNN、LSTM和微调的大语言模型)在从金融交易数据中预测商户类别方面的表现。基于Bank A的数据训练、Bank B的数据测试,证明了采用客户数据自然语言格式进行指令微调的Mistral Instruct模型具有优越的预测能力。该方法通过LoRA对Mistral模型进行指令微调,使其预训练知识适配金融交易领域。微调后的模型在生鲜、服装、加油站三个关键商户类别上的F1分数显著优于传统序列模型,归因于其更强的语义理解与对少数类的处理能力,从而提升了交易类别预测准确性。结果表明大语言模型在预测人类行为方面具有巨大潜力。
原文摘要 · Abstract (English)
In this study, the performance of various predictive models, including probabilistic baseline, CNN, LSTM, and finetuned LLMs, in forecasting merchant categories from financial transaction data have been evaluated. Utilizing datasets from Bank A for training and Bank B for testing, the superior predictive capabilities of the fine-tuned Mistral Instruct model, which was trained using customer data converted into natural language format have been demonstrated. The methodology of this study involves instruction fine-tuning Mistral via LoRA (LowRank Adaptation of Large Language Models) to adapt its vast pre-trained knowledge to the specific domain of financial transactions. The Mistral model significantly outperforms traditional sequential models, achieving higher F1 scores in the three key merchant categories of bank transaction data (grocery, clothing, and gas stations) that is crucial for targeted marketing campaigns. This performance is attributed to the model's enhanced semantic understanding and adaptability which enables it to better manage minority classes and predict transaction categories with greater accuracy. These findings highlight the potential of LLMs in predicting human behavior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。