arXiv:2608.14198cs.LGcs.CL2026-08

MINT让金融交易数据零样本预测更准更快

MINT: A Universal Zero-Shot Predictor for Transaction Data

论文配图:MINT: A Universal Zero-Shot Predictor for Transaction Data
图 1 · 摘自论文原文
  • 用轻量嵌入注入连接交易编码器与语言模型
  • 在分布内/外任务上均达顶尖零样本问答性能
  • 比文本序列化方案节省大量计算资源

银行分析序列化金融交易数据以完成反欺诈、信用风险评估和个性化推荐等任务。现有支付基础模型虽能生成丰富的上下文嵌入,但不支持跨新任务的灵活零样本推理,限制了其适应性。当前基于大模型的零样本方法常因依赖昂贵的文本序列化或专用架构而表现不佳且难以扩展。为此,我们提出多模态指令交易网络(MINT),通过轻量嵌入注入、交易-语言对齐与指令微调,将预训练交易序列编码器与仅解码器型大模型连接。实验表明,MINT在分布内与分布外问题上均实现最先进的问答性能,同时显著降低输入词元数、延迟和内存消耗。通过深入分析表示、对齐策略、训练数据及历史长度,我们证明紧凑的交易嵌入优于文本序列化,是多模态推理与零样本预测的更优选择。

原文摘要 · Abstract (English)

Banks analyse sequential financial transaction data to perform many tasks, including fraud prevention, credit risk assessment and offer personalization. To improve the predictive accuracy of these tasks, Payments Foundation Models encode transaction sequence data as rich contextual embeddings, which can then be provided to task-specific models as features. However, these Foundation Models are not designed for flexible zero-shot reasoning across novel downstream prediction tasks, limiting their adaptability and utility. Existing LLM-based approaches to zero-shot prediction often fail to fully exploit the predictive signal within transaction data, while relying on costly text serialization or task-specific architectures that scale poorly. To address these limitations, we present the Multimodal Instruction Network for Transactions (MINT), a framework that connects a pretrained transaction sequence encoder to a decoder-only LLM through lightweight embedding injection, transaction-language alignment, and instruction tuning. We find that MINT achieves state-of-the-art predictive question-answering performance in both in-distribution and out-of-distribution questions, while substantially reducing input tokens, latency, and memory consumption compared to text-serialization baselines. Through comprehensive analyses of representations, alignment strategies, training data, and history length, we establish that compact transaction embeddings are a superior approach to transaction representation than text serialization for multimodal reasoning and zero-shot prediction tasks.

零样本预测金融交易大模型嵌入注入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。