arXiv:2507.16672cs.LGcs.AI2025-07被引 6

用元学习实现LLM推荐系统冷启动快速个性化。

Meta-Learning for Cold-Start Personalization in Prompt-Tuned LLMs

  • 将用户视为任务,通过元学习优化可学习提示向量以实现高效个性化。
  • 在多个数据集上优于基线模型,且推理时间低于300毫秒。
  • 适合需要实时个性化的金融风控与推荐场景。

基于大语言模型的生成式、可解释且灵活的推荐系统在冷启动用户(无历史交互记录)场景下表现不佳。现有方法如监督微调和协同过滤依赖密集的用户-物品数据,维护成本高。本文提出一种元学习框架,通过一阶(Reptile)和二阶(MAML)优化,为每个用户学习软提示嵌入,实现参数高效的提示调优。这些可学习向量作为输入令牌的增强项,代表用户行为先验。模型通过周期采样、内层适应与外层泛化进行元优化。在MovieLens-1M、Amazon Reviews和Recbole数据集上,该方法在NDCG@10、HR@10和MRR指标上均超越强基线,且可在消费级GPU上实现实时推理(<300毫秒)。该方案支持零历史个性化,275毫秒的适配速度可显著缩短金融系统风险识别延迟,提升支付网络稳定性与国家金融基础设施韧性。

原文摘要 · Abstract (English)

Generative, explainable, and flexible recommender systems, derived using Large Language Models (LLM) are promising and poorly adapted to the cold-start user situation, where there is little to no history of interaction. The current solutions i.e. supervised fine-tuning and collaborative filtering are dense-user-item focused and would be expensive to maintain and update. This paper introduces a meta-learning framework, that can be used to perform parameter-efficient prompt-tuning, to effectively personalize LLM-based recommender systems quickly at cold-start. The model learns soft prompt embeddings with first-order (Reptile) and second-order (MAML) optimization by treating each of the users as the tasks. As augmentations to the input tokens, these learnable vectors are the differentiable control variables that represent user behavioral priors. The prompts are meta-optimized through episodic sampling, inner-loop adaptation, and outer-loop generalization. On MovieLens-1M, Amazon Reviews, and Recbole, we can see that our adaptive model outperforms strong baselines in NDCG@10, HR@10, and MRR, and it runs in real-time (i.e., below 300 ms) on consumer GPUs. Zero-history personalization is also supported by this scalable solution, and its 275 ms rate of adaptation allows successful real-time risk profiling of financial systems by shortening detection latency and improving payment network stability. Crucially, the 275 ms adaptation capability can enable real-time risk profiling for financial institutions, reducing systemic vulnerability detection latency significantly versus traditional compliance checks. By preventing contagion in payment networks (e.g., Fedwire), the framework strengthens national financial infrastructure resilience.

元学习冷启动提示调优金融风控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。