用分布预测取代逐对判断,让大模型高效处理百亿级冷启动推荐。
FilterLLM: Text-To-Distribution LLM for Billion-Scale Cold-Start Recommendation
- 提出文本到分布的新范式,单次推理预测全用户集的交互概率。
- 在阿里巴巴平台部署,处理超10亿冷启动商品,效率提升30倍以上。
- 适合需要海量冷启动推荐的工业场景,如电商、内容平台。
基于大语言模型(LLM)的冷启动推荐系统在百亿规模场景下仍面临显著计算挑战,因其采用“文本到判断”范式,需逐对评估用户-物品内容,依赖预筛选小候选池以维持效率,严重限制了大模型的推理能力。为此,本文提出“文本到分布”新范式,实现单次推理中对全用户集的物品交互概率分布预测。我们构建FilterLLM框架,扩展大模型的下一个词预测能力至百亿级过滤任务:首先设计适配分布预测与冷启动的架构;其次引入高效用户词表结构,实现百亿级用户嵌入的训练与存储;最后定义分布预测与用户词表构建的联合训练目标。该框架已在阿里巴巴平台上线,持续服务两个月,处理超过10亿冷启动商品。大量实验表明,FilterLLM在冷启动推荐任务中显著优于现有方法,效率提升超30倍;线上A/B测试进一步验证其在百亿级推荐系统中的有效性。
原文摘要 · Abstract (English)
Large Language Model (LLM)-based cold-start recommendation systems continue to face significant computational challenges in billion-scale scenarios, as they follow a "Text-to-Judgment" paradigm. This approach processes user-item content pairs as input and evaluates each pair iteratively. To maintain efficiency, existing methods rely on pre-filtering a small candidate pool of user-item pairs. However, this severely limits the inferential capabilities of LLMs by reducing their scope to only a few hundred pre-filtered candidates. To overcome this limitation, we propose a novel "Text-to-Distribution" paradigm, which predicts an item's interaction probability distribution for the entire user set in a single inference. Specifically, we present FilterLLM, a framework that extends the next-word prediction capabilities of LLMs to billion-scale filtering tasks. FilterLLM first introduces a tailored distribution prediction and cold-start framework. Next, FilterLLM incorporates an efficient user-vocabulary structure to train and store the embeddings of billion-scale users. Finally, we detail the training objectives for both distribution prediction and user-vocabulary construction. The proposed framework has been deployed on the Alibaba platform, where it has been serving cold-start recommendations for two months, processing over one billion cold items. Extensive experiments demonstrate that FilterLLM significantly outperforms state-of-the-art methods in cold-start recommendation tasks, achieving over 30 times higher efficiency. Furthermore, an online A/B test validates its effectiveness in billion-scale recommendation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。