解决大模型在个性化搜索中语义退化问题,提升推荐效果。
KARMA: Knowledge-Action Regularized Multimodal Alignment for Personalized Search at Taobao
- 用双重约束保持语义可解码性,防止模型注意力坍缩。
- 在淘宝搜索中实现点击率提升0.25,商品成交额增长0.9%。
- 适合需要兼顾语义理解与个性化行为的推荐系统场景。
大语言模型具备丰富的语义知识,是注入个性化搜索系统语义泛化能力的理想选择。然而实践中发现,直接在工业级个性化任务(如下一物品预测)上微调大模型往往效果不佳。我们归因于关键的‘知识-行为鸿沟’:保留预训练语义知识与通过判别目标对齐个性化行为之间存在根本冲突。实证表明,仅基于行为的目标会导致语义坍缩,如注意力‘黑洞’现象,严重削弱模型泛化能力。为此提出KARMA(知识-行为正则化多模态对齐)框架,将语义重建作为仅训练阶段的正则项。KARMA在优化检索嵌入(行为)的同时,通过两项互补目标保持语义可解码性:(i) 历史条件下的语义生成,锚定于LLM原生的下一个词分布;(ii) 嵌入条件下的语义重建,约束兴趣嵌入保持语义可恢复性。在淘宝搜索系统上,KARMA缓解了语义坍缩(注意力黑洞分析),并同时提升行为指标与语义保真度。消融实验显示,语义可解码性带来最高+22.5 HR@200。部署后,在排序与预排序阶段实现低推理开销,分别取得+0.25 CTR AUC、+1.86 HR、+2.51 HR提升,线上部署带动GMV增加0.9%。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are equipped with profound semantic knowledge, making them a natural choice for injecting semantic generalization into personalized search systems. However, in practice we find that directly fine-tuning LLMs on industrial personalized tasks (e.g. next item prediction) often yields suboptimal results. We attribute this bottleneck to a critical Knowledge--Action Gap: the inherent conflict between preserving pre-trained semantic knowledge and aligning with specific personalized actions by discriminative objectives. Empirically, action-only training objectives induce Semantic Collapse, such as attention "sinks". This degradation severely cripples the LLM's generalization, failing to bring improvements to personalized search systems. We propose KARMA (Knowledge--Action Regularized Multimodal Alignment), a unified framework that treats semantic reconstruction as a train-only regularizer. KARMA optimizes a next-interest embedding for retrieval (Action) while enforcing semantic decodability (Knowledge) through two complementary objectives: (i) history-conditioned semantic generation, which anchors optimization to the LLM's native next-token distribution, and (ii) embedding-conditioned semantic reconstruction, which constrains the interest embedding to remain semantically recoverable. On Taobao search system, KARMA mitigates semantic collapse (attention-sink analysis) and improves both action metrics and semantic fidelity. In ablations, semantic decodability yields up to +22.5 HR@200. With KARMA, we achieve +0.25 CTR AUC in ranking, +1.86 HR in pre-ranking and +2.51 HR in recalling. Deployed online with low inference overhead at ranking & pre-ranking stage, KARMA drives +0.9% increase in GMV.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。