让聊天机器人更懂用户,用排名反馈优化推理能力
RGAlign-Rec: Ranking-Guided Alignment for Latent Query Reasoning in Recommendation Systems
- 用下游排序信号反向优化大模型的潜空间推理
- 工业级数据集上提升GAUC 0.12%,错误率降3.52%
- 适合做主动推荐系统的工程师和研究者
主动意图预测是现代电商聊天机器人实现“零查询”推荐的关键能力,能从用户行为和上下文信号中预判需求。然而现有工业系统面临两大挑战:(1) 离散用户特征与聊天机器人知识库中的语义意图之间存在语义鸿沟;(2) 通用大模型输出与任务特定排序目标存在目标错位。为此,我们提出RGAlign-Rec,一个闭环对齐框架,将基于大模型的语义推理器与查询增强(QE)排序模型结合。引入排名引导对齐(RGA),通过下游排序信号作为反馈,分阶段优化大模型的潜在推理过程。在虾皮(Shopee)大规模工业数据集上的实验表明,RGAlign-Rec实现GAUC提升0.12%,错误率相对降低3.52%,Recall@3提升0.56%。线上A/B测试进一步验证:查询增强模型(QE-Rec)初期带来CTR提升0.98%,后续对齐阶段再增0.13%。结果表明,感知排序的对齐能有效同步语义推理与排序目标,显著提升真实场景下主动推荐系统的预测准确性和服务质量。
原文摘要 · Abstract (English)
Proactive intent prediction is a critical capability in modern e-commerce chatbots, enabling "zero-query" recommendations by anticipating user needs from behavioral and contextual signals. However, existing industrial systems face two fundamental challenges: (1) the semantic gap between discrete user features and the semantic intents within the chatbot's Knowledge Base, and (2) the objective misalignment between general-purpose LLM outputs and task-specific ranking utilities. To address these issues, we propose RGAlign-Rec, a closed-loop alignment framework that integrates an LLM-based semantic reasoner with a Query-Enhanced (QE) ranking model. We also introduce Ranking-Guided Alignment (RGA), a multi-stage training paradigm that utilizes downstream ranking signals as feedback to refine the LLM's latent reasoning. Extensive experiments on a large-scale industrial dataset from Shopee demonstrate that RGAlign-Rec achieves a 0.12% gain in GAUC, leading to a significant 3.52% relative reduction in error rate, and a 0.56% improvement in Recall@3. Online A/B testing further validates the cumulative effectiveness of our framework: the Query-Enhanced model (QE-Rec) initially yields a 0.98% improvement in CTR, while the subsequent Ranking-Guided Alignment stage contributes an additional 0.13% gain. These results indicate that ranking-aware alignment effectively synchronizes semantic reasoning with ranking objectives, significantly enhancing both prediction accuracy and service quality in real-world proactive recommendation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。