arXiv:2601.21611cs.IRcs.AI2026-01中稿 · WWW2026 industry t…被引 4

用多视角推理增强电商搜索相关性,实现快速精准匹配。

Thinking Broad, Acting Fast: Latent Reasoning Distillation from Multi-Perspective Chain-of-Thought for E-Commerce Relevance

  • 构建多视角思维链,捕捉用户意图与商品属性的多重匹配
  • 提出隐式推理蒸馏技术,学生模型推理延迟降低60%以上
  • 适用于高并发电商搜索场景,提升点击率与用户体验

电商搜索的相关性建模对匹配用户意图、提升购物体验至关重要。现有方法虽利用大语言模型(LLM)和思维链(CoT)提升准确性与可解释性,但普遍存在两大缺陷:一是仅依赖单一视角的思维链,难以覆盖用户意图、属性匹配及商业规则等多维度需求;二是现有蒸馏方法在推理阶段丢弃思维链结构,仅将其作为临时辅助信号,丧失了其推理价值。为此,本文提出新框架,教师模型采用多视角思维链(MPCoT),结合监督微调(SFT)与直接偏好优化(DPO)训练更鲁棒的推理器。学生模型则引入隐式推理知识蒸馏(LRKD),配备轻量级推理时潜空间推理提取器,高效内化大模型的复杂推理能力。离线实验与在线A/B测试均在日均服务数千万用户的电商平台中验证有效,显著提升商业表现与用户体验。

原文摘要 · Abstract (English)

Effective relevance modeling is crucial for e-commerce search, as it aligns search results with user intent and enhances customer experience. Recent work has leveraged large language models (LLMs) to address the limitations of traditional relevance models, especially for long-tail and ambiguous queries. By incorporating Chain-of-Thought (CoT) reasoning, these approaches improve both accuracy and interpretability through multi-step reasoning. However, two key limitations remain: (1) most existing approaches rely on single-perspective CoT reasoning, which fails to capture the multifaceted nature of e-commerce relevance (e.g., user intent vs. attribute-level matching vs. business-specific rules); and (2) although CoT-enhanced LLM's offer rich reasoning capabilities, their high inference latency necessitates knowledge distillation for real-time deployment, yet current distillation methods discard the CoT rationale structure at inference, using it as a transient auxiliary signal and forfeiting its reasoning utility. To address these challenges, we propose a novel framework that better exploits CoT semantics throughout the optimization pipeline. Specifically, the teacher model leverages Multi-Perspective CoT (MPCoT) to generate diverse rationales and combines Supervised Fine-Tuning (SFT) with Direct Preference Optimization (DPO) to construct a more robust reasoner. For distillation, we introduce Latent Reasoning Knowledge Distillation (LRKD), which endows a student model with a lightweight inference-time latent reasoning extractor, allowing efficient and low-latency internalization of the LLM's sophisticated reasoning capabilities. Evaluated in offline experiments and online A/B tests on an e-commerce search advertising platform serving tens of millions of users daily, our method delivers significant offline gains, showing clear benefits in both commercial performance and user experience.

电商搜索思维链知识蒸馏大模型推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。