arXiv:2609.05363cs.LG2026-09

用小模型替代大模型做商品升级推荐,速度快一万倍且效果更好

Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation

论文配图:Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation
图 1 · 摘自论文原文
  • 先用大模型生成推理理由,再训练小型嵌入模型对齐理解
  • 小模型在8352组商品对上达AUC 0.924,比纯标签训练高0.012
  • 针对不同品类微调,性能进一步提升,适合大规模电商推荐场景

商品升级推荐旨在识别更高品质但保持用户购买意图的替代品。大型语言模型(LLM)虽能推理此类差异,但直接应用于数亿商品对不现实。本文提出两级框架:一级将LLM推理蒸馏为高效非生成式学生模型,通过检索增强少样本提示生成结构化关系标签与自然语言推理,监督一个紧凑的嵌入对分类器;推理时仅需两个预计算的768维产品嵌入,无需调用大模型或生成文本。在8,352对人工标注的基准测试中,1550万参数的四分类蒸馏学生模型达到AUC 0.924(95%置信区间[0.918, 0.929]),优于仅使用标签的学生模型(0.912)。二级采用产品类型测试时训练(PT-TTT),利用少量示例优化冻结学生模型上的轻量级类别特定适配器,使AUC从0.924提升至0.941,平均精度从0.920升至0.940。在10万对模拟商品目录上,该蒸馏学生模型在单台八卡机器上运行速度比直接使用大模型快约5000倍,成本降低约10000倍。

原文摘要 · Abstract (English)

Trade-up recommendation identifies higher-quality alternatives that preserve a customer's purchase intent while offering upgraded benefits. Large language models (LLMs) can reason about such distinctions, but applying them directly to hundreds of millions of product pairs is operationally impractical. We introduce a two-level framework that distills LLM reasoning into an efficient non-generative student and adapts its decision boundary to product-type-specific trade-up criteria. At Level 1, a retrieval-augmented few-shot LLM teacher generates structured relation labels and natural-language rationales. These rationales supervise a compact embedding-pair classifier through alignment and contrastive objectives; at inference, the student uses only two precomputed 768-dimensional product embeddings, with no LLM calls or text generation. On a fixed human-annotated benchmark of 8,352 pairs, a 15.5M-parameter four-class reasoning-distilled student achieves AUC 0.924 (95% CI [0.918, 0.929]), compared with 0.912 for the four-class label-only student. At Level 2, product-type test-time training (PT-TTT) uses few-shot demonstrations to optimize lightweight category-specific adapters over the frozen student. PT-TTT improves AUC from 0.924 to 0.941 and average precision from 0.920 to 0.940. On a 100K-pair proxy catalog, the distilled student on a single eight-GPU machine is approximately 5,000x faster and 10,000x lower in estimated cost than direct LLM inference.

推荐系统模型蒸馏测试时训练商品升级

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。