arXiv:2607.17070cs.AI2026-07

用结构化语义与事后蒸馏解决新用户预测难题。

Bridging the Information Gap: Semantic Densification and Hindsight Distillation for Cold-Start Prediction

论文配图:Bridging the Information Gap: Semantic Densification and Hindsight Distillation for Cold-Start Prediction
图 1 · 摘自论文原文
  • 构建结构化语义推理流程,生成可落地的用户画像
  • 通过事后蒸馏目标提升冷启动模型性能,LTV增1.9%、CVR增1.0%
  • 适配不同用户差异,仅需9%数据即可匹配现有系统表现

新用户冷启动是电商平台预测用户生命周期价值(LTV)和转化率(CVR)的核心瓶颈。现有方法中,基于大模型的语义增强产生非结构化推理,难以部署;而朴素师生蒸馏因教师与学生间存在信息鸿沟且用户间差异显著,效果脆弱。本文提出SemRaD框架:首先通过发现-整理-审核工作流构建结构化语义推理管道,生成每位用户的稠密语义画像(由语义门控编码器在部署时使用),并生成训练用的事后蒸馏目标;其次设计事前感知蒸馏网络,利用事后目标实现知识迁移,并引入蒸馏专家应对用户间异质性。在大规模工业数据集上,相较于生产基线,该方法使LTV(Gini)提升+1.9%,CVR(AUROC)提升+1.0%;四周期线上A/B测试验证了LTV+1.0%、CVR+0.43%的收益。此外,仅用9%训练数据即达到生产系统同等LTV表现,同时将CVR提升0.8%。

原文摘要 · Abstract (English)

New-user cold-start is a critical bottleneck for e-commerce platforms: predicting user lifetime value (LTV) and conversion rate (CVR) for users with sparse interaction history. Two prior directions -- LLM-based semantic augmentation and learning using privileged information (LUPI) -- each face a key limitation. First, LLM augmentation produces unstructured rationales that are noisy and hard to operationalize in production. Second, naive student-teacher distillation can be brittle due to an information gap between the privileged teacher and the sparse student; moreover, this gap is heterogeneous across users. We propose SemRaD, a Semantic Reasoning-aware Distillation framework addressing both limitations. First, a Structured Semantic Reasoning Pipeline replaces free-form rationales with a structured schema built via a discover-curate-audit workflow, producing per user a Densified Semantic Profile (consumed by the deployed student via a Semantic-Gated Encoder that focuses on the most informative dimensions) and a Hindsight Distillation Target reconciled from pre- and post-conversion reasoning (used only at training). Second, to bridge this gap and handle its heterogeneity, a Hindsight-Aware Distillation Network transfers privileged knowledge via the hindsight target, with Distillation Experts improving transfer under per-user variability. On a large-scale industrial dataset, SemRaD lifts +1.9% LTV (Gini) and +1.0% CVR (AUROC) over a production-grade base; a four-week online A/B at Keeta confirms +1.0% LTV / +0.43% CVR. SemRaD also matches the production system's LTV using only 9% of the training data while improving CVR by 0.8%.

冷启动用户建模蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。