arXiv:2608.28931cs.IRcs.LG2026-08中稿 · EMNLP

解决电商推荐中标签生成的暴露偏差问题,提升用户兴趣匹配准确率。

MERIT: Mitigating Exposure Bias in Generative XMC for User-Interest Propensity Modeling

论文配图:MERIT: Mitigating Exposure Bias in Generative XMC for User-Interest Propensity Modeling
图 1 · 摘自论文原文
  • 通过打乱真实标签与挖掘负样本的混合序列,让模型自纠正错误预测。
  • 在25万+标签数据集上,全局召回率提升11.9%,命中率平均提高6.1%。
  • 适合大规模电商场景下需要精准匹配用户兴趣的推荐系统应用。

在大规模电商平台上,实现用户与兴趣类别的精准匹配是个性化购物的核心挑战,因标签空间持续演化且用户兴趣信号稀疏、长尾分布显著。自回归语言模型因其世界知识和描述符语义先验,可泛化于极端标签空间并支持多标签分配,但教师强制微调下,推理时的预测会成为条件上下文:早期错误导致后续输出偏向共现标签,过度生成相关项而遗漏真正无关的兴趣。本文提出MERIT框架,通过一种置换不变的多目标损失函数,将真实标签与挖掘的硬负样本随机混合,使生成器在训练中暴露于错误前缀,从而缓解暴露偏差。该目标聚焦分类位置的监督信号,生成与兴趣倾向对齐的隐藏状态,驱动轻量级评分器实现双向检索(用户找兴趣、兴趣找用户)。在包含25万+兴趣类别的私有电商数据集上,MERIT使全局召回率提升至少11.9%,平均Hit@k提升6.1%;生产环境A/B测试中,用户转化率提升0.26%。

原文摘要 · Abstract (English)

Matching users to interest categories at scale is central to personalized shopping, but the task is challenging in large e-commerce platforms, where label spaces continually evolve and user-interest signals are sparse and long-tailed. Autoregressive language models are appealing because their world knowledge and semantic priors over descriptors generalize across extreme label spaces and accommodate multiple valid label assignments. Yet under teacher-forced fine-tuning, inference-time predictions become part of the conditioning context: early errors steer later outputs toward co-occurring labels, over-generating near-correlates and missing unrelated true interests. We present MERIT, a framework for user-interest propensity modeling that mitigates this exposure bias through a self-correction objective. A permutation-invariant multi-target loss over shuffled mixtures of gold and mined hard-negative labels exposes the generator to erroneous prefixes while preserving the efficiency of teacher-forced training. This training objective concentrates supervision at classification positions, yielding propensity-aligned hidden states powering a lightweight scorer for bidirectional retrieval (interests for users and users for interests). On a proprietary e-commerce dataset with 250k+ interest categories, MERIT improves global recall by at least 11.9% and average Hit@k by 6.1%. In production A/B tests, it achieves +0.26% gain in user conversion.

推荐系统生成模型曝光偏差电商

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。