arXiv:2606.23919cs.IR2026-06中稿 · E-commerce worksho…

用统一模型同时处理电商六大相关性任务,提升效率与一致性。

Unified Multi-Task Relevance Modeling for E-Commerce: Comparing Task Routing Architectures Across LLMs and Cross-Encoders

  • 设计统一多任务框架,共享三分类相关性标签
  • 多头带私有层架构在45.3万测试样本上达89.96%准确率
  • 适合需要跨任务知识迁移的电商推荐系统研发

如何构建一个单一相关性模型,以应对电商中从查询商品匹配到商品类型相似度等六类实体对关系?每类任务数据量不同、语义要求各异,且学习信号可能冲突。当前工业实践依赖独立模型,阻碍知识迁移并产生不一致的相关性判断。本研究发现:基于编码器和仅解码器的模型通过不同机制编码任务身份,因此任务路由架构的选择对两类模型影响不对称。我们提出三大创新:(a) 统一多任务框架,在六类任务上联合训练,共享三分类相关性评分;(b) 系统比较三种路由架构(文本前缀路由、多头分类、多头加私有层)在LoRA微调的大语言模型与全微调交叉编码器上的表现;(c) 采用多数投票集成策略,利用私有层带来的多样性。结果表明:MHP集成(多头带私有层)在45.3万测试样本上达到89.96%准确率,为所有配置最高;移除文本前缀但无私有层时,仅解码器模型性能显著下降,而交叉编码器保持鲁棒,揭示编码器-解码器在任务身份编码上的不对称性;多任务训练使低资源任务性能相比单任务基线最高提升14%。

原文摘要 · Abstract (English)

How can we build a single relevance model that handles six different entity pair relationship types in e commerce from query product matching to product type similarity when each task has different data volumes, different semantic requirements, and potentially conflicting learning signals? This question is important because current industry practice relies on separate models for each task, preventing knowledge transfer and producing inconsistent relevance signals. Our work is driven by the following insight: encoder based and decoder only models encode task identity through different mechanisms, so the choice of task routing architecture how task identity is communicated to the shared model affects these two families in asymmetric ways. As our key novelty, we combine three ideas: (a) a unified multi task framework that jointly trains on six entity pair tasks under a shared three point relevance scale, (b) a systematic comparison of three task routing architectures (text prefix routing, multi head classification, and multihead with private transformer layers) across both LoRA adapted LLMs and fully finetuned cross encoders, and (c) a majority vote ensemble that exploits the diversity induced by private layer routing. First, we show that the MHP Ensemble (multi head with private layers) achieves 89.96% accuracy on 453K test examples the highest across all configurations . Second, we show that removing text prefixes without private layers causes severe degradation for decoder only LLMs while cross encoders remain robust , suggesting an encoder decoder asymmetry in task identity encoding. Third, we show that multi task training yields up to 14% improvement on low resource tasks over single task baselines.

多任务学习电商推荐大模型应用相关性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。