arXiv:2608.30251cs.IR2026-08

用集合预测方法解决推荐系统多兴趣检索的冗余与浪费问题。

SetMIR: Multi-Interest Retrieval as Set Prediction

论文配图:SetMIR: Multi-Interest Retrieval as Set Prediction
图 1 · 摘自论文原文
  • 将多兴趣检索建模为集合预测,通过可学习查询生成用户兴趣集。
  • 训练时用匈牙利匹配确保兴趣不重复,推理时仅发起有效查询。
  • 在真实业务中减少33%查询量,同时提升点击率44%、转化率51%。

基于嵌入的检索是工业级推荐系统的核心,但单个用户嵌入难以捕捉多样兴趣。多兴趣检索通过多个用户嵌入来缓解此问题,但现有方法仍存在两个缺陷:兴趣坍缩(不同嵌入学习相同兴趣)和静态调度(即使某些嵌入无用也固定使用检索预算)。我们提出SetMIR,将多兴趣检索视为集合预测问题。SetMIR使用Transformer编码用户行为历史,并通过K个可学习查询解码一组用户兴趣,每个兴趣生成一个检索嵌入和一个存在得分。训练时,匈牙利匹配实现查询与目标的一一对应,使匹配查询学习不同兴趣,存在头学习哪些查询是活跃的。推理时,SetMIR结合存在得分与查询级NMS,仅发出活跃且不冗余的ANN查询。在Snap的动态产品广告(DPA)数据上,SetMIR在所有指标上均优于四种已知的多兴趣检索器,且每请求减少33%的ANN查询。作为新检索源部署于DPA生产系统后,整体转化率提升3.1%,相比使用相同商品嵌入、ANN索引和检索配额的item-to-item检索源,点击率提升44%,转化率提升51%。

原文摘要 · Abstract (English)

Embedding-based retrieval is at the core of industrial recommender systems, but a single user embedding is often too limited to capture a user's diverse interests. Multi-interest retrieval addresses this by using multiple user embeddings, yet existing methods still suffer from two issues: interest collapse, where different embeddings learn the same interest, and static dispatch, where serving uses a fixed retrieval budget even when some embeddings are unnecessary. We propose SetMIR, which treats multi-interest retrieval as a set prediction problem. SetMIR encodes a user's behavior history with a transformer and uses K learnable queries to decode a set of user interests, each producing a retrieval embedding and a presence score. During training, Hungarian matching assigns targets to queries one-to-one, so matched queries learn distinct interests and the presence head learns which queries are active. At serving time, SetMIR uses presence scores and query-level Non-Maximum Suppression (NMS) to issue only active, non-redundant ANN queries. On Snap's Dynamic Product Ads (DPA) data, SetMIR outperforms four learned multi-interest retrievers on every metric while issuing 33% fewer ANN queries per request. Deployed as a new retrieval source in the DPA production stack, SetMIR lifts overall CVR by 3.1%, while lifting CTR by 44% and CVR by 51% over the item-to-item retrieval source with the same item embeddings, ANN index, and retrieval quota.

推荐系统多兴趣集合预测高效检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。