arXiv:2503.11126cs.LG2025-03被引 3

提出多层级子集选择方法,显著提升推荐与问答系统的相关性与多样性。

MUSS: Multilevel Subset Selection for Relevance and Diversity

  • 采用多层级结构优化相关性与多样性选择,提升计算效率。
  • 推荐系统精度提升4个百分点,速度加快20至80倍。
  • 适用于大规模数据场景,适合需要高效推荐的工业应用。

相关且多样子集选择问题在推荐系统和检索增强生成(RAG)中具有广泛应用。例如,在推荐系统中,需选出既相关又多样化的项目。该问题为NP-hard,传统方法如最大边际相关性(MMR)基于贪心策略,难以处理大规模数据。尽管后续方法DGDS通过随机分片实现了分布式处理,但其性能仍有提升空间。本文提出MUSS,一种利用数据结构的多层级选择方法,在推荐系统中可将精度提升最高达4个百分点,同时加速20至80倍;在RAG问答任务中也优于基线。我们提出了新的理论分析框架,证明了该方法能获得最优目标的常数因子近似解;并首次将DGDS的理论界收紧一倍。代码已开源于https://github.com/amazon-science/muss。

原文摘要 · Abstract (English)

The problem of relevant and diverse subset selection has a wide range of applications, including recommender systems and retrieval-augmented generation (RAG). For example, in recommender systems, one is interested in selecting relevant items, while providing a diversified recommendation. Constrained subset selection problem is NP-hard, and popular approaches such as Maximum Marginal Relevance (MMR) are based on greedy selection. Many real-world applications involve large data, but the original MMR work did not consider distributed selection. This limitation was later addressed by a method called DGDS which allows for a distributed setting using random data partitioning. Here, we exploit structure in the data to further improve both scalability and performance on the target application. We propose MUSS, a novel method that uses a multilevel approach to relevant and diverse selection. In a recommender system application, our method can not only improve the performance up to $4$ percent points in precision, but is also $20$ to $80$ times faster. Our method is also capable of outperforming baselines on RAG-based question answering accuracy. We present a novel theoretical approach for analyzing this type of problems, and show that our method achieves a constant factor approximation of the optimal objective. Moreover, our analysis also resulted in a $\times 2$ tighter bound for DGDS compared to previously known bound. Our code is publicly available at https://github.com/amazon-science/muss.

推荐系统子集选择分布式算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。