从粗粒度评分中恢复精细排名需大量用户,成本远高于比较排序。
Ranking Items from Discrete Ratings: The Cost of Unknown User Thresholds
- 基于用户阈值与项目得分模型,通过逐步提问优化排名。
- 需Θ(n²)用户才能接近完美排名,远超比较排序的O(n log n)。
- 适合研究在线推荐系统中用户差异对排名精度的影响。
在信息检索和推荐系统中,排名是核心任务。用户常以离散粗粒度评分参与排名,我们探究能否从中恢复细粒度排名。模型设定项目有得分,用户有阈值:当项目得分超过阈值时,用户给出正向评分。尽管所有用户对项目顺序一致,但当得分与阈值均未知时,估计该顺序极具挑战性。在此模型下,任何排名方法天然将n个项目划分为有序的若干组,组内项目无序。用户按序到来,可被逐个询问以细化当前排名。我们证明,达到近似完美排名(以斯皮尔曼距离衡量)需Θ(n²)用户(即Ω(n²)查询),显著高于比较排序所需的O(n log n)查询。这一差距源于需额外查询识别具有合适阈值的用户。我们的界还通过二次偏离因子量化了得分与阈值分布不匹配的影响。为验证结果紧性,我们提出一种算法,其查询复杂度与界仅差一个对数因子。本工作揭示了在线排名中的张力:阈值多样性有助于融合多用户粗粒度评分以实现精细排名,但若阈值事先未知,这种多样性会带来高昂代价。
原文摘要 · Abstract (English)
Ranking items is a central task in many information retrieval and recommender systems. User input for the ranking task often comes in the form of ratings on a coarse discrete scale. We ask whether it is possible to recover a fine-grained item ranking from such coarse-grained ratings. We model items as having scores and users as having thresholds; a user rates an item positively if the item's score exceeds the user's threshold. Although all users agree on the total item order, estimating that order is challenging when both the scores and the thresholds are latent. Under our model, any ranking method naturally partitions the $n$ items into bins; the bins are ordered, but the items inside each bin are still unordered. Users arrive sequentially, and every new user can be queried to refine the current ranking. We prove that achieving a near-perfect ranking, measured by Spearman distance, requires $Θ(n^2)$ users (and therefore $Ω(n^2)$ queries). This is significantly worse than the $O(n\log n)$ queries needed to rank from comparisons; the gap reflects the additional queries needed to identify the users who have the appropriate thresholds. Our bound also quantifies the impact of a mismatch between score and threshold distributions via a quadratic divergence factor. To show the tightness of our results, we provide a ranking algorithm whose query complexity matches our bound up to a logarithmic factor. Our work reveals a tension in online ranking: diversity in thresholds is necessary to merge coarse ratings from many users into a fine-grained ranking, but this diversity has a cost if the thresholds are a priori unknown.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。