通过分析模型输出分布,更公平地捕捉用户偏好中的长尾内容。
SPECTRA: Revealing the Full Spectrum of User Preferences via Distributional LLM Inference
- 用软最大值探针解析模型输出,获得语义可解释的偏好分布。
- 在多个数据集上降低偏好分布偏差38%~44%,提升长尾类目曝光23%。
- 特别适合需要覆盖多样偏好的推荐系统,如短视频平台。
大型语言模型(LLM)常被用于建模用户偏好,但传统生成式方法因自回归解码机制存在偏差,过度强调高频偏好而压制长尾偏好。为此,我们提出SPECTRA(Softmax Probing for Extracted Category-level Token Readouts and Analysis),将微调后的LLM视为隐式概率模型,通过探查其softmax输出,推断出语义可解释的偏好类别分布。在MovieLens、Yelp及一个大规模短视频平台上的评估显示:SPECTRA实现(i)分布对齐,使杰恩-申诺尔散度较真实分布降低38%至44%;(ii)长尾偏好恢复与跨用户公平性,提升MovieLens上top-3类别曝光熵23%,且对长尾偏好用户提升更大;(iii)下游应用价值显著,在MovieLens和Yelp上带来41%至46%的类别NDCG提升,在大规模部署中使长尾类别排序效果提升7倍,优于以头部偏好优化的生产级排序器。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly used to model user preferences, with the typical output as a directly-generated ranked item list per user. However, this generative paradigm inherits the bias and opacity of autoregressive decoding. It over-emphasizes frequent (head) preferences and suppresses minority, long-tail ones. To address this, we propose SPECTRA (Softmax Probing for Extracted Category-level Token Readouts and Analysis), which treats the finetuned LLM as an implicit probabilistic model and probes its softmax to infer a probability distribution over semantically interpretable preference categories. We evaluate SPECTRA on MovieLens, Yelp, and a large-scale short-video platform. SPECTRA delivers (i) distributional alignment, reducing Jensen-Shannon divergence to the empirical preference distribution by 38 to 44 percent across public datasets; (ii) long-tail recovery with cross-user fairness, raising top-3 category exposure entropy by 23 percent on MovieLens and producing a larger gain on tail-preference users than on head-preference users; and (iii) downstream application value, with a 41 to 46 percent category-NDCG boost on MovieLens and Yelp, and a 7x improvement on long-tail category ranking on a large-scale deployment against a head-optimized production ranker.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。