让用户掌控推荐多样性,打破信息茧房
Exploration on Demand: From Algorithmic Control to User Empowerment
- 用动态聚类构建内容结构,按语义分组电影
- 探索度从0.34降到0.26,意外性升至0.73
- 适合想主动发现新内容的用户,提升探索体验
推荐系统常因过度个性化导致内容单一,形成信息茧房,抑制偶然发现。本文提出一种用户可控的自适应聚类框架,通过句向量嵌入与在线动态阈值算法,将电影划分为语义一致的簇,构建内容空间的结构化表示。在此基础上,设计新颖的探索机制,允许用户主动从低互动簇中采样,拓展内容视野,同时直观展现相关性与多样性间的权衡。在MovieLens数据集上的实验表明,该系统将列表内相似度从0.34降至0.26,意外性提升至0.73。基于大语言模型的300名模拟用户A/B测试显示,72.7%的长期用户更偏好探索式推荐。此外,NDCG@k、Recall@k和HitRate@k等指标验证了该方法在保持合理相关性的同时,实现了可控的多样化推荐,可作为促进有意义内容发现的探索层。
原文摘要 · Abstract (English)
Recommender systems often struggle with over-specialization, which severely limits users' exposure to diverse content and creates filter bubbles that reduce serendipitous discovery. To address this fundamental limitation, this paper introduces an adaptive clustering framework with user-controlled exploration that effectively balances personalization and diversity in movie recommendations. Our approach leverages sentence-transformer embeddings to group items into semantically coherent clusters through an online algorithm with dynamic thresholding, thereby creating a structured representation of the content space. Building upon this clustering foundation, we propose a novel exploration mechanism that empowers users to control recommendation diversity by strategically sampling from less-engaged clusters, thus expanding their content horizons while explicitly exposing the relevance-diversity trade-off. Experiments on the MovieLens dataset demonstrate the system's effectiveness, showing that exploration significantly reduces intra-list similarity from 0.34 to 0.26 while simultaneously increasing unexpectedness to 0.73. Furthermore, our Large Language Model-based A/B testing methodology, conducted with 300 simulated users, reveals that 72.7% of long-term users prefer exploratory recommendations over purely exploitative ones. Additional relevance metrics, including NDCG@k, Recall@k, and HitRate@k, reveal the expected relevance-diversity trade-off against CF and MMR baselines, positioning the method as a controllable exploration layer for promoting meaningful content discovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。