提出内容深度评分,揭示短视频推荐偏爱浅层内容
Content Depth Matters in Short-Video Recommendation: Rethinking the Attention Economy

- 用七级认知理论构建内容深度评分(CDS)
- 在15万视频上建立首个深度评估基准SCOPE-Bench
- 发现现有推荐系统对深度内容几乎无效,适合关注长期影响的研究者
受注意力经济驱动,短视频推荐系统主要优化用户即时参与度,倾向于推送能快速吸引注意的浅层内容。然而,长期暴露于此类内容可能损害用户的认知参与和心理健康,引发社会担忧。为此,本文提出内容深度评分(CDS),基于认知心理学理论,通过七级量表衡量视频激发高阶认知过程的能力。作为初步探索,我们构建了首个短视频内容深度评估基准SCOPE-Bench,基于大规模开源数据集,提供15万视频的CDS标注,支持从认知维度系统评估推荐系统。利用该基准,我们评估了13个代表性推荐系统,发现它们普遍偏好浅层内容;且推荐深度内容的算法仅略优于随机选择,凸显现有推荐目标的重大盲区。
原文摘要 · Abstract (English)
Driven by the attention economy, short-video Recommender Systems (RSs) are primarily optimized to maximize user engagement by promoting videos that capture attention within seconds. These systems inherently favor shallow-content videos that are effective at attracting immediate attention. However, growing evidence suggests that prolonged exposure to such content may negatively affect users' cognitive engagement and mental well-being, raising concerns about the long-term societal impact of the short-video platform. To tackle this challenge, this paper introduces a new metric, the \textbf{Content Depth Score (CDS)}, to quantify the content depth of short videos. CDS measures the extent to which a video is expected to stimulate higher-order cognitive processes, using a seven-level scale grounded in established theories of cognitive psychology and learning. As an initial step toward this vision, we present \textbf{SCOPE-Bench}, the first benchmark for content-depth evaluation in short-video recommendation. Built upon a large-scale open-source short-video dataset, SCOPE-Bench provides CDS annotations for 150K videos, enabling systematic evaluation of RSs from a cognitive-content perspective. Leveraging SCOPE-Bench, we evaluate 13 representative RSs and reveal a consistent preference for shallow-content videos. Moreover, we find that these algorithms recommending cognitively deep content are only marginally better than random selection, highlighting a previously overlooked limitation of existing recommendation objectives. Our code and datasets are available at https://liweidengdavid.github.io/SCOPE-Bench/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。