arXiv:2607.12882cs.MMcs.IR2026-07

根据用户偏好生成个性化视频封面,提升点击率。

What Would You Click? Personalized Video Thumbnail Generation with Preference-aware Highlight Retrieval

论文配图:What Would You Click? Personalized Video Thumbnail Generation with Preference-aware Highlight Retrieval
图 1 · 摘自论文原文
  • 通过用户-视频交互捕捉偏好,选出符合个人兴趣的关键帧。
  • 结合视觉语义生成高质量封面图,点击率显著提升。
  • 适合做视频平台推荐系统优化的工程师与研究者。

视频缩略图是吸引用户点击的关键因素,正越来越多地依赖自动化生成。然而,现有方法通常生成通用封面,忽略用户间的偏好差异。为此,我们提出个性化视频缩略图生成任务,旨在生成符合用户偏好的封面。该任务面临两大挑战:(i) 从视频中识别能引导生成的关键帧(视觉锚点),需平衡个性化与信息量,现有检测方法难以兼顾;(ii) 生成既视觉连贯又忠实原视频的个性化封面。为此,我们提出两阶段框架,将偏好感知的候选帧检索与可控生成紧密结合。第一阶段,个性化关键帧检索器利用细粒度用户-视频交互,结合视频语义摘要,选出与用户偏好和视频上下文一致的多样化视觉锚点。第二阶段,基于视觉语言模型(VLM)的扩散流水线,从锚点提取并注入语义相关的视觉线索,生成高保真、个性化的缩略图。在两个公开数据集上的实验表明,本方法优于检索式与生成式基线,达到最先进性能。用户研究进一步验证其在提升点击偏好方面的有效性。代码已开源:https://github.com/hezy18/PVTG。

原文摘要 · Abstract (English)

Video thumbnails are a key factor for attracting user clicks on video platforms, and are increasingly supported by automation. However, existing thumbnail generation methods typically produce generic results shared across users, overlooking the diversity of individual preferences. We therefore introduce personalized video thumbnail generation, a novel task that aims to create thumbnails tailored to user-specific preferences. It is challenging in two aspects: (i) identifying visual anchors (i.e., key frames) from each video to guide the generation, which requires a balance between personalization and informativeness that existing highlight detection methods fail to achieve; and (ii) generating personalized thumbnails that are both visually coherent and faithful to the original video. As a response, we propose a two-stage framework that tightly couples preference-aware retrieval with controllable generation. In the first stage, a personalized highlight retriever captures fine-grained user-video interactions and incorporates video semantics through summarization, enabling the selection of diverse visual anchors aligned with both user preferences and video contexts. In the second stage, a VLM-guided diffusion pipeline transforms these anchors into thumbnails by extracting and injecting semantically grounded visual cues, improving personalization while preserving visual coherence and fidelity. Experiments on two public datasets show our method delivers state-of-the-art performance compared with both retrieval-based and generative baselines. A user study further demonstrates improved click preference, highlighting its effectiveness in enhancing user engagement. The code is available at https://github.com/hezy18/PVTG.

视频生成个性化推荐扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。