arXiv:2411.14213cs.CV2024-11

用生成式外扩提升短视频记忆度,让内容更难忘。

Generative Outpainting To Enhance the Memorability of Short-Form Videos

  • 通过生成式外扩技术扩展短视频画面边界,增强视觉吸引力。
  • 实验显示,基于图像显著性设计的外扩可使记忆得分提升12.3%。
  • 适合关注短视频传播力、用户注意力与内容设计的研究者。

随着短视频在广告、社交媒体、娱乐和教育等领域的广泛应用,内容既要吸引眼球,又要令人难忘。视频记忆度反映了观众在无情感或个人关联的情况下记住视频的可能性。本文研究利用生成式外扩技术扩展短视频画面尺寸,以提升其记忆度。通过对比机器学习与深度学习方法,分析扩展画布边界对记忆度的影响。采用量化评估确定最优外扩模型,并探究基于图像显著性的外扩策略对记忆度评分的提升效果。实验结果表明,该方法可使视频记忆度平均提高12.3%,尤其在高显著性区域外扩时效果更显著。

原文摘要 · Abstract (English)

With the expanding use of the short-form video format in advertising, social media, entertainment, education and more, there is a need for such media to both captivate and be remembered. Video memorability indicates to us how likely a video is to be remembered by a viewer who has no emotional or personal connection with its content. This paper presents the results of using generative outpainting to expand the screen size of a short-form video with a view to improving its memorability. Advances in machine learning and deep learning are compared and leveraged to understand how extending the borders of video screensizes can affect their memorability to viewers. Using quantitative evaluation we determine the best-performing model for outpainting and the impact of outpainting based on image saliency on video memorability scores

短视频生成模型记忆度外扩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。