让视频评论自动匹配画面时间,避免剧透并提升观看体验。
ComVi: Context-Aware Optimized Comment Display in Video Playback
- 通过音视频相关性将评论定位到具体时间点。
- 优化显示策略,兼顾相关性、热门度与阅读时长。
- 用户测试中71.9%更偏好该系统,体验显著提升。
在YouTube等通用视频平台,评论独立于视频播放显示。观众观看时可能看到与当前画面无关的评论,导致剧透或破坏沉浸感。为此,我们提出ComVi系统,使评论在语境相关的时间点显示,实现评论与视频内容的时间同步。首先通过计算音视频相关性将所有评论映射至对应视频时间戳,再通过优化构建评论序列,综合考虑时间相关性、热度(点赞数)和可读显示时长。用户研究表明,与传统界面(如YouTube和弹幕)相比,ComVi显著提升了观看体验,71.9%的参与者选择其为最偏好界面。
原文摘要 · Abstract (English)
On general video-sharing platforms like YouTube, comments are displayed independently of video playback. As viewers often read comments while watching a video, they may encounter ones referring to moments unrelated to the current scene, which can reveal spoilers and disrupt immersion. To address this problem, we present ComVi, a novel system that displays comments at contextually relevant moments, enabling viewers to see time-synchronized comments and video content together. We first map all comments to relevant video timestamps by computing audio-visual correlation, then construct the comment sequence through an optimization that considers temporal relevance, popularity (number of likes), and display duration for comfortable reading. In a user study, ComVi provided a significantly more engaging experience than conventional video interfaces (i.e., YouTube and Danmaku), with 71.9% of participants selecting ComVi as their most preferred interface.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。