用视频脚本引导360°VR中用户注意力，提升沉浸体验
Attention Guidance through Video Script: A Case Study of Object Focusing on 360° VR Video Tours
- 结合Grounding Dino与SAM模型，基于脚本定位目标物体
- 实验表明脚本可有效提升用户对关键物体的关注度
- 适合做交互式VR导览或智能内容推荐的开发者参考
在虚拟现实领域，360° VR视频为用户提供球形环境中的沉浸式体验，允许从任意角度探索和互动。然而，这种视频形式常缺乏有效手段引导用户关注特定元素。本文结合Grounding Dino与Segment Anything（SAM）模型，基于视频脚本实现对象聚焦来引导注意力。以雷丁大学360°视频导览为案例，实验结果表明，视频脚本能有效提升用户在360° VR视频导览中的体验，帮助定向引导用户注意力。
原文摘要 · Abstract (English)
Within the expansive domain of virtual reality (VR), 360° VR videos immerse viewers in a spherical environment, allowing them to explore and interact with the virtual world from all angles. While this video representation offers unparalleled levels of immersion, it often lacks effective methods to guide viewers' attention toward specific elements within the virtual environment. This paper combines the models Grounding Dino and Segment Anything (SAM) to guide attention by object focusing based on video scripts. As a case study, this work conducts the experiments on a 360° video tour on the University of Reading. The experiment results show that video scripts can improve the user experience in 360° VR Videos Tour by helping in the task of directing the user's attention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。