arXiv:2501.16164cs.HCcs.AI2025-01

用文字提示生成个性化虚拟漫游场景,让静态全景图变生动。

MetaDecorator: Generating Immersive Virtual Tours through Multimodality

  • 通过文本提示和图像合成技术改造360度全景图
  • 生成风格独特且视觉吸引力强的虚拟空间
  • 适合想提升虚拟旅游体验的开发者与设计师

MetaDecorator 是一个赋能用户个性化虚拟空间的框架。利用文本驱动的提示和图像合成技术,该框架对360°摄像设备拍摄的静态全景图进行装饰,将其转化为具有独特风格且视觉上引人入胜的环境。相比传统方案,显著提升了虚拟漫游的真实感与沉浸感。此外,论文还探讨了在VR应用中集成大语言模型(LLMs)与触觉反馈技术,以进一步增强沉浸体验。

原文摘要 · Abstract (English)

MetaDecorator, is a framework that empowers users to personalize virtual spaces. By leveraging text-driven prompts and image synthesis techniques, MetaDecorator adorns static panoramas captured by 360° imaging devices, transforming them into uniquely styled and visually appealing environments. This significantly enhances the realism and engagement of virtual tours compared to traditional offerings. Beyond the core framework, we also discuss the integration of Large Language Models (LLMs) and haptics in the VR application to provide a more immersive experience.

虚拟漫游多模态生成360度图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。