将2D内容快速转为可交互3D对象，提升远程协作沟通效率
Thing2Reality: Transforming 2D Content into Conditioned Multiviews and 3D Gaussian Objects for XR Communication
- 输入视频生成条件化多视角图像与3D高斯模型
- 用户研究显示3D交互使讨论效率显著提升
- 适合远程设计协作与虚拟会议场景
在远程沟通中，参与者常需共享数字与实体内容，如产品设计、数字资产和环境，以增进理解。近期增强型通信技术已支持用户从视频流快速创建并共享物理物体的2D数字副本。然而，传统2D表示限制了用户在沉浸式环境中对物品的空间定位与参考能力。为此，我们提出Thing2Reality——一个扩展现实（XR）通信平台，旨在提升远程会话中对数字与实体物品的即时讨论效率。该平台允许用户快速将想法或实物转化为沉浸式环境中的可交互对象，并以条件化多视角图像或3D高斯表示共享。用户可在协作中操作远程物体或讨论概念。用户研究表明，3D表示的交互能力显著提升了讨论效率，具有增强2D素材沟通潜力。
原文摘要 · Abstract (English)
During remote communication, participants often share both digital and physical content, such as product designs, digital assets, and environments, to enhance mutual understanding. Recent advances in augmented communication have facilitated users to swiftly create and share digital 2D copies of physical objects from video feeds into a shared space. However, conventional 2D representations of digital objects restricts users' ability to spatially reference items in a shared immersive environment. To address this, we propose Thing2Reality, an Extended Reality (XR) communication platform that enhances spontaneous discussions of both digital and physical items during remote sessions. With Thing2Reality, users can quickly materialize ideas or physical objects in immersive environments and share them as conditioned multiview renderings or 3D Gaussians. Thing2Reality enables users to interact with remote objects or discuss concepts in a collaborative manner. Our user study revealed that the ability to interact with and manipulate 3D representations of objects significantly enhances the efficiency of discussions, with the potential to augment discussion of 2D artifacts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。