用手机拍视频，10分钟生成可交互3D模型，帧率高达150fps
Capture and Interact: Rapid 3D Object Acquisition and Rendering with Gaussian Splatting in Unity
- 手机拍摄+云端3D高斯点云重建，实现快速建模
- 在笔记本上实现实时渲染，平均帧率达150fps
- 适合远程协作、数字孪生等需要快速3D交互的场景
实时捕捉与渲染三维物体仍是重大挑战，但对增强现实、数字孪生、远程协作和原型设计具有重要应用价值。我们提出一个端到端流程，利用3D高斯点云（3D GS）技术，通过手机拍摄、云端处理和本地计算机，在Unity中实现真实物体的快速获取与交互渲染。用户用智能手机录制视频，上传后自动完成3D重建，可在笔记本上以平均150帧每秒（fps）的速度进行交互可视化。该系统整合移动端采集、云端3D GS重建与Unity渲染，支持实时远程呈现。实验表明，该流程在图形处理器（GPU）上约10分钟完成扫描处理，实现笔记本端的实时渲染。
原文摘要 · Abstract (English)
Capturing and rendering three-dimensional (3D) objects in real time remain a significant challenge, yet hold substantial potential for applications in augmented reality, digital twin systems, remote collaboration and prototyping. We present an end-to-end pipeline that leverages 3D Gaussian Splatting (3D GS) to enable rapid acquisition and interactive rendering of real-world objects using a mobile device, cloud processing and a local computer. Users scan an object with a smartphone video, upload it for automated 3D reconstruction, and visualize it interactively in Unity at an average of 150 frames per second (fps) on a laptop. The system integrates mobile capture, cloud-based 3D GS and Unity rendering to support real-time telepresence. Our experiments show that the pipeline processes scans in approximately 10 minutes on a graphics processing unit (GPU) achieving real-time rendering on the laptop.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。