用一面镜子阵列和单相机拍下微型场景的3D全景图。
Seeing A 3D World in A Grain of Sand
- 设计八对平面镜嵌套在金字塔上，单次拍摄捕捉多视角图像。
- 在真实与合成微型场景上实现当前最佳3D重建效果。
- 适合微缩模型数字化、文化遗产保存等应用。
我们提出一种快照成像技术，用于恢复毫米级微型场景的3D周围视图。由于结构复杂，此类微型场景难以重建，但日常中常见，其3D数字化具有重要价值。我们设计了一种基于单相机和八对平面镜的猫眼成像系统，从娃娃屋视角实现单次快照的3D重建。将成对镜面布置于嵌套金字塔表面，一次曝光捕获多个视角图像。镜面布局可根据场景尺寸定制，优化视域覆盖。采用3D高斯溅射（3DGS）表示进行场景重建与新视角合成，并引入视觉外壳导出的深度约束以应对稀疏视图带来的挑战。该方法在多种合成与真实微型场景上均达到当前最优性能。
原文摘要 · Abstract (English)
We present a snapshot imaging technique for recovering 3D surrounding views of miniature scenes. Due to their intricacy, miniature scenes with objects sized in millimeters are difficult to reconstruct, yet miniatures are common in life and their 3D digitalization is desirable. We design a catadioptric imaging system with a single camera and eight pairs of planar mirrors for snapshot 3D reconstruction from a dollhouse perspective. We place paired mirrors on nested pyramid surfaces for capturing surrounding multi-view images in a single shot. Our mirror design is customizable based on the size of the scene for optimized view coverage. We use the 3D Gaussian Splatting (3DGS) representation for scene reconstruction and novel view synthesis. We overcome the challenge posed by our sparse view input by integrating visual hull-derived depth constraint. Our method demonstrates state-of-the-art performance on a variety of synthetic and real miniature scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。