用手机拍3D物体,能自动引导拍摄方向,效果更好更省图。
An Object-Centered Data Acquisition Method for 3D Gaussian Splatting using Mobile Phones

- 手机拍摄时实时引导用户运动,避免视角覆盖不均。
- 用更少照片实现比RealityScan和自由拍摄更好的重建质量。
- 适合想用手机高效获取高质量3D模型的用户。
移动端进行3D Gaussian Splatting(3DGS)的数据采集仍具挑战。本文聚焦物体中心场景,通过设备端捕捉引导与本地传感器信号记录,实现可靠的移动采集。校准后,设备姿态对齐至基准帧以获得相对位姿,并将相机光轴映射到以物体为中心的球面网格中,实现均匀视点索引。为缓解极区采样偏差,实时计算面积加权球面覆盖率并指导用户运动。与RealityScan及自由采集策略对比,本方法在更少输入图像下获得更优重建质量。进一步分析表明,该方法能实现更全面、均匀的视角覆盖。
原文摘要 · Abstract (English)
Data acquisition through mobile phones remains a challenge for 3D Gaussian Splatting (3DGS). In this work we target the object-centered scenario and enable reliable mobile acquisition by providing on-device capture guidance and recording onboard sensor signals for offline reconstruction. After the calibration step, the device orientations are aligned to a baseline frame to obtain relative poses, and the optical axis of the camera is mapped to an object-centered spherical grid for uniform viewpoint indexing. To curb polar sampling bias, we compute area-weighted spherical coverage in real-time and guide the user's motion accordingly. We compare the proposed method with RealityScan and the free-capture strategy. Our method achieves superior reconstruction quality using fewer input images compared to free capture and RealityScan. Further analysis shows that the proposed method is able to obtain more comprehensive and uniform viewpoint coverage during object-centered acquisition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。