从超高速运动模糊图像中恢复3D形状,突破传统方法极限。
Recovering 3D Shapes from Ultra-Fast Motion-Blurred Images
- 提出快速重心坐标求解器,加速模糊模拟4.57倍。
- 实现端到端可微分渲染,成功恢复极端运动下的3D形状。
- 适用于体育与工业场景中的高速运动物体重建。
本文研究超高速运动模糊图像中的3D形状恢复问题。尽管静态图像的3D重建已广泛研究,但极端运动模糊场景(如体育中的球类或旋转机械)下,传统多视图立体(MVS)技术因物体外观严重失真而失效。为此,提出一种新型逆渲染方法:通过改进重心坐标计算,消除重复运算瓶颈,实现高达4.57倍的速度提升,支持高效且逼真的高速运动模拟。该方法完全可微,使梯度可反向传播至3D形状,从而实现从2D图像中恢复真实几何结构。在快速平移和旋转两种典型运动类型上验证有效,显著推进了基于视觉的3D重建边界。项目页面:https://maxmilite.github.io/rec-from-ultrafast-blur/
原文摘要 · Abstract (English)
We consider the problem of 3D shape recovery from ultra-fast motion-blurred images. While 3D reconstruction from static images has been extensively studied, recovering geometry from extreme motion-blurred images remains challenging. Such scenarios frequently occur in both natural and industrial settings, such as fast-moving objects in sports (e.g., balls) or rotating machinery, where rapid motion distorts object appearance and makes traditional 3D reconstruction techniques like Multi-View Stereo (MVS) ineffective. In this paper, we propose a novel inverse rendering approach for shape recovery from ultra-fast motion-blurred images. While conventional rendering techniques typically synthesize blur by averaging across multiple frames, we identify a major computational bottleneck in the repeated computation of barycentric weights. To address this, we propose a fast barycentric coordinate solver, which significantly reduces computational overhead and achieves a speedup of up to 4.57x, enabling efficient and photorealistic simulation of high-speed motion. Crucially, our method is fully differentiable, allowing gradients to propagate from rendered images to the underlying 3D shape, thereby facilitating shape recovery through inverse rendering. We validate our approach on two representative motion types: rapid translation and rotation. Experimental results demonstrate that our method enables efficient and realistic modeling of ultra-fast moving objects in the forward simulation. Moreover, it successfully recovers 3D shapes from 2D imagery of objects undergoing extreme translational and rotational motion, advancing the boundaries of vision-based 3D reconstruction. Project page: https://maxmilite.github.io/rec-from-ultrafast-blur/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。