首个多视角单目小鼠3D重建模型,解决毛皮纹理缺失难题。
MoReMouse: Monocular Reconstruction of Laboratory Mouse
- 基于Transformer与三平面表示,单图生成高精度小鼠3D表面。
- 构建首个真实解剖结构的合成数据集,支持密集视点训练。
- 引入地学对应嵌入,提升四肢尾部动态区域重建稳定性。
实验室小鼠(尤其是C57BL/6品系)是生物医学研究的重要动物模型。然而,由于其复杂的非刚性形变、无纹理毛皮表面以及缺乏真实的3D网格模型,小鼠的精确3D表面运动重建仍面临重大挑战。现有视觉数据集仅包含稀疏视角且无3D几何信息。为此,我们提出MoReMouse,首个专为C57BL/6小鼠设计的单目稠密3D重建网络。为实现高保真重建,提出三项关键创新:首先,通过渲染一个解剖准确的高保真高斯小鼠虚拟体,构建首个密集视角的合成数据集;其次,采用基于Transformer的前馈架构结合三平面表示,从单张图像生成高质量3D表面,适配小型动物形态特征;第三,提出基于地学距离的连续对应嵌入,作为强语义先验,显著提升表面一致性与重建稳定性,尤其在四肢和尾巴等高动态区域。通过广泛定量与定性评估,证明MoReMouse在准确性和鲁棒性上均显著优于现有开源方法。
原文摘要 · Abstract (English)
Laboratory mice, particularly the C57BL/6 strain, are essential animal models in biomedical research. However, accurate 3D surface motion reconstruction of mice remains a significant challenge due to their complex non-rigid deformations, textureless fur-covered surfaces, and the lack of realistic 3D mesh models. Moreover, existing visual datasets for mice reconstruction only contain sparse viewpoints without 3D geometries. To fill the gap, we introduce MoReMouse, the first monocular dense 3D reconstruction network specifically designed for C57BL/6 mice. To achieve high-fidelity 3D reconstructions, we present three key innovations. First, we create the first high-fidelity, dense-view synthetic dataset for C57BL/6 mice by rendering a realistic, anatomically accurate Gaussian mouse avatar. Second, MoReMouse leverages a transformer-based feedforward architecture combined with triplane representation, enabling high-quality 3D surface generation from a single image, optimized for the intricacies of small animal morphology. Third, we propose geodesic-based continuous correspondence embeddings on the mouse surface, which serve as strong semantic priors, improving surface consistency and reconstruction stability, especially in highly dynamic regions like limbs and tail. Through extensive quantitative and qualitative evaluations, we demonstrate that MoReMouse significantly outperforms existing open-source methods in both accuracy and robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。