arXiv:2510.01665cs.CVcs.RO2025-10被引 1

提出新方法精准重建可变形物体的三维形状与纹理。

Non-Rigid Structure-from-Motion via Differential Geometry with Recoverable Conformal Scale

  • 基于图优化框架,逐点恢复形变下的局部共形尺度。
  • 在合成与真实数据上均实现更高精度和鲁棒性。
  • 适合需要高精度动态物体重建的研究者使用。

非刚性结构光流(NRSfM)是一种解决单目视觉可变形同时定位与地图构建(SLAM)映射挑战的有前景技术,日益受到关注。本文提出一种名为Con-NRSfM的新方法,用于在共形形变(包含等距形变为子集)下的NRSfM问题。该方法通过图优化框架,对选定的2D图像形变进行点级重建,无需依赖局部平面或局部线性形变等严格假设,且能准确恢复局部共形尺度。与现有方法不同,本框架将深度与共形尺度的约束解耦,解决了二者不可分离的问题,从而实现更精确的深度估计。为应对问题的敏感性,采用并行可分迭代优化策略。此外,引入自监督学习框架,结合编码器-解码器网络生成带纹理的稠密3D点云。仿真与真实数据实验结果表明,该方法在重建精度与鲁棒性方面优于现有方法。相关代码将在项目网站公开:https://sites.google.com/view/con-nrsfm。

原文摘要 · Abstract (English)

Non-rigid structure-from-motion (NRSfM), a promising technique for addressing the mapping challenges in monocular visual deformable simultaneous localization and mapping (SLAM), has attracted growing attention. We introduce a novel method, called Con-NRSfM, for NRSfM under conformal deformations, encompassing isometric deformations as a subset. Our approach performs point-wise reconstruction using 2D selected image warps optimized through a graph-based framework. Unlike existing methods that rely on strict assumptions, such as locally planar surfaces or locally linear deformations, and fail to recover the conformal scale, our method eliminates these constraints and accurately computes the local conformal scale. Additionally, our framework decouples constraints on depth and conformal scale, which are inseparable in other approaches, enabling more precise depth estimation. To address the sensitivity of the formulated problem, we employ a parallel separable iterative optimization strategy. Furthermore, a self-supervised learning framework, utilizing an encoder-decoder network, is incorporated to generate dense 3D point clouds with texture. Simulation and experimental results using both synthetic and real datasets demonstrate that our method surpasses existing approaches in terms of reconstruction accuracy and robustness. The code for the proposed method will be made publicly available on the project website: https://sites.google.com/view/con-nrsfm.

三维重建非刚性运动自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。