arXiv:2507.19459cs.CVcs.LG2025-07被引 5

用单张图像快速生成航天器3D模型,省时省力。

Fast Learning of Non-Cooperative Spacecraft 3D Models through Primitive Initialization

  • 用CNN从单图生成粗略3D模型和相机姿态,作为3DGS的初始值。
  • 在姿态不准确或无明确标注时,仍可训练出高保真3D模型。
  • 训练迭代次数和图像数量减少一个数量级,适合空间任务应用。

NeRF和3D高斯点云(3DGS)等新视图合成技术可仅凭带位姿的单目图像学习精确3D模型。但这类方法在空间应用中受限:需训练时提供位姿,且训练与推理计算开销高。本文提出:(1) 基于卷积神经网络(CNN)的3DGS粗略初始化方法,输入单张图像输出由基本体素构成的粗略3D模型及目标相对相机的姿态;(2) 支持使用噪声或隐式位姿估计进行训练的流程;(3) 分析不同初始化方式对训练成本的影响。该初始化方案显著降低3DGS训练所需迭代次数与图像数量,至少降低一个数量级。同时,通过对比多种位姿估计变体,在存在误差的位姿监督下仍能学习高质量3D表示,为新型视图合成技术在空间场景中的应用铺平道路。

原文摘要 · Abstract (English)

The advent of novel view synthesis techniques such as NeRF and 3D Gaussian Splatting (3DGS) has enabled learning precise 3D models only from posed monocular images. Although these methods are attractive, they hold two major limitations that prevent their use in space applications: they require poses during training, and have high computational cost at training and inference. To address these limitations, this work contributes: (1) a Convolutional Neural Network (CNN) based primitive initializer for 3DGS using monocular images; (2) a pipeline capable of training with noisy or implicit pose estimates; and (3) and analysis of initialization variants that reduce the training cost of precise 3D models. A CNN takes a single image as input and outputs a coarse 3D model represented as an assembly of primitives, along with the target's pose relative to the camera. This assembly of primitives is then used to initialize 3DGS, significantly reducing the number of training iterations and input images needed -- by at least an order of magnitude. For additional flexibility, the CNN component has multiple variants with different pose estimation techniques. This work performs a comparison between these variants, evaluating their effectiveness for downstream 3DGS training under noisy or implicit pose estimates. The results demonstrate that even with imperfect pose supervision, the pipeline is able to learn high-fidelity 3D representations, opening the door for the use of novel view synthesis in space applications.

3D重建航天器建模3DGS快速初始化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。