arXiv:2409.11661cs.CV2024-09中稿 · Journal of Spacecr…被引 14

SPNv3让卫星视觉定位模型在真实太空环境中更可靠,且能在星载设备上高效运行。

Bridging the Domain Gap for Flight-Ready Spaceborne Vision

  • 用合成图像训练,通过架构优化与数据增强缩小仿真与真实图像的差距。
  • 在机器人测试平台实测中达到顶尖定位精度,且仅依赖合成数据训练。
  • 计算量低,可在飞行级硬件上稳定运行,适合近轨交会任务。

本文提出航天器位姿网络v3(SPNv3),一种用于已知非合作目标航天器单目位姿估计的神经网络。SPNv3设计注重计算效率,同时具备对地面训练未覆盖的真实空间图像的鲁棒性,满足星载边缘设备部署需求。通过精心的网络结构设计与全面的权衡分析,发现数据增强、迁移学习和视觉变换器架构等特征可协同提升鲁棒性并降低计算开销。实验表明,最终的SPNv3仅在计算机生成的合成图像上训练,却能在硬件在环的机器人测试平台真实图像上实现当前最优的位姿精度,有效弥合了合成与真实图像间的域差距。同时,该模型在具有飞行历史的图形处理单元系统上运行速度远超现代卫星导航滤波器的更新频率。总体而言,SPNv3是一个高效、可飞行部署的神经网络模型,适用于与在轨空间目标的近距离交会与逼近操作。

原文摘要 · Abstract (English)

This work presents Spacecraft Pose Network v3 (SPNv3), a Neural Network (NN) for monocular pose estimation of a known, non-cooperative target spacecraft. SPNv3 is designed and trained to be computationally efficient while providing robustness to spaceborne images that have not been observed during offline training and validation on the ground. These characteristics are essential to deploying NNs on space-grade edge devices. They are achieved through careful NN design choices, and an extensive trade-off analysis reveals features such as data augmentation, transfer learning and vision transformer architecture as a few of those that contribute to simultaneously maximizing robustness and minimizing computational overhead. Experiments demonstrate that the final SPNv3 can achieve state-of-the-art pose accuracy on hardware-in-the-loop images from a robotic testbed while having trained exclusively on computer-generated synthetic images, effectively bridging the domain gap between synthetic and real imagery. At the same time, SPNv3 runs well above the update frequency of modern satellite navigation filters when tested on a representative graphical processing unit system with flight heritage. Overall, SPNv3 is an efficient, flight-ready NN model readily applicable to close-range rendezvous and proximity operations with target resident space objects.

位姿估计星载模型域适应视觉导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。