为航天器实时自主检测构建6.4万张标注图像数据集,提升在轨维修安全性。
A New Dataset and Performance Benchmark for Real-time Spacecraft Segmentation in Onboard Computers
- 用真实航天器模型叠加真实与合成背景生成数据,模拟太空环境挑战
- 在硬件约束下实现0.5秒推理、Dice分数0.92、豪斯多夫距离0.69的性能
- 适合研究空间机器人视觉、在轨自主检测与嵌入式模型部署的团队
太空中部署的航天器常因暴露于危险环境而受损,后续通过宇航员出舱或机器人操作进行在轨维修存在重大风险且成本高昂。近年来图像分割技术有望实现可靠、低成本的自主检测系统。然而,这些模型通常需要大量训练数据,而公开的航天器分割标注数据极为稀缺。本文提出一个包含近64,000张标注航天器图像的新数据集,基于真实航天器模型,叠加由NASA TTALOS管道生成的真实与合成背景,并引入噪声与相机畸变以模拟真实图像采集中的各类挑战。数据集涵盖噪声、畸变、眩光、光照变化、视场差异、部分可见、亮色城市背景、密集纹理背景、极光及多种航天器几何形态等现实难题。我们对YOLOv8和YOLOv11模型进行微调,在模拟真实航天器上行计算资源与推理时间约束条件下建立性能基准。测试结果显示,模型在约0.5秒内完成推理,获得0.92的Dice分数与0.69的豪斯多夫距离。相关数据集与基准模型已开源至https://github.com/RiceD2KLab/SWiM。
原文摘要 · Abstract (English)
Spacecraft deployed in outer space are routinely subjected to various forms of damage due to exposure to hazardous environments. In addition, there are significant risks to the subsequent process of in-space repairs through human extravehicular activity or robotic manipulation, incurring substantial operational costs. Recent developments in image segmentation could enable the development of reliable and cost-effective autonomous inspection systems. While these models often require large amounts of training data to achieve satisfactory results, publicly available annotated spacecraft segmentation data are very scarce. Here, we present a new dataset of nearly 64k annotated spacecraft images that was created using real spacecraft models, superimposed on a mixture of real and synthetic backgrounds generated using NASA's TTALOS pipeline. To mimic camera distortions and noise in real-world image acquisition, we also added different types of noise and distortion to the images. Our dataset includes images with several real-world challenges, including noise, camera distortions, glare, varying lighting conditions, varying field of view, partial spacecraft visibility, brightly-lit city backgrounds, densely patterned and confounding backgrounds, aurora borealis, and a wide variety of spacecraft geometries. Finally, we finetuned YOLOv8 and YOLOv11 models for spacecraft segmentation to generate performance benchmarks for the dataset under well-defined hardware and inference time constraints to mimic real-world image segmentation challenges for real-time onboard applications in space on NASA's inspector spacecraft. The resulting models, when tested under these constraints, achieved a Dice score of 0.92, Hausdorff distance of 0.69, and an inference time of about 0.5 second. The dataset and models for performance benchmark are available at https://github.com/RiceD2KLab/SWiM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。