数据增强能显著缩小太空视觉模型的域差距,提升检测可靠性。
How Important are Data Augmentations to Close the Domain Gap for Object Detection in Orbit?
- 系统测试多种增强方法,优化超参数以模拟轨道影像特征。
- 在SPEED+数据集上,增强后模型性能显著提升,尤其改善低信噪比场景。
- 适合从事航天视觉、遥感检测或需鲁棒性部署的研究者参考。
我们研究了数据增强在缩小空间计算机视觉中域差距的作用,这对自主在轨服务等任务至关重要。随着太空视觉应用增多,恶劣光照和低信噪比严重制约性能。尽管基于学习的算法表现良好,但其应用受限于大量标注数据需求及仿真与真实图像间的域差距。本研究通过大规模实验,采用超参数优化流程,测试数百种增强配置,探索经典色彩/几何变换、噪声与退化等策略对域泛化的影响。以2D目标检测为基准任务,在包含真实硬件在环卫星图像的SPEED+数据集上评估,涵盖Mask R-CNN、Faster R-CNN、YOLO-v7与GroundingDINO四类检测器,分析其在性能、推理速度与训练时间间的权衡。结果表明,数据增强对提升模型跨域性能、鲁棒性与可靠性至关重要。我们提出两种专为模拟轨道视觉效果设计的新增强方法,并推荐最有效的方案以推进复杂轨道环境下的计算机视觉应用。训练代码与超参数搜索工具将公开。
原文摘要 · Abstract (English)
We investigate the efficacy of data augmentations to close the domain gap in spaceborne computer vision, crucial for autonomous operations like on-orbit servicing. As the use of computer vision in space increases, challenges such as hostile illumination and low signal-to-noise ratios significantly hinder performance. While learning-based algorithms show promising results, their adoption is limited by the need for extensive annotated training data and the domain gap that arises from differences between synthesized and real-world imagery. This study explores domain generalization in terms of data augmentations -- classical color and geometric transformations, corruptions, and noise -- to enhance model performance across the domain gap. To this end, we conduct an large scale experiment using a hyperparameter optimization pipeline that samples hundreds of different configurations and searches for the best set to bridge the domain gap. As a reference task, we use 2D object detection and evaluate on the SPEED+ dataset that contains real hardware-in-the-loop satellite images in its test set. Moreover, we evaluate four popular object detectors, including Mask R-CNN, Faster R-CNN, YOLO-v7, and the open set detector GroundingDINO, and highlight their trade-offs between performance, inference speed, and training time. Our results underscore the vital role of data augmentations in bridging the domain gap, improving model performance, robustness, and reliability for critical space applications. As a result, we propose two novel data augmentations specifically developed to emulate the visual effects observed in orbital imagery. We conclude by recommending the most effective augmentations for advancing computer vision in challenging orbital environments. Code for training detectors and hyperparameter search will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。