AI+AR辅助卫星装配,提升精度与效率
AI-Powered Augmented Reality for Satellite Assembly, Integration and Test
- 用实时视觉与AR系统提供上下文提示和反馈
- 检测模型准确率超95%,所有模型均超70%
- 用合成数据与SAMAL自动标注,提速20倍
人工智能(AI)与增强现实(AR)的融合有望通过提高精度、减少人为错误并提升洁净室环境中的操作效率,彻底改变卫星装配、集成与测试(AIT)流程。本文介绍了欧洲空间局(ESA)的项目「AI for AR in Satellite AIT」的技术细节,该系统结合实时计算机视觉与AR技术,在卫星装配过程中为技术人员提供支持。采用微软HoloLens 2作为AR界面,系统可实现上下文感知的指令推送与实时反馈,解决AIT流程中物体识别与6D位姿估计的复杂性。所有AI模型准确率均超过70%,其中检测模型准确率超过95%,表明系统性能优异且可靠。本研究的关键贡献在于利用合成数据训练AR场景中的AI模型,解决了在高度动态的卫星环境中获取真实数据的难题;同时提出分割任意模型自动标注(SAMAL),实现真实数据的自动标注,速度比人工标注快达20倍。结果表明,基于AI的AR系统在自动化关键卫星装配任务方面具有显著成效,为航天领域未来创新奠定基础。
原文摘要 · Abstract (English)
The integration of Artificial Intelligence (AI) and Augmented Reality (AR) is set to transform satellite Assembly, Integration, and Testing (AIT) processes by enhancing precision, minimizing human error, and improving operational efficiency in cleanroom environments. This paper presents a technical description of the European Space Agency's (ESA) project "AI for AR in Satellite AIT," which combines real-time computer vision and AR systems to assist technicians during satellite assembly. Leveraging Microsoft HoloLens 2 as the AR interface, the system delivers context-aware instructions and real-time feedback, tackling the complexities of object recognition and 6D pose estimation in AIT workflows. All AI models demonstrated over 70% accuracy, with the detection model exceeding 95% accuracy, indicating a high level of performance and reliability. A key contribution of this work lies in the effective use of synthetic data for training AI models in AR applications, addressing the significant challenges of obtaining real-world datasets in highly dynamic satellite environments, as well as the creation of the Segmented Anything Model for Automatic Labelling (SAMAL), which facilitates the automatic annotation of real data, achieving speeds up to 20 times faster than manual human annotation. The findings demonstrate the efficacy of AI-driven AR systems in automating critical satellite assembly tasks, setting a foundation for future innovations in the space industry.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。