构建首个用于飞机油箱异物检测的仿真到现实数据集,提升模型在封闭环境下的检测能力。
FOD-S2R: A FOD Dataset for Sim2Real Transfer Learning based Object Detection
- 融合真实与合成图像,模拟油箱内复杂光照与视角变化
- 3114张实拍图+3137张引擎生成图,验证合成数据可提升检测准确率
- 适合航空维护、工业视觉检测方向研究者使用
飞机油箱内的外来物(FOD)会引发燃油污染、系统故障及维护成本上升等严重安全隐患。然而,针对油箱这类封闭复杂环境的专用数据集仍属空白。为此,我们提出FOD-S2R数据集,包含真实与合成图像,涵盖多种视场角(FOV)、物体距离、光照条件、颜色和尺寸。真实数据集由3,114张高分辨率图像构成,采集自受控油箱复制品;合成数据集则利用Unreal Engine生成3,137张图像。该数据集是首个系统评估合成数据在封闭结构中提升真实世界FOD检测性能的研究资源。实验表明,引入合成数据可有效提高目标检测模型的准确率与泛化能力,显著缩小仿真到现实的差距,为航空维护中的自动化FOD检测系统提供重要基础。
原文摘要 · Abstract (English)
Foreign Object Debris (FOD) within aircraft fuel tanks presents critical safety hazards including fuel contamination, system malfunctions, and increased maintenance costs. Despite the severity of these risks, there is a notable lack of dedicated datasets for the complex, enclosed environments found inside fuel tanks. To bridge this gap, we present a novel dataset, FOD-S2R, composed of real and synthetic images of the FOD within a simulated aircraft fuel tank. Unlike existing datasets that focus on external or open-air environments, our dataset is the first to systematically evaluate the effectiveness of synthetic data in enhancing the real-world FOD detection performance in confined, closed structures. The real-world subset consists of 3,114 high-resolution HD images captured in a controlled fuel tank replica, while the synthetic subset includes 3,137 images generated using Unreal Engine. The dataset is composed of various Field of views (FOV), object distances, lighting conditions, color, and object size. Prior research has demonstrated that synthetic data can reduce reliance on extensive real-world annotations and improve the generalizability of vision models. Thus, we benchmark several state-of-the-art object detection models and demonstrate that introducing synthetic data improves the detection accuracy and generalization to real-world conditions. These experiments demonstrate the effectiveness of synthetic data in enhancing the model performance and narrowing the Sim2Real gap, providing a valuable foundation for developing automated FOD detection systems for aviation maintenance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。