用虚拟鱼合成逼真水下图像,提升无监督分割效果
Closer to Ground Truth: Realistic Shape and Appearance Labeled Data Generation for Unsupervised Underwater Image Segmentation
- 将虚拟鱼通过形变与配色融合到真实水下场景生成训练数据
- 在DeepFish和新构建的DeepSalmon数据集上接近有监督顶尖模型性能
- 适合水下生物检测、自动化渔业监测等实际应用
解决水下视频中的鱼类分割问题具有重要的实际价值,但受拍摄环境复杂、能见度差及标注数据稀缺制约。为此,本文提出一种两阶段无监督分割方法,无需人工标注,结合人工生成与真实图像。通过薄板样条形变与颜色直方图匹配对虚拟鱼进行变换,并将其置于真实水下环境中,生成逼近真实数据的合成图像。在主流DeepFish数据集上,该方法性能接近全监督最先进模型;针对大西洋鲑鱼分割,本文构建了迄今最大的同类数据集DeepSalmon(30 GB)。此外,该方法还能提升现有全监督顶尖模型的性能。
原文摘要 · Abstract (English)
Solving fish segmentation in underwater videos, a real-world problem of great practical value in marine and aquaculture industry, is a challenging task due to the difficulty of the filming environment, poor visibility and limited existing annotated underwater fish data. In order to overcome these obstacles, we introduce a novel two stage unsupervised segmentation approach that requires no human annotations and combines artificially created and real images. Our method generates challenging synthetic training data, by placing virtual fish in real-world underwater habitats, after performing fish transformations such as Thin Plate Spline shape warping and color Histogram Matching, which realistically integrate synthetic fish into the backgrounds, making the generated images increasingly closer to the real world data with every stage of our approach. While we validate our unsupervised method on the popular DeepFish dataset, obtaining a performance close to a fully-supervised SoTA model, we further show its effectiveness on the specific case of salmon segmentation in underwater videos, for which we introduce DeepSalmon, the largest dataset of its kind in the literature (30 GB). Moreover, on both datasets we prove the capability of our approach to boost the performance of the fully-supervised SoTA model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。