用可控配方生成真实水下图像数据,提升视觉算法测试可靠性
Optical Ocean Recipes: Creating Realistic Datasets to Facilitate Underwater Vision Research
- 通过校准光吸收与散射添加剂,构建可重复的水下成像环境
- 支持水体参数估计、图像修复等多任务的真值数据生成
- 适合水下视觉研究者进行可控实验和算法验证
水下机器视觉的发展与评估仍面临挑战,常依赖针对特定应用的试错式测试。这主要源于缺乏能反映光学难题(如光谱衰减导致的颜色失真、后向散射与体积散射引起的对比度下降和模糊、自然或人工光源的动态光照)的受控、带真值的数据集。此外,海洋水体在不同区域、深度和季节间外观差异显著。但多数视觉评估仅在特定水体类型和成像条件下进行,泛化能力有限。对开放水域多种场景的全面测试在技术上不现实。为此,我们提出“Optical Ocean Recipes”框架,可在受控条件下生成逼真的水下数据集。不同于合成或野外数据,该方法利用校准的色彩与散射添加剂,实现可重复、可控的水体成分影响测试。该环境可生成水体参数估计、图像修复、分割、视觉SLAM及水下图像合成等任务的真值数据。我们提供基于该框架生成的演示数据集,并简要展示其在两项水下视觉任务中的应用。数据集与评估代码将公开。
原文摘要 · Abstract (English)
The development and evaluation of machine vision in underwater environments remains challenging, often relying on trial-and-error-based testing tailored to specific applications. This is partly due to the lack of controlled, ground-truthed testing environments that account for the optical challenges, such as color distortion from spectrally variant light attenuation, reduced contrast and blur from backscatter and volume scattering, and dynamic light patterns from natural or artificial illumination. Additionally, the appearance of ocean water in images varies significantly across regions, depths, and seasons. However, most machine vision evaluations are conducted under specific optical water types and imaging conditions, therefore often lack generalizability. Exhaustive testing across diverse open-water scenarios is technically impractical. To address this, we introduce the \textit{Optical Ocean Recipes}, a framework for creating realistic datasets under controlled underwater conditions. Unlike synthetic or open-water data, these recipes, using calibrated color and scattering additives, enable repeatable and controlled testing of the impact of water composition on image appearance. Hence, this provides a unique framework for analyzing machine vision in realistic, yet controlled underwater scenarios. The controlled environment enables the creation of ground-truth data for a range of vision tasks, including water parameter estimation, image restoration, segmentation, visual SLAM, and underwater image synthesis. We provide a demonstration dataset generated using the Optical Ocean Recipes and briefly demonstrate the use of our system for two underwater vision tasks. The dataset and evaluation code will be made available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。