用三维几何约束实现声学与光学图像精准对齐
Geometry-Driven Opti-Acoustic Co-Registration and View-Invariant Reflectivity Mapping for Side-Scan Sonar

- 基于三维重建构建声光图像的几何桥梁
- 消除声波传播损耗和视角依赖,还原海底真实反照率
- 无需人工标注,适合水下生态测绘与自监督学习
侧扫声呐(SSS)是大范围水下测绘的主要手段,但自动化感知与跨模态对齐受斑点噪声、阴影及极端视角依赖严重影响。传统手工特征与现代深度学习匹配器缺乏三维几何约束,难以弥合光学与声学图像间的物理域差距。为此,本文提出一种几何驱动的新框架,实现像素级声光联合配准与视角不变的反射率映射。利用结构光恢复(SfM)重建密集海底三维网格,作为视觉与声学域的几何锚点。提出首底返回(FBR)提取算法,动态校正未标定SfM重建带来的非线性高度漂移。结合逆朗伯模型与双高斯加权函数,分离出海底固有反射率,有效消除斜距传播损耗与几何视角依赖。通过确定性关联这些分离出的声学特性与光学像素,生成高精度、严格配准的多模态数据集。该自动化的物理引导方法无需人工标注,为底栖生境制图中的先进自监督学习铺平道路。
原文摘要 · Abstract (English)
Side-Scan Sonar (SSS) is a primary modality for large-scale underwater mapping, yet automated perception and cross-modal alignment are severely bottlenecked by acoustic complexities such as speckle noise, shadows, and extreme viewpoint dependencies. Traditional handcrafted descriptors and modern deep learning matchers fail to bridge the physical domain gap between optical and acoustic imagery without 3D geometric constraints. To overcome these limitations, we propose a novel geometry-driven framework for pixel-level opti-acoustic co-registration and view-invariant reflectivity mapping. Our method utilizes Structure-from-Motion (SfM) to reconstruct a dense 3D seafloor mesh, acting as a geometric anchor between the visual and acoustic domains. We introduce a First Bottom Return (FBR) extraction algorithm to dynamically correct non-linear altitude drift caused by uncalibrated SfM reconstruction. Furthermore, we apply an inverse Lambertian model and a dual-Gaussian weighting function to isolate the intrinsic seabed reflectivity, effectively neutralizing slant-range propagation loss and geometric view-dependence. By deterministically associating these isolated acoustic properties with optical pixels, our pipeline generates highly accurate, strictly co-registered multi-modal datasets. This automated, physics-guided approach eliminates the need for manual annotation and paves the way for advanced self-supervised learning in benthic habitat mapping.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。