arXiv:2605.02137cs.CVcs.AI2026-05

用雷达和可见光数据融合,精准重建图像并识别洪水区域。

FLoRA: Fusion-Latent for Optical Reconstruction and Flood Area Segmentation via Cross-Modal Multi-Task Distillation Network

论文配图:FLoRA: Fusion-Latent for Optical Reconstruction and Flood Area Segmentation via Cross-Modal Multi-Task Distillation Network
图 1 · 摘自论文原文
  • 通过跨模态注意力融合雷达与光学数据,构建联合特征空间。
  • 在三个数据集上实现更高图像保真度和更准的洪水分割效果。
  • 适合灾害监测、遥感分析等需要多源数据融合的场景。

准确的洪水制图对灾害管理至关重要,但现有方法未能充分挖掘卫星影像的潜力。光学影像解释性强,但受环境影响;合成孔径雷达(SAR)可全天候覆盖,但视觉解释性差。FLoRA(Fusion Latent for Optical Reconstruction and Area Segmentation)是一种跨模态多任务框架,通过融合光学与SAR数据的互补优势,联合重建高保真光学影像并分割洪水区域。训练时,轻量级光学教师模型(基于RGB和NDVI先验)提供分层特征,通过多尺度窗口交叉注意力和FiLM调节引导SAR表示进入融合潜在空间,门控残差防止过校正。该设计实现双任务学习:(a) SAR到光学图像转换以实现细粒度RGB重建;(b) 洪水区域分割以支持水文分析。双解码器分别采用Charbonnier SSIM保证结构保真度,边缘FFT幅度损失提升光谱真实感,Dice BCE实现水体边缘的水文感知对齐。特征蒸馏约束进一步使融合后的SAR特征与光学教师特征流形对齐。在SEN1FLOODS11、DEEPFLOOD和SEN12MS上的评估表明,FLoRA在PSNR、SSIM和LPIPS指标上优于融合基线,证明在教师引导的潜在空间中进行多模态融合,能从星载观测中生成语义一致且物理合理的洪水智能信息。

原文摘要 · Abstract (English)

Accurate flood water mapping is critical for disaster management, yet current methods struggle to fully exploit the potential of spaceborne imagery. Optical data offers high interpretability but is limited by environmental conditions, whereas SAR provides reliable all-weather coverage with reduced visual interpretability. FLoRA (Fusion Latent for Optical Reconstruction and Area Segmentation) is a cross-modal multi-task framework that jointly reconstructs high-fidelity optical imagery and segments flood water regions from Sentinel 1 SAR by fusing the complementary strengths of optical and SAR data. During training, a lightweight optical teacher (driven by RGB and NDVI priors) provides pyramidal features that guide SAR representations into a fusion latent space via multiscale windowed cross attention and FiLM conditioning, with gated residuals preventing overcorrection. This design enables multi-task learning across two complementary objectives: (a) SAR-to-optical translation for fine-grained RGB reconstruction and (b) flood water region segmentation for hydrologic interpretation. The dual decoders are optimized using Charbonnier SSIM for structural fidelity, edge FFT magnitude losses for spectral realism, and Dice BCE hydrology-aware edge alignment for precise flood water delineation. A feature distillation constraint further aligns fused SAR features with the optical teacher's manifold. Evaluations on SEN1FLOODS11, DEEPFLOOD, and SEN12MS demonstrate that FLoRA surpasses fusion baselines in PSNR, SSIM, and LPIPS, demonstrating that multi-modal fusion within a teacher-guided latent space yields semantically faithful and physically consistent flood-water intelligence from spaceborne observations.

洪水检测遥感融合多模态学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。