用生成式AI解决雷达图像数据少、难理解的问题
Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Survey
- 结合物理模型与生成AI,模拟真实雷达图像
- 提出混合建模方法提升图像生成质量与可解释性
- 适合遥感、AI交叉领域研究者参考
合成孔径雷达(SAR)图像因电磁特性具有独特属性,给人工观察和视觉AI理解带来挑战,主要瓶颈在于数据数量与质量。生成式人工智能(GenAI)为解决该问题提供新路径。本文系统梳理生成式AI与SAR的交叉研究,对比其与计算机视觉任务的异同,分析共性挑战。综述主流生成模型及其针对通用问题的变体,并探讨其在SAR领域的应用。重点总结基于物理模型的仿真方法,分析融合生成AI与可解释模型的混合建模策略。同时考察现有及潜在评估方法。最后讨论未来挑战与前景。本综述是首个全面覆盖SAR与生成式AI交叉领域的系统性工作,涵盖深度神经网络、物理模型、计算机视觉等多个方向。相关资源开源:https://github.com/XAI4SAR/GenAIxSAR。
原文摘要 · Abstract (English)
SAR images possess unique attributes that present challenges for both human observers and vision AI models to interpret, owing to their electromagnetic characteristics. The interpretation of SAR images encounters various hurdles, with one of the primary obstacles being the data itself, which includes issues related to both the quantity and quality of the data. The challenges can be addressed using generative AI technologies. Generative AI, often known as GenAI, is a very advanced and powerful technology in the field of artificial intelligence that has gained significant attention. The advancement has created possibilities for the creation of texts, photorealistic pictures, videos, and material in various modalities. This paper aims to comprehensively investigate the intersection of GenAI and SAR. First, we illustrate the common data generation-based applications in SAR field and compare them with computer vision tasks, analyzing the similarity, difference, and general challenges of them. Then, an overview of the latest GenAI models is systematically reviewed, including various basic models and their variations targeting the general challenges. Additionally, the corresponding applications in SAR domain are also included. Specifically, we propose to summarize the physical model based simulation approaches for SAR, and analyze the hybrid modeling methods that combine the GenAI and interpretable models. The evaluation methods that have been or could be applied to SAR, are also explored. Finally, the potential challenges and future prospects are discussed. To our best knowledge, this survey is the first exhaustive examination of the interdiscipline of SAR and GenAI, encompassing a wide range of topics, including deep neural networks, physical models, computer vision, and SAR images. The resources of this survey are open-source at \url{https://github.com/XAI4SAR/GenAIxSAR}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。