用扩散模型生成适配新雷达的仿真图像,解决数据不足难题。
Cross-Sensor SAR Data Generation Using Diffusion Models and Feature Migration

- 通过文本提示控制类别,生成特定目标的合成雷达图。
- 利用注意力蒸馏迁移真实数据的纹理与斑点特征,匹配新传感器特性。
- 适用于新雷达系统快速部署,尤其适合缺乏标注数据的场景。
不同合成孔径雷达(SAR)传感器在分辨率、极化模式和频段上差异显著,导致现有模型难以直接应用于新型发射的SAR卫星。新系统需大量标注数据重新训练模型,但短时间内获取足够数据常不可行。为此,本文提出一种数据生成与迁移框架,结合稳定扩散模型与注意力蒸馏机制,利用历史SAR数据生成适配新系统特性的训练数据。具体地,微调多模态扩散变换器(MM-DiT)中的低秩适应(LoRA)模块,实现由文本提示引导的类别可控SAR图像生成;为进一步确保生成图像反映目标传感器的统计特性和成像特征,引入注意力蒸馏机制,将真实目标域数据中的空间纹理、斑点分布与结构模式等传感器特异性特征迁移至生成模型。在两套真实星载SAR系统的多类飞机目标数据集上进行的大量实验表明,该方法能有效缓解数据稀缺问题,并支持跨传感器遥感应用。
原文摘要 · Abstract (English)
Different synthetic aperture radar (SAR) sensors vary significantly in resolution, polarization modes, and frequency bands, making it difficult to directly apply existing models to newly launched SAR satellites. These new systems require large amounts of labeled data for model retraining, but collecting sufficient data in a short time is often infeasible. To address this contradiction, this paper proposes a data generation and transfer framework, integrating a stable diffusion model with attention distillation, that leverages historical SAR data to synthesize training data tailored to the unique characteristics of new SAR systems. Specifically, we fine-tune the low-rank adaptation (LoRA) modules within the multimodal diffusion transformer (MM-DiT) architecture to enable class-controllable SAR image generation guided by textual prompts. To ensure that the generated images reflect the statistical properties and imaging characteristics of the target SAR system, we further introduce an attention distillation mechanism that transfers sensor-specific features, such as spatial texture, speckle distribution, and structural patterns, from real target-domain data to the generative model. Extensive experiments on multi-class aircraft target datasets from two real spaceborne SAR systems demonstrate the effectiveness of the proposed approach in alleviating data scarcity and supporting cross-sensor remote sensing applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。