用扩散模型思路修复遥感小目标,提升运动物体检测精度
DiffMOD: Progressive Diffusion Point Denoising for Moving Object Detection in Remote Sensing
- 将遥感小目标检测建模为逐步去噪过程,点状特征逐轮恢复
- 在RsData数据集上达到85.3%的mAP,显著优于传统方法
- 适合处理低分辨率、噪声大场景下的运动目标检测任务
遥感中的运动物体检测面临分辨率低、目标极小和复杂噪声干扰等挑战。现有深度学习方法依赖概率密度估计,限制了物体间及跨时序的信息交互。为此,本文提出一种基于点的遥感运动物体检测方法。受扩散模型启发,网络优化被建模为渐进式去噪过程,逐步从稀疏噪声点中恢复运动物体中心。具体地,从主干网络输出采样分散特征作为基本单元,同时聚合全局特征以弥补稀疏点特征覆盖不足。通过建模空间相对位置与语义亲和性,设计空间关系聚合注意力机制,实现点级特征间的高阶交互,增强物体表征。为提升时序一致性,提出时序传播与全局融合模块,利用隐式记忆推理机制实现鲁棒的跨帧特征融合。为适配渐进去噪过程,设计渐进式MinK最优传输分配策略,在每个去噪阶段建立专用学习目标。此外,引入缺失损失函数以缓解去噪后点聚集于显著目标的问题。在RsData遥感运动物体检测数据集上的实验表明,基于散点去噪的检测方法能更有效挖掘稀疏运动物体间的潜在关系,显著提升检测能力与时序一致性。
原文摘要 · Abstract (English)
Moving object detection (MOD) in remote sensing is significantly challenged by low resolution, extremely small object sizes, and complex noise interference. Current deep learning-based MOD methods rely on probability density estimation, which restricts flexible information interaction between objects and across temporal frames. To flexibly capture high-order inter-object and temporal relationships, we propose a point-based MOD in remote sensing. Inspired by diffusion models, the network optimization is formulated as a progressive denoising process that iteratively recovers moving object centers from sparse noisy points. Specifically, we sample scattered features from the backbone outputs as atomic units for subsequent processing, while global feature embeddings are aggregated to compensate for the limited coverage of sparse point features. By modeling spatial relative positions and semantic affinities, Spatial Relation Aggregation Attention is designed to enable high-order interactions among point-level features for enhanced object representation. To enhance temporal consistency, the Temporal Propagation and Global Fusion module is designed, which leverages an implicit memory reasoning mechanism for robust cross-frame feature integration. To align with the progressive denoising process, we propose a progressive MinK optimal transport assignment strategy that establishes specialized learning objectives at each denoising level. Additionally, we introduce a missing loss function to counteract the clustering tendency of denoised points around salient objects. Experiments on the RsData remote sensing MOD dataset show that our MOD method based on scattered point denoising can more effectively explore potential relationships between sparse moving objects and improve the detection capability and temporal consistency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。