融合雷达图像多视图信息,提升分类准确率与可信度
Multiview Manifold Evidential Fusion for PolSAR Image Classification
- 将协方差矩阵与多特征分别映射到HPD与格拉斯曼流形上学习
- 通过证据融合量化各视图不确定性,提升分类可靠性
- 适用于高精度遥感图像分类,尤其关注结果可解释性
极化合成孔径雷达(PolSAR)的协方差矩阵及其提取的多特征(如散射角、熵、纹理、边界描述符)提供了互补且物理可解释的信息。传统融合方法通常直接拼接特征或使用深度网络组合,但忽略了协方差矩阵与多特征分属不同流形,几何结构差异显著,且未考虑各视图重要性及不确定性,导致预测不可靠。为此,提出多视图流形证据融合(MMEFnet)方法,将PolSAR流形学习与证据融合统一建模。协方差矩阵在赫米特正定(HPD)流形上表示,多特征在格拉斯曼流形上建模,分别设计两种核度量学习网络学习其流形表示。随后,采用可信多视图证据融合替代传统Softmax分类器,从深度特征中估计信念质量并量化各视图不确定性。最后,基于Dempster-Shafer理论融合证据,实现更可靠、可解释的分类。在三个真实PolSAR数据集上的实验表明,该方法在准确率、鲁棒性和可解释性上均优于现有方法。
原文摘要 · Abstract (English)
Polarimetric Synthetic Aperture Radar (PolSAR) covariance matrices and their extracted multi-features - such as scattering angle, entropy, texture, and boundary descriptors - provide complementary and physically interpretable information for image classification. Traditional fusion strategies typically concatenate these features or employ deep learning networks to combine them. However, the covariance matrices and multi-features, as two complementary views, lie on different manifolds with distinct geometric structures. Existing fusion methods also overlook the varying importance of different views and ignore uncertainty, often leading to unreliable predictions. To address these issues, we propose a Multiview Manifold Evidential Fusion (MMEFnet) method to effectively fuse these two views. It gives a new framework to integrate PolSAR manifold learning and evidence fusion into a unified architecture. Specifically, covariance matrices are represented on the Hermitian Positive Definite (HPD) manifold, while multi-features are modeled on the Grassmann manifold. Two different kernel metric learning networks are constructed to learn their manifold representations. Subsequently, a trusted multiview evidence fusion, replacing the conventional softmax classifier, estimates belief mass and quantifies the uncertainty of each view from the learned deep features. Finally, a Dempster-Shafer theory-based fusion strategy combines evidence, enabling a more reliable and interpretable classification. Extensive experiments on three real-world PolSAR datasets demonstrate that the proposed method consistently outperforms existing approaches in accuracy, robustness, and interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。