arXiv:2501.01132cs.LGcs.AI2025-01被引 5

用缺失数据模拟多种视图,提升遥感模型鲁棒性

Missing Data as Augmentation in the Earth Observation Domain: A Multi-View Learning Approach

  • 将缺失视图作为训练样本的多样性来源,动态融合多视图信息
  • 在中等缺失率下模型鲁棒性显著提升,全视图时性能更优
  • 无需补全数据,适配任意视图组合,适合复杂遥感场景

多视图学习(MVL)通过融合多个异构数据源提升机器学习模型性能与鲁棒性。在遥感领域,视图常受缺失数据影响。尽管缺失数据通常降低预测精度,但已有研究将其作为数据增强手段(如输入掩码)。受此启发,本文提出针对遥感应用的新型多视图学习方法,通过组合所有可能的缺失视图模式生成训练样本。不采用数值填充,而是使用动态合并函数(如平均、Transformer),使模型可完全忽略缺失视图,从而增强预测鲁棒性。在四个遥感数据集(含时序与静态视图)上验证,结果表明:在中等缺失情况下模型鲁棒性提升;全视图时预测性能也更优。该方法可统一处理任意视图组合,实现自适应运行。

原文摘要 · Abstract (English)

Multi-view learning (MVL) leverages multiple sources or views of data to enhance machine learning model performance and robustness. This approach has been successfully used in the Earth Observation (EO) domain, where views have a heterogeneous nature and can be affected by missing data. Despite the negative effect that missing data has on model predictions, the ML literature has used it as an augmentation technique to improve model generalization, like masking the input data. Inspired by this, we introduce novel methods for EO applications tailored to MVL with missing views. Our methods integrate the combination of a set to simulate all combinations of missing views as different training samples. Instead of replacing missing data with a numerical value, we use dynamic merge functions, like average, and more complex ones like Transformer. This allows the MVL model to entirely ignore the missing views, enhancing its predictive robustness. We experiment on four EO datasets with temporal and static views, including state-of-the-art methods from the EO domain. The results indicate that our methods improve model robustness under conditions of moderate missingness, and improve the predictive performance when all views are present. The proposed methods offer a single adaptive solution to operate effectively with any combination of available views.

遥感多视图学习缺失数据动态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。