用信息散度正则化提升火星岩石成分预测精度
Regularization via f-Divergence: An Application to Multi-Oxide Spectroscopic Analysis
- 基于f-散度设计新正则化方法,约束预测与噪声目标分布差异
- 在火星环境光谱数据上,性能优于或媲美L1/L2/Dropout等传统正则
- 适合行星科学中的多氧化物成分反演任务,尤其适用于噪声数据
本文研究利用卷积神经网络(CNN)分析行星表面化学成分,目标是根据火星环境下遥感仪器采集的光谱数据,预测岩石样本中多种氧化物的含量。将此问题建模为多目标回归任务,提出一种基于f-散度的新型正则化方法,通过约束预测分布与含噪目标分布之间的差异,缓解过拟合。该正则项兼具双重作用:一方面限制分布差异以防止过拟合,另一方面作为辅助损失函数,惩罚预测与目标分布间过大差异。为支持反向传播,开发了可微分的f-散度并集成至训练流程。实验使用好奇号和毅力号探测器在类火星环境中获取的光谱数据,结果表明,所提f-散度正则化在多氧化物含量预测任务中表现优于或相当于L1、L2和Dropout等标准正则方法;进一步地,将其与传统正则结合后性能显著提升,超越单一正则方法。
原文摘要 · Abstract (English)
In this paper, we address the task of characterizing the chemical composition of planetary surfaces using convolutional neural networks (CNNs). Specifically, we seek to predict the multi-oxide weights of rock samples based on spectroscopic data collected under Martian conditions. We frame this problem as a multi-target regression task and propose a novel regularization method based on f-divergence. The f-divergence regularization is designed to constrain the distributional discrepancy between predictions and noisy targets. This regularizer serves a dual purpose: on the one hand, it mitigates overfitting by enforcing a constraint on the distributional difference between predictions and noisy targets. On the other hand, it acts as an auxiliary loss function, penalizing the neural network when the divergence between the predicted and target distributions becomes too large. To enable backpropagation during neural network training, we develop a differentiable f-divergence and incorporate it into the f-divergence regularization, making the network training feasible. We conduct experiments using spectra collected in a Mars-like environment by the remote-sensing instruments aboard the Curiosity and Perseverance rovers. Experimental results on multi-oxide weight prediction demonstrate that the proposed $f$-divergence regularization performs better than or comparable to standard regularization methods including $L_1$, $L_2$, and dropout. Notably, combining the $f$-divergence regularization with these standard regularization further enhances performance, outperforming each regularization method used independently.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。