优化特征工程可显著提升海洋遥感算法精度,适用于不同模型与水质参数。
The impact of feature engineering and an optimisation framework for ocean colour machine learning

- 提出七级数据变换框架,系统优化海洋光学数据特征
- 优化后模型相关系数最高达0.55(叶绿素)和0.68(透明度)
- 对多种模型有效,适合海岸水质监测场景
机器学习广泛用于海洋光学算法开发,但多数研究聚焦于模型参数与超参数调优,对输入数据的特征工程(FE)关注不足。本文评估了特征工程在海洋光学机器学习中的影响,并提出包含七级数据转换的优化框架:波段选择、对数缩放、光谱形状归一化、指数提取、主成分分析、特征缩放、零一归一化。以挪威近海的哨兵-3 OLCI数据为样本,针对多层感知机、支持向量机和极端梯度提升树,训练估计叶绿素a浓度[Chl-a]和塞奇盘深度(Zsd)。结果显示,现有六项研究中使用的特征工程导致性能差异显著:Chl-a的决定系数R在0.01至0.55之间,Zsd在0.15至0.68之间;而本文优化后的特征工程表现最优。采用优化特征工程的模型,相比CHL_OC4ME和CHL_NN标准算法,相关系数提升两倍,平均绝对误差降低最高达63%。然而,未发现适用于所有目标变量与模型的通用最优特征工程,表明每项应用均需独立优化。该框架可显著提升近海水质监测精度。
原文摘要 · Abstract (English)
Machine learning (ML) is widely used for the development of ocean colour algorithms, but most studies focus on model parameter training and hyperparameter tuning. The optimisation of the data that feeds the models - i.e., Feature Engineering (FE) - is not fully explored. We assess the impact of FE in ocean colour machine learning models and we propose an optimisation framework that includes seven sequenced levels of data transformation: i. band choice, ii. log scaling, iii. spectral shape normalisation, iv. index extraction, v. principal component analysis, vi. feature scaling, and vii. zero-to-one scaling. We demonstrate the application for Multi-layer perceptron, Support Vector Machines, and eXtreme Gradient Boosting Trees on Sentinel-3 OLCI observations in the Norwegian coastal waters. The models are trained to estimate Chlorophyll-a concentration [Chl-a] and Secchi disk depth (Zsd). Results show that accuracy is highly variable among FE found in six studies using Sentinel-3 OLCI and the ones that we optimise. The R range from 0.01 to 0.55 for [Chl-a] and from 0.15 to 0.68 for Zsd, where the optimised FE shows the top results. The ML models with optimised FE could also improve by two times the R and reduce up to 63% of the mean absolute error when compared to CHL_OC4ME and CHL_NN standard algorithms. Nevertheless, no common optimised FE is found for all target variables and ML models, suggesting that FE optimisation is necessary for each application. Therefore, our proposed framework can be key for improving the accuracy of water quality monitoring in coastal waters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。