将光谱转为二维图像,提升植物性状预测精度。
Turning spectra into images improves plant trait retrieval with 2D-CNNs

- 把一维光谱重塑为二维图像,用2D-CNN捕捉波段间长程依赖。
- 最优方法在7897个样本上达R²=0.684,比1D模型提升0.097。
- 适合关注植物性状反演与光谱可视化解释的研究者。
高光谱反射率光谱可实现植物功能性状的非破坏性估计,但现有深度学习方法将光谱视为一维序列,难以捕捉远距离波段依赖关系。本文探究将一维光谱转化为二维图像表示是否能提升卷积神经网络对多性状的预测能力。在包含7,897个标注光谱、8个性状、波长范围400-2450 nm的GreenHyperSpectra数据集上,使用EfficientNet-B0对比了九种变换方式,结果表明最简单的直接重塑方法表现最佳(R² = 0.684 ± 0.001),显著优于当前最优的1D基线(R² = 0.587,提升0.097)。进一步预训练一个2D掩码自编码器(MAE-2D)于13.9万张无标签光谱图像,线性探测(冻结编码器,仅训练MLP头)达到R² = 0.646,超越所有1D自监督方法,包括微调后的MAE-1D(R² = 0.641)。跨数据集评估中所有模型性能大幅下降,无一显著优于1D基线。通过集成梯度和Grad-CAM分析,发现蛋白质(r = 0.45)与叶片水分(r = 0.33)的敏感性与PROSAIL辐射传输模型模拟一致,而类胡萝卜素(r = 0.06)和叶面积指数(r = -0.11)不一致,表明模型更依赖具有明显吸收特征的叶部化学信息。2D表示的优势而非架构复杂性或ImageNet预训练是性能提升的关键。
原文摘要 · Abstract (English)
Hyperspectral reflectance spectroscopy enables non-destructive estimation of plant functional traits, yet current deep learning approaches process spectra as one-dimensional sequences, which limits how they capture long-range inter-band dependencies. We asked whether transforming 1D spectra into 2D image representations improves multi-trait prediction with convolutional neural networks (CNN). We compared nine transformations using EfficientNet-B0 on the GreenHyperSpectra dataset (7,897 labeled spectra, eight traits, 400-2450 nm), benchmarked against published 1D CNN results on the same split. Trained from scratch, the simplest transformation, a direct Reshape of the spectrum into a 2D grid, performed best ($R^2 = 0.684 \pm 0.001$) and improved on the state-of-the-art 1D baseline ($R^2 = 0.587$, $+0.097$). We then pretrained a 2D masked autoencoder (MAE-2D) on 139,000 unlabeled spectral images. Linear probing, which freezes the encoder and trains only a multilayer perceptron head, reached $R^2 = 0.646$ and exceeded every 1D self-supervised counterpart, including the fine-tuned MAE-1D ($R^2 = 0.641$). Under cross-dataset evaluation all models lost most of their accuracy and none beat the 1D baseline significantly. To identify which wavelengths drive each prediction, we applied Integrated Gradients and Grad-CAM and unfolded band importance back to the spectral axis. Protein ($r = 0.45$) and leaf water ($r = 0.33$) agreed with sensitivities simulated by the PROSAIL radiative-transfer model, while carotenoids ($r = 0.06$) and leaf area index ($r = -0.11$) did not, showing that the model reads established leaf chemistry for traits with sharp absorption features. The representational advantage of 2D spectral images, rather than architectural complexity or ImageNet pretraining, drives the gain over 1D approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。