arXiv:2605.02636cs.LGphysics.optics2026-05被引 1

破解近红外光谱深度学习中的设计矛盾,提出条件化建模框架。

Convolutional Neural Networks in Vis-NIR Chemometrics: From Contradiction to Conditional Design

  • 基于感受野原理重构卷积核设计逻辑,关联波长范围与实际使用区域。
  • 揭示验证策略隐含超参数特性,随机划分可能误导模型泛化评估。
  • 适合需提升模型可复现性与跨场景迁移能力的化学计量研究者。

近红外(NIR)和可见-近红外(Vis-NIR)光谱广泛用于食品、农业、制药、过程分析技术及生物过程监测中的快速、无损分析。然而,深度学习在NIR化学计量学中的研究常对卷积神经网络(CNN)设计产生相互矛盾的结论,包括卷积核大小、模型深度、预处理方法、模型复杂度及迁移鲁棒性等。本综述指出,许多看似矛盾的结果实因实验条件不完整所致。CNN性能受光谱物理特性、数据集特征、采集协议、验证设计及部署条件之间相互作用的影响。我们围绕三个调节因素梳理文献:首先,NIR信号为间接测量,高度共线,受宽重叠带、散射、温度及基质效应影响;其次,应通过感受野推理理解CNN设计:核大小、深度、空洞率及多尺度分支决定模型可访问的波长范围,而有效感受野反映实际使用的部分;第三,验证设计可能成为隐藏超参数,因随机划分可能奖励利用批次、仪器、季节或工艺运行结构的架构,而非可转移的化学信息。因此,我们提出一种条件化设计框架,将预处理、架构、超参数优化、迁移评估、可解释性与可复现性视为耦合组件。该框架不追求普适最优的CNN,而是支持物理感知、漂移感知且可复现的模型比较,推动更可靠的近红外化学计量建模。

原文摘要 · Abstract (English)

Near-infrared (NIR and Vis-NIR) spectroscopy is widely used for rapid, non-destructive analysis in food, agriculture, pharmaceuticals, process analytical technology, and bioprocess monitoring. Nevertheless, deep-learning studies in NIR chemometrics often reach conflicting conclusions about convolutional neural network (CNN) design, including kernel size, depth, preprocessing, model complexity, and transfer robustness. This review argues that many apparent contradictions reflect incomplete experimental conditioning rather than incompatible findings. CNN performance depends on interactions among spectral physics, dataset regime, acquisition protocol, validation design, and deployment conditions. We organize the literature around three moderators. First, NIR signals are indirect, highly collinear, and shaped by broad overlapping bands, scattering, temperature, and matrix effects. Second, CNN design should be interpreted through receptive-field reasoning: kernel size, depth, dilation, and multi-scale branches determine the wavelength span available to the model, whereas the effective receptive field indicates which parts are actually used. Third, validation design can behave as a hidden hyperparameter because random splits may reward architectures that exploit shared batch, instrument, season, or process-run structure instead of transferable chemical information. We therefore propose a conditional design framework in which preprocessing, architecture, hyperparameter optimization, transfer evaluation, interpretability, and reproducibility are treated as coupled components. Rather than seeking a universally optimal CNN, the framework aims to support physics-aware, shift-aware, and reproducible model comparison in NIR chemometrics.

近红外光谱深度学习卷积神经网络化学计量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。