arXiv:2505.03677cs.LG2025-05

用积分算子学习光谱分类,小样本下表现更稳。

Neural Integral Operators for Inverse Problems: An Operator-Learning Framework for Small-Sample Spectroscopic Classification

  • 用神经网络参数化积分算子,联合训练编码器和核函数。
  • 在小样本光谱数据上,性能优于传统与深度模型,尤其在纺织品数据集上最佳。
  • 蒙特卡洛采样隐含正则化,降低过拟合,适合数据少的逆问题。

在训练数据稀缺时,标准深度网络易过拟合,而学习函数空间间的映射是软计算的核心挑战。本文提出基于第一类积分方程的神经积分算子(NIO)框架:通过前馈网络 $G_{θ_G}$ 参数化乌里索恩核,卷积编码器 $E_{ϕ_E}$ 生成潜在函数,两者端到端联合训练,使用交叉熵损失。积分通过蒙特卡洛采样近似,该过程在被积函数层面起到隐式随机正则化作用,补充权重衰减、丢弃等参数级正则。在三个真实光谱分类任务(FT-IR果泥、NIR肉类、NIR纺织品)上测试,涵盖不同规模与复杂度,对比传统机器学习(决策树、SVM,带/不带UMAP)及现代深度学习基线(FFNN、CNN+FFNN、浅层CNN、Transformer)。NIO在所有数据集和指标中均位列前二,尤其在最复杂的小样本纺织品数据集上表现最优,且在小样本条件下性能方差低于其他深度模型。结果表明,结合随机数值积分的算子学习架构,是光谱逆问题中数据稀缺场景下的可行策略。

原文摘要 · Abstract (English)

Learning maps between function spaces with a strong inductive bias is a central challenge in soft computing, especially when training data are scarce and standard deep architectures overfit. We introduce a \emph{neural integral operator} (NIO) framework based on integral equations of the first kind, in which the Urysohn kernel of the operator is parameterized by a feed-forward network~$G_{θ_G}$ and the latent function is produced by a convolutional encoder~$E_{ϕ_E}$, both trained jointly end-to-end via cross-entropy loss. The integral defining the learned operator is approximated by Monte Carlo sampling, which we argue acts as an implicit stochastic regularizer operating at the level of the integrand and complementing parameter-level regularizers such as weight decay and dropout. We benchmark the framework on three real-world spectroscopic classification tasks (FT-IR fruit purees, NIR meat, NIR textiles) of varying size and complexity, against traditional machine learning (decision tree, support vector machine, with and without UMAP) and modern deep learning baselines (FFNN, CNN+FFNN, shallow CNN, transformer). The proposed NIO is consistently among the top two performing models across all datasets and metrics, achieves the best results on the most challenging small-and-complex dataset (Textile), and yields lower performance variance than competing deep models in the small-data regime. The results suggest that operator-learning architectures with stochastic numerical integration are a viable soft-computing strategy for inverse problems in spectroscopy when conventional deep learning approaches are limited by data scarcity.

积分算子小样本光谱分类正则化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。