研究深度学习在不同数据集间的泛化能力,发现训练数据多样性决定模型泛化效果。
Cross-Dataset Generalization in Deep Learning
- 通过增加训练数据多样性提升模型跨数据集泛化能力
- 发现网络学的是数据依赖的近似映射而非真实物理关系
- 适用于成像、重建等缺乏解析模型的领域
深度学习广泛应用于相位成像、3D重构、相位解缠和激光散斑抑制等复杂问题,尤其在缺乏解析模型的场景中。其数据驱动特性使网络能通过大量数据隐式构建数学关系。然而实际应用中的关键挑战是跨数据集泛化问题:在某一数据集上训练的模型难以识别另一数据集中的未知目标。本研究以散射介质成像为例,发现网络学习到的数学关系是训练数据依赖的近似,而非物理模型的真实映射。我们证明,增强训练数据多样性可改善该近似,从而实现跨数据集泛化,因为线性物理模型的映射关系与输入无关。该研究揭示了跨数据集泛化的本质,为设计训练数据提供了新思路,有助于解决各类基于深度学习应用中的泛化难题。
原文摘要 · Abstract (English)
Deep learning has been extensively used in various fields, such as phase imaging, 3D imaging reconstruction, phase unwrapping, and laser speckle reduction, particularly for complex problems that lack analytic models. Its data-driven nature allows for implicit construction of mathematical relationships within the network through training with abundant data. However, a critical challenge in practical applications is the generalization issue, where a network trained on one dataset struggles to recognize an unknown target from a different dataset. In this study, we investigate imaging through scattering media and discover that the mathematical relationship learned by the network is an approximation dependent on the training dataset, rather than the true mapping relationship of the model. We demonstrate that enhancing the diversity of the training dataset can improve this approximation, thereby achieving generalization across different datasets, as the mapping relationship of a linear physical model is independent of inputs. This study elucidates the nature of generalization across different datasets and provides insights into the design of training datasets to ultimately address the generalization issue in various deep learning-based applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。