用深度神经网络预测非欧几里得响应,提升建模精度。
DFNN: A Deep Fréchet Neural Network Framework for Learning Metric-Space-Valued Responses
- 通过最小化弗雷歇风险,学习预测响应的条件弗雷歇均值。
- 在合成数据和真实就业构成预测中,性能优于现有方法。
- 适用于分布、网络等非欧空间响应,无需假设或局部平滑。
非欧几里得响应(如概率分布、网络、对称正定矩阵、组成数据)的回归在现代应用中日益重要。本文提出深度弗雷歇神经网络(DFNN),一种端到端深度学习框架,用于从欧氏预测变量中预测非欧几里得响应(视为度量空间中的随机对象)。该方法利用深度神经网络(DNN)的表征学习能力,通过最小化弗雷歇风险来逼近给定预测变量的响应条件弗雷歇均值,即度量空间中的条件期望类比。框架高度灵活,可处理多种度量和高维预测变量。我们建立了DFNN的通用逼近定理,将神经网络逼近理论推进至无模型假设、无需局部平滑的通用度量空间响应领域。在合成分布响应和网络响应数据,以及真实世界中预测就业职业构成的应用中,实验表明DFNN始终优于现有方法。
原文摘要 · Abstract (English)
Regression with non-Euclidean responses -- e.g., probability distributions, networks, symmetric positive-definite matrices, and compositions -- has become increasingly important in modern applications. In this paper, we propose deep Fréchet neural networks (DFNNs), an end-to-end deep learning framework for predicting non-Euclidean responses -- which are considered as random objects in a metric space -- from Euclidean predictors. Our method leverages the representation-learning power of deep neural networks (DNNs) to the task of approximating conditional Fréchet means of the response given the predictors, the metric-space analogue of conditional expectations, by minimizing a Fréchet risk. The framework is highly flexible, accommodating diverse metrics and high-dimensional predictors. We establish a universal approximation theorem for DFNNs, advancing the state-of-the-art of neural network approximation theory to general metric-space-valued responses without making model assumptions or relying on local smoothing. Empirical studies on synthetic distributional and network-valued responses, as well as a real-world application to predicting employment occupational compositions, demonstrate that DFNNs consistently outperform existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。