arXiv:2508.18903cs.LGcs.AI2025-08NeurIPS被引 3

通过距离感知的局部潜在结构,提升神经过程的不确定性估计能力

Distance-informed Neural Processes

  • 用全局+距离保持的局部潜在变量建模任务与输入相似性
  • 在回归和分类任务中实现更精准的不确定性校准
  • 适合需要可靠置信度估计的机器学习场景

我们提出距离感知神经过程(DNP),一种改进不确定性估计的新版神经过程。标准神经过程依赖全局潜在变量,难以校准不确定性并捕捉局部数据依赖。DNP引入全局潜在变量建模任务级变化,同时通过双李普希茨正则化,在保持输入关系的距离不变性下,构建距离感知的局部潜在空间,从而更好地捕获输入相似性。该方法使DNP在回归与分类任务中均表现出更强的预测性能和更优的不确定性校准。实验证明其能有效区分分布内与分布外数据。

原文摘要 · Abstract (English)

We propose the Distance-informed Neural Process (DNP), a novel variant of Neural Processes that improves uncertainty estimation by combining global and distance-aware local latent structures. Standard Neural Processes (NPs) often rely on a global latent variable and struggle with uncertainty calibration and capturing local data dependencies. DNP addresses these limitations by introducing a global latent variable to model task-level variations and a local latent variable to capture input similarity within a distance-preserving latent space. This is achieved through bi-Lipschitz regularization, which bounds distortions in input relationships and encourages the preservation of relative distances in the latent space. This modeling approach allows DNP to produce better-calibrated uncertainty estimates and more effectively distinguish in- from out-of-distribution data. Empirical results demonstrate that DNP achieves strong predictive performance and improved uncertainty calibration across regression and classification tasks.

神经过程不确定性估计距离感知生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。