用输入锚定的生成路径提升条件随机函数建模能力
Neural Bridge Processes
- 引入输入锚定的桥接轨迹替代无条件前向过程
- 在多个任务上实现比NDP更优的预测性能与不确定性估计
- 适合需要强条件依赖和不确定性的生成建模场景
从部分观测的上下文-目标对中学习随机函数,需要模型具备强表达性、不确定性感知能力以及对输入的强烈条件依赖。神经扩散过程(NDPs)通过去噪扩散提升表达性,但其前向过程与输入无关;输入仅在反向去噪器中起作用,导致噪声训练状态不包含条件输入信息。本文提出神经桥接过程(NBPs),将无条件前向核替换为输入锚定的桥接轨迹。当输入与输出维度不同时,NBP学习输出空间锚点 $a_ψ(x)=P_ψ(x)$,使坐标或其他输入可引导生成路径,且不改变去噪主干结构。理论上证明,过程级锚定能实现路径级输入可区分性,将输入信息注入噪声状态,并建立原生梯度通路,这是NDPs无法实现的。在合成回归、脑电图(EEG)、CylinderFlow和图像回归任务上的实验显示持续改进。消融实验表明收益源于完整桥接构造与学习对齐机制,且该输入锚定路径原则可迁移至流匹配神经过程。结果表明,桥接锚定的生成路径为强化条件随机函数建模提供了一种通用机制。
原文摘要 · Abstract (English)
Learning stochastic functions from partially observed context-target pairs requires models that are expressive, uncertainty-aware, and strongly conditioned on inputs. Neural Diffusion Processes (NDPs) improve expressivity with denoising diffusion, but their forward process is input-independent; inputs only enter the reverse denoiser, so the noisy training states themselves do not encode the conditioning inputs. We propose Neural Bridge Processes (NBPs), which replace the unconditional forward kernel with an input-anchored bridge trajectory. When input and output dimensions differ, NBP learns an output-space anchor $a_ψ(x)=P_ψ(x)$, allowing coordinates or other inputs to guide the generative path without changing the denoising backbone. We show theoretically that process-level anchoring induces pathwise input distinguishability, injects information about x into noisy states, and creates a direct gradient pathway unavailable to NDPs. Experiments on synthetic regression, EEG, CylinderFlow, and image regression show consistent improvements. Additional ablations show that the gains come from the full bridge construction with learned alignment, and that the same input-anchored path principle transfers to Flow Matching Neural Processes. These results suggest that bridge-anchored generative paths provide a general mechanism for strengthening conditional stochastic function modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。