arXiv:2603.15670cs.AIcs.LG2026-03被引 1

用潜在变量建模不确定性,实现多源证据的可信推理。

I Know What I Don't Know: Latent Posterior Factor Models for Multi-Evidence Probabilistic Reasoning

  • 将VAE隐空间转化为软似然因子,接入概率图进行推理
  • 在8个领域中准确率达97.8%,校准误差仅1.4%
  • 适合需要可解释性与不确定性的医疗、金融等决策场景

现实世界决策(如税务合规评估、医学诊断)需整合多源噪声大且可能矛盾的证据。现有方法或缺乏显式不确定性量化(神经聚合方法),或依赖手工设计的离散谓词(概率逻辑框架),难以扩展至非结构化数据。本文提出潜在后验因子(LPF),将变分自编码器(VAE)的隐后验转化为求和-乘积网络(SPN)中的软似然因子,实现对非结构化证据的可计算概率推理,同时保持校准的不确定性估计。我们构建了两种实例:基于结构因子的LPF-SPN与端到端学习的LPF-Learned,可在统一不确定性表示下对比显式概率推理与学习聚合。在八个领域(七个合成数据集及FEVER基准)中,LPF-SPN最高准确率达97.8%,校准误差(ECE)仅为1.4%,显著优于证据深度学习(EDL)、大型语言模型(LLM)及图基基线,在15组随机种子下表现稳定。贡献包括:(1) 桥接潜在不确定性表示与结构化概率推理的框架;(2) 双架构支持受控比较推理范式;(3) 可复现训练方法与种子选择策略;(4) 对比EDL、BERT、R-GCN及大型语言模型的全面评估;(5) 跨领域验证;(6) 补充论文提供形式化保证。

原文摘要 · Abstract (English)

Real-world decision-making, from tax compliance assessment to medical diagnosis, requires aggregating multiple noisy and potentially contradictory evidence sources. Existing approaches either lack explicit uncertainty quantification (neural aggregation methods) or rely on manually engineered discrete predicates (probabilistic logic frameworks), limiting scalability to unstructured data. We introduce Latent Posterior Factors (LPF), a framework that transforms Variational Autoencoder (VAE) latent posteriors into soft likelihood factors for Sum-Product Network (SPN) inference, enabling tractable probabilistic reasoning over unstructured evidence while preserving calibrated uncertainty estimates. We instantiate LPF as LPF-SPN (structured factor-based inference) and LPF-Learned (end-to-end learned aggregation), enabling a principled comparison between explicit probabilistic reasoning and learned aggregation under a shared uncertainty representation. Across eight domains (seven synthetic and the FEVER benchmark), LPF-SPN achieves high accuracy (up to 97.8%), low calibration error (ECE 1.4%), and strong probabilistic fit, substantially outperforming evidential deep learning, LLMs and graph-based baselines over 15 random seeds. Contributions: (1) A framework bridging latent uncertainty representations with structured probabilistic reasoning. (2) Dual architectures enabling controlled comparison of reasoning paradigms. (3) Reproducible training methodology with seed selection. (4) Evaluation against EDL, BERT, R-GCN, and large language model baselines. (5) Cross-domain validation. (6) Formal guarantees in a companion paper.

概率推理不确定性多源证据生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。