利用概率电路的层次结构提升分布外检测精度,无需额外训练数据。
A Probabilistic Circuit-Induced Pseudo-Metric for Out-of-Distribution Detection

- 通过节点似然向量构建层次化表示,捕捉变量范围的多级概率摘要。
- 在表格与MNIST数据上优于根似然、不确定性等基线方法,检测准确率提升显著。
- 无需分布内样本即可部署,天然定位分布偏移源头,适合无监督场景。
概率电路(PC)是可计算的生成模型,其内部节点对不同变量范围编码概率摘要的层级结构。现有基于PC的分布外(OOD)检测方法忽略此层级,仅将整个电路简化为根节点的标量似然(或其不确定性)。本文提出层次似然向量(HLV),其元素为选定PC节点的似然值,并定义层次似然距离(HLD),一种由PC诱导的伪度量,通过比较其HLV的期望来评估概率分布差异。我们证明HLD是PC自然诱导函数类上的积分概率度量,并开发了用于无监督OOD检测的严谨拟合优度假设检验。与现有方法不同,训练后的PC本身即构成分布内表示:部署时无需持有分布内数据。进一步表明,假设检验所需量可通过训练电路直接精确计算,从而得到近似解析决策阈值。在表格和MNIST数据集上的实验表明,利用PC编码的层次化概率摘要,相比根似然、不确定性、典型性及核基基线,显著提升OOD检测性能,且能自然定位导致分布偏移的PC节点。
原文摘要 · Abstract (English)
Probabilistic Circuits (PCs) are tractable generative models whose internal nodes encode a hierarchy of probabilistic summaries over different variable scopes. Existing PC-based out-of-distribution (OOD) detection methods ignore this hierarchy, reducing the entire circuit to the scalar likelihood (or its uncertainty) computed at the root. We introduce Hierarchical Likelihood Vector (HLV), a representation whose entries are the likelihoods associated with selected PC nodes and define the Hierarchical Likelihood Distance (HLD), a PC-induced pseudo-metric that compares the probability distributions through the expectations of their HLVs. We show that HLD is an integral probability metric over a function class naturally induced by the PC and develop a principled goodness-of-fit hypothesis test for unsupervised OOD detection. Unlike existing approaches, the trained PC alone serves as the representation of the in-distribution: no held-out in-distribution data are required at deployment. We further show that the quantities required by the hypothesis test can be computed exactly, directly from the trained circuit, yielding an approximate analytic decision threshold. Experiments on tabular and MNIST datasets demonstrate that exploiting the hierarchical probabilistic summaries encoded through the PC improve OOD detection over root-likelihood, uncertainty-, typicality- and kernel-based baselines, while naturally localizing distribution shifts to the PC nodes responsible for the shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。