arXiv:2505.22288cs.AI2025-05被引 4

提出无超参的层次化压缩方法,平衡模型压缩与精度。

Compression versus Accuracy: A Hierarchy of Lifted Models

  • 构建ε值层次结构,确保分组一致性。
  • 不同ε对应不同压缩-精度权衡,误差有界。
  • 无需调参,提升模型可解释性,适合推理优化场景。

具有不可区分对象的概率图模型通过一阶逻辑构造来压缩命题分解模型,实现更高效的提升推理。当前最先进的算法先进着色传递(ACP)通过分组具有相似分布的因子来获得提升表示。在使用ε作为超参数的近似版本中,仅当因子分布差异不超过(1±ε)时才进行分组。然而,选择合适的ε并不直观,可能需要多次运行ACP以尝试不同的ε值。此外,ε的变化可能导致模型剧烈变化,降低可解释性。为此,本文提出一种无超参的层次化提升模型构建方法。该方法高效计算出一组ε值层次,确保一旦在某个ε下因子被分组,则在更大的ε下仍保持分组。该ε值层次还带来相应的误差界层次,使得在选择特定ε运行ACP时,可明确权衡压缩与精度,并支持不同模型间的可解释性比较。

原文摘要 · Abstract (English)

Probabilistic graphical models that encode indistinguishable objects and relations among them use first-order logic constructs to compress a propositional factorised model for more efficient (lifted) inference. To obtain a lifted representation, the state-of-the-art algorithm Advanced Colour Passing (ACP) groups factors that represent matching distributions. In an approximate version using $\varepsilon$ as a hyperparameter, factors are grouped that differ by a factor of at most $(1\pm \varepsilon)$. However, finding a suitable $\varepsilon$ is not obvious and may need a lot of exploration, possibly requiring many ACP runs with different $\varepsilon$ values. Additionally, varying $\varepsilon$ can yield wildly different models, leading to decreased interpretability. Therefore, this paper presents a hierarchical approach to lifted model construction that is hyperparameter-free. It efficiently computes a hierarchy of $\varepsilon$ values that ensures a hierarchy of models, meaning that once factors are grouped together given some $\varepsilon$, these factors will be grouped together for larger $\varepsilon$ as well. The hierarchy of $\varepsilon$ values also leads to a hierarchy of error bounds. This allows for explicitly weighing compression versus accuracy when choosing specific $\varepsilon$ values to run ACP with and enables interpretability between the different models.

概率图模型提升推理模型压缩可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。