arXiv:2603.00517cs.LGcs.AI2026-03

提出快速贝叶斯框架,统一处理多种弱监督学习场景。

FastBUS: A Fast Bayesian Framework for Unified Weakly-Supervised Learning

  • 将标签搜索转为概率转移,构建共享贝叶斯网络
  • 在多数设定下达最优性能,速度提升数百倍
  • 适合需要高效弱监督训练的研究者使用

机器学习常面临各类不精确标签,导致多种弱监督设置。现有方法通常需复杂人工预处理,忽略标签间关联,或因计算设计缺陷无法批处理,导致运行时间长。为此,我们提出一种新通用框架,可高效推断不同弱监督下的真实标签分布。核心思想是将标签暴力搜索过程建模为标签变量的概率转移,将多样化的弱监督搜索树结构压缩为共享贝叶斯网络。由此导出基于广义信念传播的隐变量概率计算算法,并提出两种联合加速策略:1)引入低秩假设近似转移矩阵,降低时间复杂度;2)设计端到端状态演化模块,学习批量规模的转移矩阵,支持多类别批处理。此外,进一步证明该方法在多数场景下等价于EM算法。大量实验表明,本方法在多数弱监督设定下达到最先进水平,相比其他通用方法运行时间最高提速数百倍。

原文摘要 · Abstract (English)

Machine Learning often involves various imprecise labels, leading to diverse weakly supervised settings. While recent methods aim for universal handling, they usually suffer from complex manual pre-work, ignore the relationships between associated labels, or are unable to batch process due to computational design flaws, resulting in long running times. To address these limitations, we propose a novel general framework that efficiently infers latent true label distributions across various weak supervisions. Our key idea is to express the label brute-force search process as a probabilistic transition of label variables, compressing diverse weakly supervised DFS tree structures into a shared Bayesian network. From this, we derived a latent probability calculation algorithm based on generalized belief propagation and proposed two joint acceleration strategies: 1) introducing a low-rank assumption to approximate the transition matrix, reducing time complexity; 2) designing an end-to-end state evolution module to learn batch-scale transition matrices, facilitating multi-category batch processing. In addition, the equivalence of our method with the EM algorithm in most scenarios is further demonstrated. Extensive experiments show that our method achieves SOTA results under most weakly supervised settings, and achieves up to hundreds of times faster acceleration in running time compared to other general methods.

弱监督贝叶斯网络加速训练概率推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。