用扩散模型生成多轮实验的逻辑值,提升分类准确率
BGDB: Bernoulli-Gaussian Decision Block with Improved Denoising Diffusion Probabilistic Models
- 用改进扩散模型模拟多次伯努利试验,合成更准概率信息
- 在多个图像任务上实现显著性能提升,最高增益达3.2%
- 适合需要高置信度输出的医疗影像分类与分割场景
生成模型可通过构建复杂特征空间来增强判别分类器,在复杂数据集上表现更优。传统方法通常通过增加特征细节或维度使非线性数据线性可分,但仅将生成模型用于特征处理难以发挥其全部潜力,且缺乏理论支撑。本文提出新假设:单次训练得到的概率信息(logit)可用来生成等效于多次训练的结果。基于中心极限定理,这些合成概率信息有望更逼近真实概率。为此,我们提出伯努利-高斯决策块(BGDB),该模块受中心极限定理和多次伯努利试验均值趋近单次成功概率的启发,利用改进去噪扩散概率模型(IDDPM)建模伯努利试验概率。方法重点从特征重构转向逻辑值重构,将单次迭代的logit转化为等效于多次实验的多组logit。通过数学分析提供理论支持,并在多种图像任务(包括分类与分割)上验证其有效性,使用多个数据集进行实验。
原文摘要 · Abstract (English)
Generative models can enhance discriminative classifiers by constructing complex feature spaces, thereby improving performance on intricate datasets. Conventional methods typically augment datasets with more detailed feature representations or increase dimensionality to make nonlinear data linearly separable. Utilizing a generative model solely for feature space processing falls short of unlocking its full potential within a classifier and typically lacks a solid theoretical foundation. We base our approach on a novel hypothesis: the probability information (logit) derived from a single model training can be used to generate the equivalent of multiple training sessions. Leveraging the central limit theorem, this synthesized probability information is anticipated to converge toward the true probability more accurately. To achieve this goal, we propose the Bernoulli-Gaussian Decision Block (BGDB), a novel module inspired by the Central Limit Theorem and the concept that the mean of multiple Bernoulli trials approximates the probability of success in a single trial. Specifically, we utilize Improved Denoising Diffusion Probabilistic Models (IDDPM) to model the probability of Bernoulli Trials. Our approach shifts the focus from reconstructing features to reconstructing logits, transforming the logit from a single iteration into logits analogous to those from multiple experiments. We provide the theoretical foundations of our approach through mathematical analysis and validate its effectiveness through experimental evaluation using various datasets for multiple imaging tasks, including both classification and segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。