提出可解释且泛化性强的图像分解框架,结合贝叶斯与深度学习。
InDeed: Interpretable image deep decomposition with guaranteed generalizability
- 用分层贝叶斯建模图像分解,转为优化问题求解。
- 在去噪和异常检测任务中提升泛化性能,结果可解释。
- 适合关注模型可解释性与鲁棒性的研究者使用。
图像分解旨在将图像解析为基本成分,对众多下游任务至关重要,且天然具备可解释性。深度学习虽强大,但其与可解释性和泛化能力的结合仍较少被探索。本文提出一种新型可解释深度图像分解框架,融合分层贝叶斯建模与深度学习,构建架构模块化、模型通用的深度神经网络(DNN)。该框架包含三步:(1) 图像分解的分层贝叶斯建模;(2) 将推断问题转化为优化任务;(3) 通过模块化贝叶斯DNN进行深度推断。我们进一步建立了损失函数与泛化误差界之间的理论联系,启发了一种新的测试时适应方法,用于分布外场景。我们在图像去噪和无监督异常检测两个下游任务上验证了该方法,结果表明其在泛化性和可解释性方面均有提升。代码将在论文接收后公开。
原文摘要 · Abstract (English)
Image decomposition aims to analyze an image into elementary components, which is essential for numerous downstream tasks and also by nature provides certain interpretability to the analysis. Deep learning can be powerful for such tasks, but surprisingly their combination with a focus on interpretability and generalizability is rarely explored. In this work, we introduce a novel framework for interpretable deep image decomposition, combining hierarchical Bayesian modeling and deep learning to create an architecture-modularized and model-generalizable deep neural network (DNN). The proposed framework includes three steps: (1) hierarchical Bayesian modeling of image decomposition, (2) transforming the inference problem into optimization tasks, and (3) deep inference via a modularized Bayesian DNN. We further establish a theoretical connection between the loss function and the generalization error bound, which inspires a new test-time adaptation approach for out-of-distribution scenarios. We instantiated the application using two downstream tasks, \textit{i.e.}, image denoising, and unsupervised anomaly detection, and the results demonstrated improved generalizability as well as interpretability of our methods. The source code will be released upon the acceptance of this paper.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。