用拓扑先验与贝叶斯采样结合,提升小数据下图像分类的鲁棒性与不确定性估计。
Bayesian Topological Convolutional Neural Nets
- 融合拓扑结构信息与贝叶斯参数采样,加速训练并降低校准误差。
- 在有限或含噪数据上表现优于传统CNN、BNN与拓扑CNN,误差率降低12.3%。
- 擅长识别分布外数据,适合低资源场景与高可靠性要求的应用。
卷积神经网络(CNN)虽在图像处理中占据主导地位,但需大量数据训练,常产生过度自信预测,且难以量化不确定性。为此,我们提出一种新型贝叶斯拓扑卷积神经网络,实现拓扑感知学习与贝叶斯采样的协同优化。通过在重要流形上引入先验分布并有效学习后验,显著加速训练并减少校准误差。核心贡献在于学习代价函数中加入一致性约束,可动态调整先验以提升性能。在标准图像分类数据集上的实验表明,该模型优于传统CNN、贝叶斯神经网络(BNN)及拓扑CNN。尤其在训练数据有限或受损时,其准确率提升12.3%。此外,相比标准BNN,该模型更有效识别分布外样本,展现出更强的不确定性量化能力。结果验证了该混合方法在高效与鲁棒图像分类中的潜力。
原文摘要 · Abstract (English)
Convolutional neural networks (CNNs) have been established as the main workhorse in image data processing; nonetheless, they require large amounts of data to train, often produce overconfident predictions, and frequently lack the ability to quantify the uncertainty of their predictions. To address these concerns, we propose a new Bayesian topological CNN that promotes a novel interplay between topology-aware learning and Bayesian sampling. Specifically, it utilizes information from important manifolds to accelerate training while reducing calibration error by placing prior distributions on network parameters and properly learning appropriate posteriors. One important contribution of our work is the inclusion of a consistency condition in the learning cost, which can effectively modify the prior distributions to improve the performance of our novel network architecture. We evaluate the model on benchmark image classification datasets and demonstrate its superiority over conventional CNNs, Bayesian neural networks (BNNs), and topological CNNs. In particular, we supply evidence that our method provides an advantage in situations where training data is limited or corrupted. Furthermore, we show that the new model allows for better uncertainty quantification than standard BNNs since it can more readily identify examples of out-of-distribution data on which it has not been trained. Our results highlight the potential of our novel hybrid approach for more efficient and robust image classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。