用人类关注区域指导模型训练,提升准确率和泛化能力。
Training Better Deep Learning Models Using Human Saliency
- 引入人类注意力机制作为损失函数新成分,引导模型聚焦重要区域。
- 在人脸、虹膜攻击和胸片异常检测中,用更少数据达到更高准确率。
- 模型可解释性更强,且跨训练运行结果更稳定,适合医疗等高可靠性场景。
本研究探索如何将人类对图像显著区域的判断引入深度卷积神经网络(DCNN)训练。传统训练纯依赖数据,常导致学习到与类别标签仅偶然相关的特征。本文提出一种新损失函数组件——ConveYs Brain Oversight to Raise Generalization(CYBORG),通过惩罚模型对非显著区域的依赖,引导其关注人类关注的区域。实验表明,使用CYBORG训练的模型在多个架构和任务(合成人脸检测、虹膜伪造攻击识别、胸部X光异常检测)中均取得更高准确率与泛化性能,且所需数据量显著减少。可视化显示,CYBORG训练模型的显著图在不同训练运行间更一致,且与人类标注更吻合。为降低人工标注成本,还探索了用深度学习自动生成标注。该方法有效缓解了大样本依赖、可解释性差和对新数据脆弱等问题。
原文摘要 · Abstract (English)
This work explores how human judgement about salient regions of an image can be introduced into deep convolutional neural network (DCNN) training. Traditionally, training of DCNNs is purely data-driven. This often results in learning features of the data that are only coincidentally correlated with class labels. Human saliency can guide network training using our proposed new component of the loss function that ConveYs Brain Oversight to Raise Generalization (CYBORG) and penalizes the model for using non-salient regions. This mechanism produces DCNNs achieving higher accuracy and generalization compared to using the same training data without human salience. Experimental results demonstrate that CYBORG applies across multiple network architectures and problem domains (detection of synthetic faces, iris presentation attacks and anomalies in chest X-rays), while requiring significantly less data than training without human saliency guidance. Visualizations show that CYBORG-trained models' saliency is more consistent across independent training runs than traditionally-trained models, and also in better agreement with humans. To lower the cost of collecting human annotations, we also explore using deep learning to provide automated annotations. CYBORG training of CNNs addresses important issues such as reducing the appetite for large training sets, increasing interpretability, and reducing fragility by generalizing better to new types of data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。