用脑机接口辅助视觉模型检测伪装目标,提升准确率与可靠性。
Uncertainty Aware Human-machine Collaboration in Camouflaged Object Detection
- 引入多视角主干网络估算模型置信度,指导训练与决策。
- 在CAMO数据集上提升平衡准确率4.56%、F1分数3.66%。
- 适合需高可靠性的安防、医疗等实时伪装目标检测场景。
伪装目标检测(COD)旨在识别环境中隐藏的物体,因其广泛应用而迅速发展。构建可信的COD系统关键在于对不确定性进行估计与利用。本文提出一种人机协作框架,通过计算机视觉(CV)模型与非侵入式脑机接口(BCI)互补优势,实现对伪装目标存在性的分类。方法采用多视角主干网络估计预测不确定性,在训练中利用该信息提升效率,并在测试阶段将低置信度样本交由基于快速串行视觉呈现(RSVP)的BCI进行人工评估,以增强决策可靠性。在CAMO数据集上的实验表明,该框架达到当前最优性能,平均提升平衡准确率4.56%、F1分数3.66%;表现最佳参与者进一步实现7.6%的平衡准确率与6.66%的F1分数提升。训练过程分析显示,置信度指标与精度强相关;消融实验证实了所提训练策略与人机协作机制的有效性。整体显著降低人类认知负荷,提升系统可靠性,为真实世界应用和人机交互提供坚实基础。代码与数据已公开。
原文摘要 · Abstract (English)
Camouflaged Object Detection (COD), the task of identifying objects concealed within their environments, has seen rapid growth due to its wide range of practical applications. A key step toward developing trustworthy COD systems is the estimation and effective utilization of uncertainty. In this work, we propose a human-machine collaboration framework for classifying the presence of camouflaged objects, leveraging the complementary strengths of computer vision (CV) models and noninvasive brain-computer interfaces (BCIs). Our approach introduces a multiview backbone to estimate uncertainty in CV model predictions, utilizes this uncertainty during training to improve efficiency, and defers low-confidence cases to human evaluation via RSVP-based BCIs during testing for more reliable decision-making. We evaluated the framework in the CAMO dataset, achieving state-of-the-art results with an average improvement of 4.56\% in balanced accuracy (BA) and 3.66\% in the F1 score compared to existing methods. For the best-performing participants, the improvements reached 7.6\% in BA and 6.66\% in the F1 score. Analysis of the training process revealed a strong correlation between our confidence measures and precision, while an ablation study confirmed the effectiveness of the proposed training policy and the human-machine collaboration strategy. In general, this work reduces human cognitive load, improves system reliability, and provides a strong foundation for advancements in real-world COD applications and human-computer interaction. Our code and data are available at: https://github.com/ziyuey/Uncertainty-aware-human-machine-collaboration-in-camouflaged-object-identification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。