用可解释性技术让机器看懂海豹,提升生态监测可信度
On Thin Ice: Towards Explainable Conservation Monitoring via Attribution and Perturbations
- 用梯度和扰动方法分析模型判断依据
- 解释结果准确聚焦海豹身体而非背景,且移除海豹会降低置信度
- 发现模型常把黑冰、岩石误认成海豹,适合生态监测开发者参考
计算机视觉可加速生态研究与保护监测,但因对黑箱神经网络模型缺乏信任而应用滞后。本文以格兰特湾国家公园的航拍图像为基础,训练Faster R-CNN检测海豹,并通过基于梯度的类激活图(HiResCAM、LayerCAM)、局部可解释模型无关解释(LIME)及扰动解释生成解释。从三个角度评估:(i) 定位保真度——高注意力区域是否对应动物而非背景;(ii) 忠实度——删除/插入测试是否影响检测置信度;(iii) 诊断效用——能否揭示系统性错误模式。结果显示,解释主要集中于海豹躯干和轮廓,而非周围冰岩;移除海豹会显著降低置信度,为真阳性提供模型证据。同时发现模型反复将黑冰和岩石误判为海豹。据此提出针对性改进方向,如更精准的数据筛选与增强。通过结合目标检测与后处理可解释性,推动保护监测从黑箱预测转向可审计、支持决策的工具。
原文摘要 · Abstract (English)
Computer vision can accelerate ecological research and conservation monitoring, yet adoption in ecology lags in part because of a lack of trust in black-box neural-network-based models. We seek to address this challenge by applying post-hoc explanations to provide evidence for predictions and document limitations that are important to field deployment. Using aerial imagery from Glacier Bay National Park, we train a Faster R-CNN to detect pinnipeds (harbor seals) and generate explanations via gradient-based class activation mapping (HiResCAM, LayerCAM), local interpretable model-agnostic explanations (LIME), and perturbation-based explanations. We assess explanations along three axes relevant to field use: (i) localization fidelity: whether high-attribution regions coincide with the animal rather than background context; (ii) faithfulness: whether deletion/insertion tests produce changes in detector confidence; and (iii) diagnostic utility: whether explanations reveal systematic failure modes. Explanations concentrate on seal torsos and contours rather than surrounding ice/rock, and removal of the seals reduces detection confidence, providing model-evidence for true positives. The analysis also uncovers recurrent error sources, including confusion between seals and black ice and rocks. We translate these findings into actionable next steps for model development, including more targeted data curation and augmentation. By pairing object detection with post-hoc explainability, we can move beyond "black-box" predictions toward auditable, decision-supporting tools for conservation monitoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。