arXiv:2607.14509cs.CVcs.AI2026-07

多尺度视觉模型结合地理先验,提升复杂植被图像中多物种识别精度。

Multi-Scale ViT Inference with Habitat-Fit Priors and kNN Retrieval for Multi-Species Plant Identification

论文配图:Multi-Scale ViT Inference with Habitat-Fit Priors and kNN Retrieval for Multi-Species Plant Identification
图 1 · 摘自论文原文
  • 用多尺度瓦片分解+DINOv2模型处理高分辨率植被图
  • 引入地理与海拔先验,显著降低误检率,提升宏观F1至0.439
  • 适合需要高精度植物多样性识别的生态监测场景

本文介绍DS@GT ARC在PlantCLEF 2026挑战赛中的第三名方案,针对高分辨率(约3000×3000像素)植被样方图像中的多物种植物识别任务。系统仅在单个植株的单标签图像上训练,却需预测图像中所有存在的物种。该方案基于微调后的DINOv2 ViT-L/14分类器,对样方图像进行多尺度瓦片分解,结合FAISS kNN检索器融合每片预测,并通过跨时间访问的源感知时序融合、基于训练数据地理与海拔先验的栖息地匹配降权机制,以及西南欧地理掩码进行后处理。消融实验表明,栖息地匹配降权与多尺度聚合是性能提升的关键。两种训练端改进方法——跨区域变压器配合噪声学生蒸馏、基于合成伪样方的标签查询解码器——均未见效;实例感知分割增强也未提升效果。最终提交方案在私有排行榜上获得宏F1 0.43902(第三名;公开榜0.51096),同一管道的未选配置在私有集上超过0.45。代码已开源。

原文摘要 · Abstract (English)

This paper describes DS@GT ARC's third-place solution to the PlantCLEF 2026 challenge on multi-species plant identification in vegetation quadrat images, where systems must predict every species present in high-resolution (~3000 x 3000 pixel) plot photographs while training only on single-label images of individual plants. The pipeline is built around a fine-tuned DINOv2 ViT-L/14 classifier applied over a multi-scale tile decomposition of each quadrat, with per-tile predictions blended with a FAISS kNN retriever and post-processed by source-aware temporal fusion across repeated plot visits, a habitat-fit demotion that injects geographic and altitude priors from the training data, and a South-Western Europe geographic mask. Habitat-fit demotion and multi-scale aggregation are the largest individual contributors in the ablations. Two complementary training-centric directions, a cross-region transformer with noisy-student distillation on the LUCAS dataset and a label-as-query transformer decoder over synthetic CLS-domain pseudo-quadrats, yielded null results. An inference-time augmentation with instance-aware segmentation crops also did not improve performance. The selected submission reaches a private-leaderboard macro-F1 of 0.43902 (third place; public 0.51096); an unselected configuration of the same pipeline scored above 0.45 on the private set. Code: https://github.com/dsgt-arc/plantclef-2026.

植物识别多尺度分析视觉模型生态监测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。