arXiv:2601.03011cs.CVcs.MA2026-01

用递归框架自动标注罕见场景图像,提升视觉语言模型鲁棒性。

ReCCur: A Recursive Corner-Case Curation Framework for Robust Vision-Language Understanding in Open and Edge Scenarios

论文配图:ReCCur: A Recursive Corner-Case Curation Framework for Robust Vision-Language Understanding in Open and Edge Scenarios
图 1 · 摘自论文原文
  • 多智能体递归管道将噪声网络图像转为细粒度标签
  • 在消费级显卡上运行,纯度与可区分性持续提升
  • 适合边缘部署的低资源视觉语言模型训练

罕见或极端场景(角落案例)常导致真实系统失效,但大规模标注困难:网络数据嘈杂、标签脆弱,边缘部署难以重训。本文提出 ReCCur(递归角落案例梳理框架),一种低计算量方法,通过多智能体递归流程将噪声网络图像转化为可审计的细粒度标签。首先,利用视觉-语言模型(VLM)大规模采集与过滤数据,爬取网页并结合轻量人工抽检,确保图像、描述、关键词三模态一致性,获得优化候选集。其次,采用专家混合知识蒸馏,结合不同编码器(如 CLIP、DINOv2、BEiT)进行 kNN 投票与双置信度激活及不确定性采样,收敛至高精度标签集。最后,区域证据 VLM 对抗标注机制,由提议者(多粒度区域与语义线索)与验证者(全局与局部链式一致性)协作,生成可解释标签并闭环优化。在真实角落案例(如洪水车检测)上,ReCCur 可在消费级 GPU 上运行,持续提升标签纯度与可区分性,仅需极少人工干预,为资源受限场景下的下游训练与评估提供实用基础。代码与数据集将公开。

原文摘要 · Abstract (English)

Corner cases are rare or extreme scenarios that drive real-world failures, but they are difficult to curate at scale: web data are noisy, labels are brittle, and edge deployments preclude large retraining. We present ReCCur (Recursive Corner-Case Curation), a low-compute framework that converts noisy web imagery into auditable fine-grained labels via a multi-agent recursive pipeline. First, large-scale data acquisition and filtering expands a domain vocabulary with a vision-language model (VLM), crawls the web, and enforces tri-modal (image, description, keyword) consistency with light human spot checks to yield refined candidates. Next, mixture-of-experts knowledge distillation uses complementary encoders (e.g., CLIP, DINOv2, BEiT) for kNN voting with dual-confidence activation and uncertainty sampling, converging to a high-precision set. Finally, region-evidence VLM adversarial labeling pairs a proposer (multi-granularity regions and semantic cues) with a validator (global and local chained consistency) to produce explainable labels and close the loop. On realistic corner-case scenarios (e.g., flooded-car inspection), ReCCur runs on consumer-grade GPUs, steadily improves purity and separability, and requires minimal human supervision, providing a practical substrate for downstream training and evaluation under resource constraints. Code and dataset will be released.

视觉语言模型边缘计算数据标注鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。