arXiv:2511.10983cs.CVcs.AI2025-11

用二值判断提升零样本视觉理解,无需训练即可增强模型推理能力

Binary Verification for Zero-Shot Vision

  • 将开放问题转为多选题,再逐个验证候选答案真假
  • 在多个任务上比直接问答提升显著,最高增益达35%
  • 适合想快速提升现有视觉模型性能的研究者和开发者

我们提出一种无需训练的二值验证流程,用于零样本视觉任务,可直接使用现成的视觉语言模型(VLMs)。该流程包含两步:(i) 量化,将开放式查询转化为包含少量明确候选项的多选题(MCQ);(ii) 二值化,对每个候选项提出一个真/假问题,并确定性地解决:若仅有一个为真,则选择该选项;否则回退至剩余合理候选项的多选题。我们在指代表达定位(REC)、空间推理(Spatial-Map、Spatial-Grid、Spatial-Maze)和BLINK-Jigsaw任务上评估该流程。相比直接回答开放式问题,量化为多选题带来显著提升,而真/假二值化进一步提供稳定增益。该流程在所有任务中均表现优异,体现通用性。我们还将该REC流程集成至真实视频处理与编辑系统,展示系统架构与端到端流程。整体方案强调推理时设计,而非任务特异性训练,为当前VLM提供一条简单、统一且即插即用的强零样本视觉路径。

原文摘要 · Abstract (English)

We propose a training-free, binary verification workflow for zero-shot vision with off-the-shelf VLMs. It comprises two steps: (i) quantization, which turns the open-ended query into a multiple-choice question (MCQ) with a small, explicit list of unambiguous candidates; and (ii) binarization, which asks one True/False question per candidate and resolves deterministically: if exactly one is True, select it; otherwise, revert to an MCQ over the remaining plausible candidates. We evaluate the workflow on referring expression grounding (REC), spatial reasoning (Spatial-Map, Spatial-Grid, Spatial-Maze), and BLINK-Jigsaw. Relative to answering open-ended queries directly, quantization to MCQ yields large gains, and True/False binarization provides a consistent additional boost. Across all tasks, the same workflow produces significant improvements, indicating generality. We further integrate the proposed REC workflow into a real-world video processing and editing system, and present the system architecture and end-to-end pipeline in the paper. Together, these components yield a simple and unified workflow that emphasizes inference-time design over task-specific training. It offers a practical, drop-in path to stronger zero-shot vision with today's VLMs.

零样本视觉语言模型二值验证推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。