arXiv:2606.25838cs.CVcs.AI2026-06

用边缘信息快速判断图像模糊,节省下游模型计算资源。

Edges Before Embeddings: A Confidence-Aware Blur Gate for Vision-Language Pipelines

  • 基于边缘幅度构建辅助通道,直接利用频域特征判断清晰度。
  • 在384×384分辨率下达到F1 0.9803,比基线提升1.31点。
  • 轻量级设计适配CPU,7ms内完成单图判断,适合生产环境部署。

生产级视觉流水线在模糊输入下性能悄然下降,导致下游OCR、检索及视觉语言模型(VLM)调用浪费算力却无法恢复有效输出。本文提出MagikaDocumentFromPixel,一种轻量级、兼容CPU的图像质量判别器,可在单核CPU上以约7毫秒/张的速度判断图像为清晰、模糊或不确定。贡献包括:(i) 经过46种配置、8轮实验筛选出的优化方案,确认输入分辨率是关键因素,模型容量仅在≥384像素时体现优势;(ii) 基于经典选择性预测的置信度感知路由机制;(iii) 边缘先验模块(EPM),引入拉普拉斯幅值作为辅助通道,使网络直接获取传统模糊判据依赖的频域证据,在相同环境下测试F1提升+1.3点;(iv) 观察到该门控设计在Magika内容类型检测、风险可控的VLM OCR与DocVLM中独立复现,构成通用模式。最终模型采用MobileNetV3-Large+ EPM,384×384训练,5尺度测试增强,达F1=0.9803(AUC=0.9989),ONNX模型仅17MB,相较同硬件基线(F1=0.9672)提升1.31点。明确说明局限:当前结果仅针对单一运动模糊分布,数值来自单次随机种子,校准为定性而非定量。

原文摘要 · Abstract (English)

Production vision pipelines silently degrade on blurry input, wasting compute on downstream OCR, retrieval, and vision-language model (VLM) calls that cannot recover a usable output. We present MagikaDocumentFromPixel, a lightweight, CPU-friendly image quality gate that classifies a single image as sharp, blurred, or uncertain in roughly 7 ms on a single CPU core. The contributions are (i) a recipe selected from a 46-configuration, 8-sweep empirical search that isolates input resolution as the dominant lever and shows architecture capacity only pays off at >= 384 px; (ii) a confidence-aware routing formalism grounded in classical selective prediction; (iii) the Edge Prior Module (EPM), a Laplacian-magnitude auxiliary input channel that gives the network direct access to the spectral evidence that classical blur heuristics rely on and that lifts test F1 by +1.3 points in a matched-env comparison; and (iv) an observation that the gate is one instance of a recurring design pattern that appears independently in Magika content-type detection, risk-controlled OCR with VLMs, and DocVLM. The final recipe MobileNetV3-Large with the EPM trained at 384x384 on paired GoPro Large frames, evaluated with 5-scale test-time augmentation reaches F1 = 0.9803 (AUC 0.9989) with a 17 MB ONNX artifact, improving over our fixed-scale baseline on the same hardware (F1 = 0.9672) by +1.31 points. We are explicit about limitations: results are on a single motion-blur distribution, numbers are from a single seed, and calibration is qualitative rather than measured.

图像质量边缘检测轻量化视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。