arXiv:2505.03631cs.CV2025-05中稿 · CVPR被引 9

用弱模型教强模型,让视频质量评估更通用。

Generalizable Video Quality Assessment via Weak-to-Strong Learning

  • 用多个弱教师模型提供监督信号,通过排序学习训练强学生模型。
  • 在未见视频上表现优于传统方法,尤其在跨数据集测试中提升显著。
  • 无需人工标注,适合大规模视频质量评估场景。

视频质量评估(VQA)旨在预测视频的主观感知质量,是量化视频处理流程中质量退化的基础工具。主流方法依赖人工标注数据集进行监督训练,但泛化能力差,难以适应新内容。本文探索弱到强(W2S)学习作为新范式,不依赖人工标注。实验证明,直接应用W2S策略可使强学生模型不仅在域内基准上匹配弱教师,更在域外(OOD)基准上超越。基于此,提出新框架:(1)通过排序学习融合多种教师信号——包括现成的VQA模型和合成失真模拟器;(2)迭代式W2S训练,将强学生模型循环作为后续教师,逐步聚焦挑战样本。大量实验表明,该方法在域内与域外基准均达领先性能,尤其在域外场景提升明显。结果表明,W2S学习是突破标注瓶颈、实现可扩展泛化的有效路径。数据与代码将开源。

原文摘要 · Abstract (English)

Video quality assessment (VQA) seeks to predict the perceptual quality of a video in alignment with human visual perception, serving as a fundamental tool for quantifying quality degradation across video processing workflows. The dominant VQA paradigm relies on supervised training with human-labeled datasets, which, despite substantial progress, still suffers from poor generalization to unseen video content. In this work, we explore weak-to-strong (W2S) learning as a new paradigm for advancing VQA without reliance on human-labeled datasets. We first provide empirical evidence that a straightforward W2S strategy allows a strong student model to not only match its weak teacher on in-domain benchmarks but also surpass it on out-of-distribution (OOD) benchmarks, revealing a distinct weak-to-strong effect in VQA. Building on this insight, we propose a novel framework that enhances W2S learning from two aspects: (1) integrating homogeneous and heterogeneous supervision signals from diverse VQA teachers -- including off-the-shelf VQA models and synthetic distortion simulators -- via a learn-to-rank formulation, and (2) iterative W2S training, where each strong student is recycled as the teacher in subsequent cycles, progressively focusing on challenging cases. Extensive experiments show that our method achieves state-of-the-art results across both in-domain and OOD benchmarks, with especially strong gains in OOD scenarios. Our findings highlight W2S learning as a principled route to break annotation barriers and achieve scalable generalization in video quality assessment. Our data and code will be available at https://github.com/clh124/W2S-VQA.

视频质量弱监督泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。