arXiv:2508.11170cs.CVcs.AI2025-08ICCV

用整数标签和掩码损失,提升视觉问答模型的视频质量评估精度。

Better Supervised Fine-tuning for VQA: Integer-Only Loss

  • 输出限制在[10,50]的整数,标签转为整数后训练
  • 仅解码前两位数字计算损失,聚焦关键评估指标
  • 在VQualA 2025挑战赛中排名第三,适合量化评估任务

随着视觉语言模型(VLM)的快速发展,其基于特定标准评估视觉内容的能力在视频主题一致性评估和视觉质量评分等应用中日益重要。然而,现有方法常因结果不精确和损失计算效率低,导致模型无法聚焦关键评价指标。为此,我们提出IOVQA(Integer-only VQA),一种专为VLM设计的新型微调方法,以增强其在视频质量评估任务中的表现。核心创新在于标签构建与目标损失机制:数据集构建时,将模型输出限制在[10,50]区间内的整数,并将原始连续值Overall_MOS转换为整数作为标签;引入目标掩码策略,计算损失时仅对标签的前两位整数不掩码,强制模型学习数值评估的关键成分。在Qwen2.5-VL模型上使用构建数据集微调后,实验结果表明该方法显著提升了模型在VQA任务中的准确率与一致性,在VQualA 2025 GenAI-Bench AIGC Video Quality Assessment Challenge -- Track I中排名第三。本工作验证了仅使用整数标签进行微调的有效性,为优化VLM在定量评估场景中的表现提供了新思路。

原文摘要 · Abstract (English)

With the rapid advancement of vision language models(VLM), their ability to assess visual content based on specific criteria and dimensions has become increasingly critical for applications such as video-theme consistency assessment and visual quality scoring. However, existing methods often suffer from imprecise results and inefficient loss calculation, which limit the focus of the model on key evaluation indicators. To address this, we propose IOVQA(Integer-only VQA), a novel fine-tuning approach tailored for VLMs to enhance their performance in video quality assessment tasks. The key innovation of IOVQA lies in its label construction and its targeted loss calculation mechanism. Specifically, during dataset curation, we constrain the model's output to integers within the range of [10,50], ensuring numerical stability, and convert decimal Overall_MOS to integer before using them as labels. We also introduce a target-mask strategy: when computing the loss, only the first two-digit-integer of the label is unmasked, forcing the model to learn the critical components of the numerical evaluation. After fine-tuning the Qwen2.5-VL model using the constructed dataset, experimental results demonstrate that the proposed method significantly improves the model's accuracy and consistency in the VQA task, ranking 3rd in VQualA 2025 GenAI-Bench AIGC Video Quality Assessment Challenge -- Track I. Our work highlights the effectiveness of merely leaving integer labels during fine-tuning, providing an effective idea for optimizing VLMs in quantitative evaluation scenarios.

视觉问答视频质量整数标签微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。