用轻量级流水线让大模型高效识别复杂违规视频。
Filter-And-Refine: A MLLM Based Cascade System for Industrial-Scale Video Content Moderation
- 将生成式多模态大模型转为分类器,仅需2%微调数据。
- 线上系统自动审核量提升41%,计算成本降至1.5%。
- 适合需要高精度、低成本大规模内容审核的平台。
有效的内容审核对视频平台保障用户体验和维护社区标准至关重要。传统视频分类模型虽能处理明确的审核任务,但在隐含有害内容和语境模糊等复杂场景下表现不佳。多模态大语言模型(MLLM)凭借更强的跨模态推理与上下文理解能力,有望解决上述问题。然而,两大挑战阻碍其工业应用:一是计算成本过高,难以全量部署;二是将生成式模型用于判别性分类仍属开放难题。本文提出一种高效方法,仅用少量判别训练数据即可将生成式MLLM转化为多模态分类器。为进一步实现工业级部署,设计了一种路由-排序级联系统,融合MLLM与轻量级路由模型。离线实验表明,该方法相比传统分类器F1得分提升66.50%,且仅需2%微调数据。在线评估显示,系统使自动内容审核量增加41%,级联部署将计算成本降至直接全量部署的1.5%。
原文摘要 · Abstract (English)
Effective content moderation is essential for video platforms to safeguard user experience and uphold community standards. While traditional video classification models effectively handle well-defined moderation tasks, they struggle with complicated scenarios such as implicit harmful content and contextual ambiguity. Multimodal large language models (MLLMs) offer a promising solution to these limitations with their superior cross-modal reasoning and contextual understanding. However, two key challenges hinder their industrial adoption. First, the high computational cost of MLLMs makes full-scale deployment impractical. Second, adapting generative models for discriminative classification remains an open research problem. In this paper, we first introduce an efficient method to transform a generative MLLM into a multimodal classifier using minimal discriminative training data. To enable industry-scale deployment, we then propose a router-ranking cascade system that integrates MLLMs with a lightweight router model. Offline experiments demonstrate that our MLLM-based approach improves F1 score by 66.50% over traditional classifiers while requiring only 2% of the fine-tuning data. Online evaluations show that our system increases automatic content moderation volume by 41%, while the cascading deployment reduces computational cost to only 1.5% of direct full-scale deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。