用大模型蒸馏出轻量模型,实时识别视频重复内容
MatchLM2Lite: A Scalable MLLM-to-Lite Framework for Reproduced Content Identification

- 用多模态大模型做教师,蒸馏出快速小模型进行推理
- 小模型保留90%以上准确率,计算成本降低35倍
- 已上线应用,使重复视频播放量下降2.5%且不影响用户活跃
内容审核对在线视频平台保障内容安全、保护创作者、维持良好用户体验至关重要。除了过滤有害内容,平台还需在大规模下确保内容真实性,防止低价值复制品泛滥。本文提出MatchLM2Lite,一个实时、可部署的重复内容识别(RCI)系统,利用多模态大语言模型(MLLM)的能力,通过知识蒸馏生成轻量、高速推理的小模型。系统联合建模视频、音频和文本信号,对视频对进行细粒度重复性评分。系统包含两个模块:作为教师模型的高容量匹配模型MatchLM,以及蒸馏后的轻量学生模型MatchLite,配合两阶段训练方案。MatchLM相比前代生产模型提升8.57点F1-score;蒸馏后,MatchLite仍保持6.55点的F1-score提升,同时计算成本降低35倍。该系统已规模化部署,稳定支持高每秒查询数(QPS),端到端延迟低于30秒。实际应用中,平台重复视频播放率下降2.5%,未影响用户参与度,验证了其在真实环境中的有效性。
原文摘要 · Abstract (English)
Content moderation is critical for online video platforms to ensure content safety, protect creators, and sustain positive user experiences. Beyond filtering harmful content, platforms must guarantee content authenticity at scale so that users are exposed to diverse, original videos rather than low-value reproductions. We present MatchLM2Lite, a real-time, production-grade reproduced content identification (RCI) system that leverages the powerful understanding of a multimodal large language model (MLLM) distilled into a small and fast-inference model. Our system jointly models video, audio, and text signals, operating on pairs of videos to produce fine-grained reproduction scores. The system comprises two modules, MatchLM and MatchLite, and a two-stage training recipe. First, our high-capacity MLLM, MatchLM, serves as a teacher model to define the upper bound of RCI performance. Its capabilities are then distilled into a compact student model, MatchLite. This design allows MatchLite to deliver low-latency, high-throughput inference on video pairs while preserving much of MatchLM's accuracy, making it suitable for integration into real-time recommendation systems. MatchLM achieves an F1-score improvement of +8.57 compared to our previous production model. After knowledge distillation, MatchLite retains a +6.55 gain in F1-score while reducing computational cost by 35x. Deployed at scale, MatchLM2Lite enables efficient, pairwise multimodal RCI, stably serving online traffic at high queries per second (QPS) with an end-to-end latency below 30 seconds. This system has reduced the reproduced video view rate on our platform by 2.5% without degrading user engagement, demonstrating its effectiveness in a large-scale production environment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。