用对比学习提升视频年龄分级准确率,达88%。
Video-Based MPAA Rating Prediction: An Attention-Driven Hybrid Architecture Using Contrastive Learning
- 结合对比学习与注意力机制,动态捕捉视频关键帧。
- 在上下文对比学习框架下,准确率达88%,F1为0.8815。
- 适合流媒体平台自动化内容合规,支持实时推理。
视觉内容消费的快速增长要求对视频进行自动化年龄适宜性分类,如美国电影协会(MPAA)评级(G、PG、PG-13、R)。传统方法面临标注数据需求大、泛化能力差和特征学习效率低的问题。为此,本文采用对比学习增强判别力与适应性,探索三种框架:实例判别、上下文对比学习与多视角对比学习。提出的混合架构融合LRCN(CNN+LSTM)主干网络与Bahdanau注意力机制,在上下文对比学习框架中取得最佳性能,准确率为88%,F1得分为0.8815。通过卷积神经网络提取空间特征、长短期记忆网络建模时间序列,并利用注意力机制实现动态帧优先级选择,模型在细微等级区分(如PG-13与R级)上表现优异。我们评估了多种对比损失函数(包括NT-Xent、NT-logistic、Margin Triplet),验证了该架构的鲁棒性。为促进实际应用,模型已部署为网页应用,支持实时MPAA评级分类,为流媒体平台提供高效的内容合规解决方案。
原文摘要 · Abstract (English)
The rapid growth of visual content consumption across platforms necessitates automated video classification for age-suitability standards like the MPAA rating system (G, PG, PG-13, R). Traditional methods struggle with large labeled data requirements, poor generalization, and inefficient feature learning. To address these challenges, we employ contrastive learning for improved discrimination and adaptability, exploring three frameworks: Instance Discrimination, Contextual Contrastive Learning, and Multi-View Contrastive Learning. Our hybrid architecture integrates an LRCN (CNN+LSTM) backbone with a Bahdanau attention mechanism, achieving state-of-the-art performance in the Contextual Contrastive Learning framework, with 88% accuracy and an F1 score of 0.8815. By combining CNNs for spatial features, LSTMs for temporal modeling, and attention mechanisms for dynamic frame prioritization, the model excels in fine-grained borderline distinctions, such as differentiating PG-13 and R-rated content. We evaluate the model's performance across various contrastive loss functions, including NT-Xent, NT-logistic, and Margin Triplet, demonstrating the robustness of our proposed architecture. To ensure practical application, the model is deployed as a web application for real-time MPAA rating classification, offering an efficient solution for automated content compliance across streaming platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。