用AI代理自动发现短视频新问题,提速政策更新。
When Rules Fall Short: Agent-Driven Discovery of Emerging Content Issues in Short Video Platforms
- 用多模态大模型代理自动召回潜在新问题视频。
- 两阶段聚类发现新问题,F1提升超20%。
- 适合内容安全团队快速响应新兴风险。
短视频平台趋势变化极快,新内容问题每日涌现,超出现有标注政策覆盖范围。传统人工发现方式滞后,导致政策更新缓慢,影响内容治理效果。本文提出基于多模态大语言模型代理的自动问题发现方法:自动召回含潜在新问题的短视频,通过两阶段聚类将视频分组,每组对应一个新发现的问题;代理再基于聚类结果生成更新的标注政策,扩展政策覆盖范围。该代理已部署于真实系统中。离线与在线实验表明,该方法显著提升新问题发现效率(F1分数提升超过20%),并改善后续治理效果(问题视频播放量降低约15%)。更重要的是,相比人工发现,大幅降低时间成本,显著加快标注政策迭代速度。
原文摘要 · Abstract (English)
Trends on short-video platforms evolve at a rapid pace, with new content issues emerging every day that fall outside the coverage of existing annotation policies. However, traditional human-driven discovery of emerging issues is too slow, which leads to delayed updates of annotation policies and poses a major challenge for effective content governance. In this work, we propose an automatic issue discovery method based on multimodal LLM agents. Our approach automatically recalls short videos containing potential new issues and applies a two-stage clustering strategy to group them, with each cluster corresponding to a newly discovered issue. The agent then generates updated annotation policies from these clusters, thereby extending coverage to these emerging issues. Our agent has been deployed in the real system. Both offline and online experiments demonstrate that this agent-based method significantly improves the effectiveness of emerging-issue discovery (with an F1 score improvement of over 20%) and enhances the performance of subsequent issue governance (reducing the view count of problematic videos by approximately 15%). More importantly, compared to manual issue discovery, it greatly reduces time costs and substantially accelerates the iteration of annotation policies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。