自适应视频场景分割与关键帧提取,适配长短视频统一处理
Scene Detection Policies and Keyframe Extraction Strategies for Large-Scale Video Analysis
- 按视频时长动态选策略:短片用自适应阈值,长片用分段法
- 轻量级评分模块结合清晰度、亮度和时间分布,高效选关键帧
- 已落地商用平台,适合媒体、教育、安防等多场景应用
稳健的场景分割与关键帧提取是视频理解流程中的重要预处理步骤,支持索引、摘要和语义检索等任务。然而,现有方法在跨类型、跨时长视频上泛化能力不足。本文提出一种统一、自适应的框架,可处理从短视频到长片、档案内容及监控录像等多种格式。系统根据视频长度动态选择分割策略:短视频采用自适应阈值,中等长度视频使用混合策略,长视频则采用基于区间的分割方法,确保各领域下粒度一致且处理高效。关键帧选择采用轻量级模块,通过清晰度、亮度和时间分布的综合指标对采样帧打分,避免复杂显著性模型,同时保证视觉相关性。该系统已部署于商业视频分析平台,服务于媒体、教育、科研和安全等领域,具备高吞吐能力,适用于界面预览、嵌入式处理和内容过滤等下游任务。文中还讨论了实际部署细节,并提出未来方向,包括音频感知分割与强化学习驱动的帧评分。
原文摘要 · Abstract (English)
Robust scene segmentation and keyframe extraction are essential preprocessing steps in video understanding pipelines, supporting tasks such as indexing, summarization, and semantic retrieval. However, existing methods often lack generalizability across diverse video types and durations. We present a unified, adaptive framework for automatic scene detection and keyframe selection that handles formats ranging from short-form media to long-form films, archival content, and surveillance footage. Our system dynamically selects segmentation policies based on video length: adaptive thresholding for short videos, hybrid strategies for mid-length ones, and interval-based splitting for extended recordings. This ensures consistent granularity and efficient processing across domains. For keyframe selection, we employ a lightweight module that scores sampled frames using a composite metric of sharpness, luminance, and temporal spread, avoiding complex saliency models while ensuring visual relevance. Designed for high-throughput workflows, the system is deployed in a commercial video analysis platform and has processed content from media, education, research, and security domains. It offers a scalable and interpretable solution suitable for downstream applications such as UI previews, embedding pipelines, and content filtering. We discuss practical implementation details and outline future enhancements, including audio-aware segmentation and reinforcement-learned frame scoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。