提出首个实时视频体验评估数据集与端到端模型,解决直播质量评价难题。
Subjective and Objective Quality-of-Experience Evaluation Study for Live Video Streaming
- 构建首个直播流QoE数据集TaoLive QoE,含42段真实直播源视频
- 提出Tao-QoE模型,融合多尺度语义与光流运动特征,准确预测主观体验得分
- 突破传统依赖网络指标的局限,适用于真实直播场景的质量评估
近年来,实时视频直播在各大社交平台广泛流行。用户体验质量(QoE)反映用户满意度,对媒体服务提供商优化大规模直播压缩与传输策略至关重要,以实现感知最优的码率-失真权衡。尽管已有大量面向点播视频(VoD)的QoE度量方法,但针对实时直播的QoE评估仍面临显著挑战。为此,本文开展了一项全面的主观与客观QoE评估研究。在主观评估方面,首次发布直播流QoE数据集TaoLive QoE,包含42段真实直播源视频及1,155段因多种流媒体失真(如压缩、卡顿、帧跳过、可变帧率等)生成的失真视频。通过人类实验获取该数据集的主观评分。在客观评估方面,将现有QoE模型在TaoLive QoE及公开的VoD QoE数据集上进行基准测试,发现当前模型在直播内容上表现不佳。因此,本文提出一种端到端的QoE评估模型Tao-QoE,整合多尺度语义特征与基于光流的运动特征,预测回溯式QoE分数,不再依赖统计服务质量(QoS)特征。
原文摘要 · Abstract (English)
In recent years, live video streaming has gained widespread popularity across various social media platforms. Quality of experience (QoE), which reflects end-users' satisfaction and overall experience, plays a critical role for media service providers to optimize large-scale live compression and transmission strategies to achieve perceptually optimal rate-distortion trade-off. Although many QoE metrics for video-on-demand (VoD) have been proposed, there remain significant challenges in developing QoE metrics for live video streaming. To bridge this gap, we conduct a comprehensive study of subjective and objective QoE evaluations for live video streaming. For the subjective QoE study, we introduce the first live video streaming QoE dataset, TaoLive QoE, which consists of $42$ source videos collected from real live broadcasts and $1,155$ corresponding distorted ones degraded due to a variety of streaming distortions, including conventional streaming distortions such as compression, stalling, as well as live streaming-specific distortions like frame skipping, variable frame rate, etc. Subsequently, a human study was conducted to derive subjective QoE scores of videos in the TaoLive QoE dataset. For the objective QoE study, we benchmark existing QoE models on the TaoLive QoE dataset as well as publicly available QoE datasets for VoD scenarios, highlighting that current models struggle to accurately assess video QoE, particularly for live content. Hence, we propose an end-to-end QoE evaluation model, Tao-QoE, which integrates multi-scale semantic features and optical flow-based motion features to predicting a retrospective QoE score, eliminating reliance on statistical quality of service (QoS) features.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。