arXiv:2607.04151cs.CV2026-07中稿 · ECCV

修复手机动态照片的模糊帧,让重选画面更清晰真实

Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset

论文配图:Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset
图 1 · 摘自论文原文
  • 用高质量主图作参考,融合相邻视频帧提升低质帧画质
  • 在2042张真实动态照片上验证,显著改善模糊与色彩失真
  • 适合做手机影像优化、多媒体增强的研究者和开发者

现代智能手机拍摄的Live Photos包含一张静态图像及周围的短视频片段,带来动态视觉体验。但静态图由完整计算摄影处理,而视频流受实时性与高压缩限制,导致封面图与视频帧在分辨率、色彩保真度和动态范围上存在显著差距。当用户从视频中选取替代帧时,常因画质严重退化而难以直接替换。恢复此类帧需同步提升空间细节与色彩表现,难度远超普通超分辨率或色彩校正。为此,我们提出Live Photo Cover Frame Reselection and Enhancement(LPRE)任务,利用每张动态照片内部的线索:高质量封面图作为结构与色彩参考,用户选定的低质帧为目标,相邻视频帧提供时序信息。基于此,我们构建了真实世界数据集Live2K(含2042张动态照片),并设计统一单阶段基线模型,整合多帧融合、引导式色彩增强与超分辨率,首次建立动态照片增强研究基准。

原文摘要 · Abstract (English)

Modern smartphones capture Live Photos, short video bursts surrounding a still image, offering a dynamic and engaging photographic experience. However, the cover photo and video components are generated by two distinct imaging pipelines: the photo stream undergoes full computational photography processing, while the video stream is constrained by real-time efficiency and heavy compression. This intrinsic separation produces a substantial quality gap in resolution, color fidelity, and dynamic range between the cover photo and video frames. When users reselect an alternative frame from the video to replace an imperfect cover, the chosen frame often suffers from severe degradation, making direct replacement visually unsatisfactory. Restoring such frames requires simultaneous enhancement of spatial detail and color appearance, a task considerably more challenging than ordinary super-resolution or color enhancement. To address this, we define the Live Photo Cover Frame Reselection and Enhancement (LPRE) task, which leverages the intrinsic cues available within each Live Photo: the high-quality cover image as a structural and color reference, the user-reselected low-quality frame as the reconstruction target and several adjacent video frames providing temporal cues. Building upon this formulation, we construct Live2K, a real-world dataset of 2,042 Live Photos, and develop a unified one-stage baseline that integrates multi-frame fusion, guided color enhancement and super-resolution, establishing the first benchmark for Live Photo enhancement research.

动态照片图像修复多帧融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。