arXiv:2605.22423cs.CV2026-05TPAMI

通过双快门同步捕捉模糊与滚动快门图像,实现高速运动下视频重建。

Moment-Reenacting: Inverse Motion Degradation with Cross-shutter Guidance

论文配图:Moment-Reenacting: Inverse Motion Degradation with Cross-shutter Guidance
图 1 · 摘自论文原文
  • 设计双快门系统,联合利用全局与滚动快门互补特性
  • 在真实数据集上实现亚毫秒级运动重演,精度优于现有方法
  • 适合需要高精度高速视频重建的工业检测与自动驾驶场景

运动退化表现为全局快门(GS)图像中的模糊或滚动快门(RS)图像中的时序畸变,是计算成像中的根本挑战,尤其在快速运动或低光条件下。以往工作将模糊分解与RS时序超分辨率视为独立任务,忽略了二者内在互补性。本文提出统一框架,通过联合利用GS模糊与RS畸变的互补特征,逆向恢复运动退化并重演成像时刻。为此,我们引入新型双快门设置,同步采集模糊-RS图像对,并证明该组合可有效解决两种模态固有的时空歧义。为实现灵活性能-成本权衡,进一步扩展为窄基线立体模糊-RS配置。此外,构建三轴成像系统,采集包含对齐的GS-RS图像对与真实高速帧的实拍数据集,支持超越合成数据的鲁棒训练与评估。所提网络通过双流运动解析模块,显式解耦出上下文感知与时间敏感的运动表征,再经自提示帧重建阶段完成重建。大量实验验证了方法的优越性与泛化能力,确立了复杂运动退化下真实高速视频重建的新范式。代码与资源详见 https://jixiang2016.github.io/dualBR_site/。

原文摘要 · Abstract (English)

Motion degradation, manifested as blur in global shutter (GS) images or rolling shutter (RS) distortion in RS counterparts, remains a fundamental challenge in computational imaging, especially under fast motion or low-light conditions. While prior works have treated blur decomposition and RS temporal super-resolution as separate tasks, this separation fails to exploit their intrinsic complementarity. In this paper, we propose a unified framework to invert motion degradation and reenact imaging moment by jointly leveraging the complementary characteristics of GS blur and RS distortion. To this end, we introduce a novel dual-shutter setup that captures synchronized blur-RS image pairs and demonstrate that this combination effectively resolves temporal and spatial ambiguities inherent in both modalities. For allowing flexible performance-cost trade-offs, we further extend this dual-shutter setup to a stereo Blur-RS configuration with a narrow baseline. In addition, we construct a triaxial imaging system to collect a real-world dataset with aligned GS-RS pairs and ground-truth high-speed frames, enabling robust training and evaluation beyond synthetic data. Our proposed network explicitly disentangles motion into context-aware and temporally-sensitive representations via a dual-stream motion interpretation module, followed by a self-prompted frame reconstruction stage. Extensive experiments validate the superiority and generalizability of our approach, establishing a new paradigm for realistic high-speed video reconstruction under complex motion degradations. Codes and more resources are available at https://jixiang2016.github.io/dualBR_site/.

视频重建运动退化双快门高精度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。