让专家参与修复老式立体胶片色彩,效果更准更可用。
A Human-in-the-Loop Deep Learning Framework for Color Reconstruction of Lenticular Films

- 引入可编辑的矢量边界,专家可手动调整透镜位置
- 在复杂区域(弯曲/低对比)仍能还原高质量色彩
- 适合需要精细修复的老电影修复团队使用
历史性的立体胶片(如Kodacolor工艺制作)以独特空间方式编码色彩信息,需专用技术进行准确还原。尽管近期信号处理方法(如doLCE)和深度学习方法(如deep-doLCE)已提升自动化还原能力,但在曲面透镜、低对比度或拍摄不良区域仍表现不佳。本文提出一种人机协同(HITL)深度学习框架,采用可编辑的矢量化透镜边界表示,允许专家在色彩提取与去马赛克前交互式修正边界位置。该解耦架构支持针对性修正与迭代优化,将专家知识嵌入检测模型,增强对困难帧的鲁棒性。为保留原始银盐乳剂中的细节,我们将重建的色度信息与原始胶片扫描的亮度融合。在以往自动方法失效且重构色彩无法展览的挑战性序列上,本方法成功生成高质量、可展览的色彩结果。这是首个结合专家引导、可编辑中间表示与纹理保持后处理的立体胶片色彩重建工作,推动了该领域的技术进步。
原文摘要 · Abstract (English)
Historical lenticular films, such as those created with the Kodacolor process, encode color information in a distinctive spatial format. This structure requires specialized techniques for accurate color reconstruction. While recent signal processing approaches like doLCE and deep learning methods like deep-doLCE have advanced automated color recovery, they often fail with cases such as curved lenticules, low-contrast, or badly captured regions. We propose a human-in-the-loop (HITL) deep learning framework which is designed for color reconstruction in lenticular films. Our approach introduces an editable, vector-based representation of lenticule boundaries, allowing experts to interactively refine boundary positions before color extraction and demosaicing. This decoupled architecture enables targeted corrections and iterative fine-tuning, embedding expert knowledge into the detection model and improving robustness across challenging frames. To preserve image details using information solely present in the original silver emulsion, we merge the reconstructed chrominance with the original film scan's luminance. We evaluate our pipeline on a challenging lenticular film sequence where previous automated approaches fail and the reconstructed colors are not suitable for exhibition. In contrast, our HITL approach successfully produces high-quality, exhibitable color reconstructions with preserved texture. This work is the first to combine expert guidance, editable intermediate representations, and texture-preserving post-processing for lenticular film color reconstruction, advancing the state of the art in this field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。