让手机拍的图在屏幕上颜色更准,通过联合优化摄像头和屏幕实现。
Color Pass-Through via Camera-Display Coupling

- 将摄像头与屏幕视为耦合系统,端到端学习色彩传递。
- 用户评测提升2.0分(5分制),量化指标改善超2倍。
- 适合做手机影像色彩还原、跨设备显示一致性的研究者。
当真实场景被智能手机相机拍摄并在其屏幕上显示时,图像的颜色、亮度和对比度常与原场景明显不同,这一差距即使在现代相机和显示屏技术大幅提升后依然存在。主要原因是多数流程将高维捕获到显示的过程分解为独立校准的相机和显示两个阶段,并通过低维色彩变换连接,导致信息瓶颈和误差累积。为此,我们提出Color Pass-Through,一种直接作用于捕获图像的端到端学习框架。核心思想是将相机与显示视为耦合系统而非独立校准。这种耦合带来两大优势:(1) 通过端到端优化,将真实场景的完整信息传递至显示;(2) 可针对每位观察者进行高效一步校准。我们通过数字与人类观察者验证该方法。相比代表性基线,本方法在5分制用户研究中平均提升2.0分,量化指标改善超过2倍,显著提升了原始场景感知色彩的还原度。
原文摘要 · Abstract (English)
When a real-world scene is captured by a smartphone camera and viewed on its screen, the displayed image often differs noticeably from the original scene in color, brightness, and contrast. This gap persists despite substantial advances in both modern cameras and displays. A key reason is that most pipelines factor the high-dimensional capture-to-display process into two separately calibrated camera and display stages, and then connect them through low-dimensional color transforms, leading to information bottlenecks and inevitable error accumulation. To address this systemic challenge, we propose Color Pass-Through, an end-to-end learned framework that operates directly on captured images. Our key insight is to treat the camera and display as a coupled system rather than calibrating them in isolation. Coupling the camera and display yields two practical advantages: (1) it brings the entire real-world scenes to the display via end-to-end optimization, and (2) it allows efficient one-step calibration for each distinct observer via complete capture-to-display path. We validate Color Pass-Through using both digital and human observers. Compared with representative baselines, our method achieves an average gain of +2.0 points on a 5-point user study and more than 2x improvement on quantitative metrics, demonstrating improved reproduction of the perceived color of the original scene.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。