提出新图像相似度度量,兼顾几何与色彩感知,结果可解释。
A new Image Similarity Metric for a Perceptual and Transparent Geometric and Chromatic Assessment
- 分纹理与色彩两部分评估,用地球移动距离和Oklab色空间
- 在伯克利-Adobe数据集上超越现有方法,尤其擅长形状失真场景
- 输出分数附带可视化解释,评估过程透明可读
现有先进图像相似度度量多非感知性,且在存在纹理失真时表现不佳。本文提出一种新感知度量,由两项组成:第一项基于地球移动距离评估图像纹理差异;第二项在Oklab感知色彩空间中计算色彩差异。在包含复杂形状与色彩失真的非传统数据集Berkeley-Adobe Perceptual Patch Similarity上进行评估,结果显示本方法在含形状扭曲的图像中显著优于现有技术,验证了其更强的感知能力。相较深度黑盒模型仅提供分数而无解释,本方法可生成视觉化依据支持得分,使相似性判断过程透明可信。
原文摘要 · Abstract (English)
In the literature, several studies have shown that state-of-the-art image similarity metrics are not perceptual metrics; moreover, they have difficulty evaluating images, especially when texture distortion is also present. In this work, we propose a new perceptual metric composed of two terms. The first term evaluates the dissimilarity between the textures of two images using Earth Mover's Distance. The second term evaluates the chromatic dissimilarity between two images in the Oklab perceptual color space. We evaluated the performance of our metric on a non-traditional dataset, called Berkeley-Adobe Perceptual Patch Similarity, which contains a wide range of complex distortions in shapes and colors. We have shown that our metric outperforms the state of the art, especially when images contain shape distortions, confirming also its greater perceptiveness. Furthermore, although deep black-box metrics could be very accurate, they only provide similarity scores between two images, without explaining their main differences and similarities. Our metric, on the other hand, provides visual explanations to support the calculated score, making the similarity assessment transparent and justified.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。