构建感知一致的风格无关人脸身份识别数据集与评估框架
StyleID: A Perception-Aware Dataset and Metric for Stylization-Agnostic Facial Identity Recognition

- 基于扩散与流匹配模型生成多风格、多强度画像,采集人类判别数据
- 通过心理物理实验建模识别强度曲线,实现编码器与人眼感知对齐
- 显著提升模型在艺术绘图等域外场景下的身份识别鲁棒性
创意人脸风格化旨在以卡通、素描、绘画等多种视觉风格呈现肖像,同时保持可辨识的身份特征。然而,当前身份编码器多基于自然照片训练,在风格化下表现脆弱,常将纹理或色彩变化误判为身份漂移,或无法识别几何夸张。这反映出缺乏风格无关的身份一致性评估与监督框架。为此,我们提出StyleID,一个面向感知一致性的风格化人脸身份识别数据集与评估体系。StyleID包含两个数据集:(i) StyleBench-H,涵盖扩散与流匹配生成的多风格、多强度风格化图像的人类同异判断基准;(ii) StyleBench-S,通过受控的二选一强迫选择(2AFC)实验获得的心理学识别强度曲线构成的监督集。利用StyleBench-S,我们微调现有语义编码器,使其相似度排序与人类感知一致。实验表明,校准后的模型在人类判断相关性上显著提升,并增强了对域外艺术手绘肖像的鲁棒性。所有数据集、代码及预训练模型均公开于https://kwanyun.github.io/StyleID_page/
原文摘要 · Abstract (English)
Creative face stylization aims to render portraits in diverse visual idioms such as cartoons, sketches, and paintings while retaining recognizable identity. However, current identity encoders, which are typically trained and calibrated on natural photographs, exhibit severe brittleness under stylization. They often mistake changes in texture or color palette for identity drift or fail to detect geometric exaggerations. This reveals the lack of a style-agnostic framework to evaluate and supervise identity consistency across varying styles and strengths. To address this gap, we introduce StyleID, a human perception-aware dataset and evaluation framework for facial identity under stylization. StyleID comprises two datasets: (i) StyleBench-H, a benchmark that captures human same-different verification judgments across diffusion- and flow-matching-based stylization at multiple style strengths, and (ii) StyleBench-S, a supervision set derived from psychometric recognition-strength curves obtained through controlled two-alternative forced-choice (2AFC) experiments. Leveraging StyleBench-S, we fine-tune existing semantic encoders to align their similarity orderings with human perception across styles and strengths. Experiments demonstrate that our calibrated models yield significantly higher correlation with human judgments and enhanced robustness for out-of-domain, artist drawn portraits. All of our datasets, code, and pretrained models are publicly available at https://kwanyun.github.io/StyleID_page/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。