提出新评估方法,精准检测个性化生成中身份细节是否保留。
Finer-Personalization Rank: Fine-Grained Retrieval Examines Identity Preservation for Personalized Generation
- 用检索排名思路评估生成图像与真实图像的细粒度匹配
- 在多个数据集上发现主流方法存在显著身份漂移现象
- 适合关注个性化生成质量、身份一致性研究者使用
个性化生成模型兴起,核心问题是如何评估身份保留?给定参考图像(如宠物),期望生成结果保留主体的精确身份细节。然而现有评估指标只关注整体语义相似性,忽视细粒度区分特征。本文提出细粒度身份保留评估协议 Finer-Personalization Rank:将每个生成图像视为查询,在包含视觉相似真实图像的身份标签图库中进行检索,采用检索指标(如平均精度均值)衡量性能。更高的得分表示身份特异性细节(如独特头部斑点)被有效保留。我们在 CUB、Stanford Cars 与动物重识别基准上验证,该方法比仅依赖语义的指标更准确反映身份保留情况,并揭示多个主流个性化方法存在显著身份漂移。该基于图库的评估协议为个性化生成提供了原则性强且实用的评测范式。
原文摘要 · Abstract (English)
The rise of personalized generative models raises a central question: how should we evaluate identity preservation? Given a reference image (e.g., one's pet), we expect the generated image to retain precise details attached to the subject's identity. However, current generative evaluation metrics emphasize the overall semantic similarity between the reference and the output, and overlook these fine-grained discriminative details. We introduce Finer-Personalization Rank, an evaluation protocol tailored to identity preservation. Instead of pairwise similarity, Finer-Personalization Rank adopts a ranking view: it treats each generated image as a query against an identity-labeled gallery consisting of visually similar real images. Retrieval metrics (e.g., mean average precision) measure performance, where higher scores indicate that identity-specific details (e.g., a distinctive head spot) are preserved. We assess identity at multiple granularities -- from fine-grained categories (e.g., bird species, car models) to individual instances (e.g., re-identification). Across CUB, Stanford Cars, and animal Re-ID benchmarks, Finer-Personalization Rank more faithfully reflects identity retention than semantic-only metrics and reveals substantial identity drift in several popular personalization methods. These results position the gallery-based protocol as a principled and practical evaluation for personalized generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。