arXiv:2509.10980cs.CV2025-09被引 2

构建首个系统化皮肤色调数据集,提升模型识别与生成的公平性与准确性。

TrueSkin: Towards Fair and Accurate Skin Tone Recognition and Generation

  • 构建6类7299张图像的TrueSkin数据集,覆盖多样光照与拍摄条件。
  • 基于该数据集,识别模型准确率提升超20%,生成模型肤色保真度显著改善。
  • 揭示大模型在肤色识别中偏好浅色、生成受提示无关属性干扰的缺陷。

皮肤色调识别与生成在模型公平性、医疗健康和生成式AI中至关重要,但因缺乏全面数据集与稳健方法而面临挑战。相比其他人体图像分析任务,当前主流的大规模多模态模型(LMMs)和图像生成模型在肤色识别与合成上表现不佳。为此,我们提出TrueSkin数据集,包含7299张图像,按6类系统分类,涵盖多样光照、相机角度与采集设置。利用TrueSkin,我们对现有识别与生成方法进行基准测试,发现显著偏差:LMMs常将中间色调误判为较浅色,生成模型则在提示中存在无关属性(如发型或环境)干扰时难以准确生成指定肤色。训练识别模型于TrueSkin可使准确率提升超过20%,相较于现有LMMs与传统方法;微调生成模型亦显著提升肤色保真度。研究强调,类似TrueSkin的综合性数据集不仅可用于评估模型性能,更可作为提升皮肤色调识别与生成公平性与准确性的关键训练资源。

原文摘要 · Abstract (English)

Skin tone recognition and generation play important roles in model fairness, healthcare, and generative AI, yet they remain challenging due to the lack of comprehensive datasets and robust methodologies. Compared to other human image analysis tasks, state-of-the-art large multimodal models (LMMs) and image generation models struggle to recognize and synthesize skin tones accurately. To address this, we introduce TrueSkin, a dataset with 7299 images systematically categorized into 6 classes, collected under diverse lighting conditions, camera angles, and capture settings. Using TrueSkin, we benchmark existing recognition and generation approaches, revealing substantial biases: LMMs tend to misclassify intermediate skin tones as lighter ones, whereas generative models struggle to accurately produce specified skin tones when influenced by inherent biases from unrelated attributes in the prompts, such as hairstyle or environmental context. We further demonstrate that training a recognition model on TrueSkin improves classification accuracy by more than 20\% compared to LMMs and conventional approaches, and fine-tuning with TrueSkin significantly improves skin tone fidelity in image generation models. Our findings highlight the need for comprehensive datasets like TrueSkin, which not only serves as a benchmark for evaluating existing models but also provides a valuable training resource to enhance fairness and accuracy in skin tone recognition and generation tasks.

皮肤色调公平性生成模型数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。