首次系统评估检测印度人脸生成图像的公平性,发现现有模型在跨生成器时表现严重下降。
Are Detectors Fair to Indian IP-AIGC? A Cross-Generator Study
- 构建针对印度人脸的生成图像测试集,评估跨生成器泛化能力
- 微调后模型在印度人脸数据上准确率从0.923降至0.563,出现过拟合
- 揭示当前检测器对身份保持编辑的脆弱性,适合关注AI公平性的研究者
现代图像编辑可生成保留人物身份的AIGC(IP-AIGC),如更换服装、背景或光照。当前检测器在该场景下的鲁棒性与公平性尚不明确,尤其对代表性不足的人群。本文首次系统研究印度及南亚人脸的IP-AIGC检测,量化了跨生成器泛化能力与群体内性能。基于FairFD和HAV-DF构建印度聚焦训练集,并利用Gemini和ChatGPT等商用网页生成器,通过身份保持提示构造两个独立测试集(HIDF-img-ip-genai和HIDF-vid-ip-genai)。评估两种先进检测器(AIDE和Effort)在预训练(PT)与微调(FT)下的表现,报告AUC、AP、EER和准确率。微调带来域内显著提升(如Effort在HAV-DF-test上AUC从0.739升至0.944;AIDE EER从0.484降至0.259),但在印度人群的持留测试集上性能持续下降(如AIDE AUC从0.923降至0.563;Effort从0.740降至0.533),表明对训练生成器特征的过拟合。在非IP-HIDF图像上,预训练表现仍高,说明问题源于身份保持编辑的特殊性而非通用分布偏移。本研究确立了IP-AIGC-Indian为一个具挑战性且实际相关的检测场景,推动保留表征的适应方法与面向印度的基准建设以弥合泛化差距。
原文摘要 · Abstract (English)
Modern image editors can produce identity-preserving AIGC (IP-AIGC), where the same person appears with new attire, background, or lighting. The robustness and fairness of current detectors in this regime remain unclear, especially for under-represented populations. We present what we believe is the first systematic study of IP-AIGC detection for Indian and South-Asian faces, quantifying cross-generator generalization and intra-population performance. We assemble Indian-focused training splits from FairFD and HAV-DF, and construct two held-out IP-AIGC test sets (HIDF-img-ip-genai and HIDF-vid-ip-genai) using commercial web-UI generators (Gemini and ChatGPT) with identity-preserving prompts. We evaluate two state-of-the-art detectors (AIDE and Effort) under pretrained (PT) and fine-tuned (FT) regimes and report AUC, AP, EER, and accuracy. Fine-tuning yields strong in-domain gains (for example, Effort AUC 0.739 to 0.944 on HAV-DF-test; AIDE EER 0.484 to 0.259), but consistently degrades performance on held-out IP-AIGC for Indian cohorts (for example, AIDE AUC 0.923 to 0.563 on HIDF-img-ip-genai; Effort 0.740 to 0.533), which indicates overfitting to training-generator cues. On non-IP HIDF images, PT performance remains high, which suggests a specific brittleness to identity-preserving edits rather than a generic distribution shift. Our study establishes IP-AIGC-Indian as a challenging and practically relevant scenario and motivates representation-preserving adaptation and India-aware benchmark curation to close generalization gaps in AIGC detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。