弱监督下分离共现面部组件,提升人脸解析精度
DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing
- 通过显式与隐式机制解耦共现面部成分
- 在三个数据集上显著优于现有弱监督方法
- 适合关注少标注人脸分割的研究者
人脸解析旨在将人脸图像分割为眼睛、嘴唇、眉毛等关键组件。现有方法依赖密集的像素级标注,但标注成本高。为降低标注开销,我们提出弱监督人脸解析(WSFP),仅使用图像级标签和自然语言描述进行密集分割。由于面部组件高度共现且视觉相似,导致激活模糊,解析性能下降。为此,我们提出DisFaceRep框架,通过显式与隐式机制解耦共现组件:设计共现组件解耦策略以减少数据集级偏差,并引入文本引导解耦损失,利用语言监督隐式指导组件分离。在CelebAMask-HQ、LaPa和Helen上的大量实验表明,WSFP具有挑战性,而DisFaceRep显著优于现有弱监督语义分割方法。
原文摘要 · Abstract (English)
Face parsing aims to segment facial images into key components such as eyes, lips, and eyebrows. While existing methods rely on dense pixel-level annotations, such annotations are expensive and labor-intensive to obtain. To reduce annotation cost, we introduce Weakly Supervised Face Parsing (WSFP), a new task setting that performs dense facial component segmentation using only weak supervision, such as image-level labels and natural language descriptions. WSFP introduces unique challenges due to the high co-occurrence and visual similarity of facial components, which lead to ambiguous activations and degraded parsing performance. To address this, we propose DisFaceRep, a representation disentanglement framework designed to separate co-occurring facial components through both explicit and implicit mechanisms. Specifically, we introduce a co-occurring component disentanglement strategy to explicitly reduce dataset-level bias, and a text-guided component disentanglement loss to guide component separation using language supervision implicitly. Extensive experiments on CelebAMask-HQ, LaPa, and Helen demonstrate the difficulty of WSFP and the effectiveness of DisFaceRep, which significantly outperforms existing weakly supervised semantic segmentation methods. The code will be released at \href{https://github.com/CVI-SZU/DisFaceRep}{\textcolor{cyan}{https://github.com/CVI-SZU/DisFaceRep}}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。