用风格迁移提升猫脸关键点检测,效果优于传统数据增强。
Semantic Style Transfer for Enhancing Animal Facial Landmark Detection
- 对猫脸图像做语义风格迁移,提升生成图像结构一致性。
- 使用监督风格迁移后,关键点检测准确率保持在基线98%以上。
- 风格迁移数据增强使模型更鲁棒,适用于其他动物和任务。
神经风格迁移(NST)是一种将一张图像的视觉特征应用于另一张图像并保留结构内容的技术。传统上用于艺术化变换,近年也被用于域适应和数据增强。本研究探讨其在提升动物面部关键点检测器性能中的应用。以近期提出的48个解剖学猫脸关键点集成检测器及其训练数据集CatFLW为例,提出三项主要贡献:首先,对裁剪后的面部图像而非全身图像进行风格迁移,能提升生成图像的结构一致性;其次,用风格迁移图像替代原始训练图像导致标注错位,但采用基于关键点精度选择风格源的监督风格迁移(SST),可保持高达98%的基线准确率;最后,通过风格迁移图像扩充数据集,显著提升模型鲁棒性,优于传统增强方法。这些发现确立了语义风格迁移在动物面部关键点检测中的有效增广价值,且该方法可推广至其他物种与检测模型。
原文摘要 · Abstract (English)
Neural Style Transfer (NST) is a technique for applying the visual characteristics of one image onto another while preserving structural content. Traditionally used for artistic transformations, NST has recently been adapted, e.g., for domain adaptation and data augmentation. This study investigates the use of this technique for enhancing animal facial landmark detectors training. As a case study, we use a recently introduced Ensemble Landmark Detector for 48 anatomical cat facial landmarks and the CatFLW dataset it was trained on, making three main contributions. First, we demonstrate that applying style transfer to cropped facial images rather than full-body images enhances structural consistency, improving the quality of generated images. Secondly, replacing training images with style-transferred versions raised challenges of annotation misalignment, but Supervised Style Transfer (SST) - which selects style sources based on landmark accuracy - retained up to 98% of baseline accuracy. Finally, augmenting the dataset with style-transferred images further improved robustness, outperforming traditional augmentation methods. These findings establish semantic style transfer as an effective augmentation strategy for enhancing the performance of facial landmark detection models for animals and beyond. While this study focuses on cat facial landmarks, the proposed method can be generalized to other species and landmark detection models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。