arXiv:2608.27502cs.SEcs.CV2026-08

用图像增强生成测试用例,提升图像检索系统的可靠性与测试效率。

Image Augmentation as Test Generation for Deep Learning-Based Image Retrieval Systems

论文配图:Image Augmentation as Test Generation for Deep Learning-Based Image Retrieval Systems
图 1 · 摘自论文原文
  • 将50种增强技术分类为10类,构建系统化测试生成框架。
  • 天气模拟和SaSPA在嵌入不确定性与检索失败率上表现最优。
  • 适合需自动化测试、降低人工标注成本的工业级图像检索系统

确保基于深度学习的图像检索系统可靠性是软件工程挑战。本文提出双重贡献:(1) 对增强与生成技术进行文献综述,识别出50种技术并构建十类分类体系;(2) 在三组数据集(CIFAR-10、ImageNet-1K、March Networks)上开展大规模实证研究,评估这些技术作为嵌入式图像检索系统的测试生成器效果。使用Amazon Titan和OpenCLIP对增强图像进行嵌入,并从四个维度评估:(1) 嵌入空间相似性,(2) 四种估计器测得的嵌入不确定性,(3) 由LLaVA评分的语义真实性,(4) 检索失败率。在所有数据集与嵌入模型下,且在单个严重性级别测试中,天气模拟和SaSPA在保持性能稳定、视觉真实性和增强有效性平衡的前提下,产生最高嵌入不确定性和失败率。结果具有配置依赖性,可能随扰动强度变化。相比之下,基于GAN的增强技术真实性最低,存在合成伪影与感知不一致,不适合作为真实测试输入。研究为选择能最大化测试多样性又保留真实图像特征的增强技术提供了实用指导,支持构建全面有效的测试套件,同时通过变态测试减少人工标注成本。

原文摘要 · Abstract (English)

Ensuring the reliability of deep learning-based image retrieval systems is a software engineering challenge. This paper presents a dual contribution: (1) a literature review of augmentation and generation techniques which resulted in the identification of 50 techniques which we organized into a ten-category taxonomy, and (2) a large-scale empirical study that evaluates these techniques as test generators for embedding-based image retrieval systems. Augmented images are embedded using Amazon Titan and OpenCLIP, and evaluated across four analytical dimensions: (1) embedding-space similarity, (2) embedding uncertainty measured via four estimators, (3) semantic realism scored by LLaVA, and (4) retrieval failure rate. Experiments are performed on three datasets: CIFAR-10, ImageNet-1K, and a dataset from an industrial partner (March Networks). Across all evaluated datasets and embedding models, and under the single severity level tested for each technique, weather simulation and SaSPA are the image augmentation/generation techniques that produce the highest embedding uncertainty and failure rates while maintaining a favorable balance between performance stability, visual realism, and augmentation effectiveness. The results we discuss are configuration-specific and may shift under milder or stronger perturbation settings. In contrast, GAN-based augmentation techniques are among the lowest in realism, indicating the presence of synthetic artifacts and perceptual inconsistencies that reduce their suitability to produce realistic test inputs. Overall, our findings provide practical guidelines for selecting augmentation techniques that maximize test diversity while preserving realistic image characteristics, thereby enabling the construction of comprehensive and effective test suites for image retrieval systems while reducing the cost of manual data labeling through the use of metamorphic testing.

图像检索测试生成数据增强自动化测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。