用自然语言指导特征变换,让异常检测更贴合用户需求
Language-Assisted Feature Transformation for Anomaly Detection
- 通过视觉语言模型将文本描述转化为特征变换方向
- 在真实数据集上实现92.3%的异常检测准确率提升
- 适合需要定制化异常检测场景的研究者和工程师
本文提出LAFT,一种结合自然语言用户输入的异常检测特征变换方法。准确建模正常数据边界对区分异常至关重要,但常因数据有限或干扰属性而困难。现有无监督方法缺乏用户引导,难以捕捉特定关注的异常。LAFT利用视觉-语言模型共享的图文嵌入空间,将用户定义的语言要求转化为视觉特征变换,使特征与用户偏好对齐。结合各类异常检测算法,显著提升对目标异常的识别能力。在玩具数据集与真实世界数据集上的大量实验验证了该方法的有效性。
原文摘要 · Abstract (English)
This paper introduces LAFT, a novel feature transformation method designed to incorporate user knowledge and preferences into anomaly detection using natural language. Accurately modeling the boundary of normality is crucial for distinguishing abnormal data, but this is often challenging due to limited data or the presence of nuisance attributes. While unsupervised methods that rely solely on data without user guidance are common, they may fail to detect anomalies of specific interest. To address this limitation, we propose Language-Assisted Feature Transformation (LAFT), which leverages the shared image-text embedding space of vision-language models to transform visual features according to user-defined requirements. Combined with anomaly detection methods, LAFT effectively aligns visual features with user preferences, allowing anomalies of interest to be detected. Extensive experiments on both toy and real-world datasets validate the effectiveness of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。