通过几何约束生成虚拟异常样本,提升模型对分布外数据的鲁棒性。
Geometrically Constrained Outlier Synthesis
- 在特征空间中沿数据流形的偏离方向生成异常样本
- 在近分布外任务上优于现有方法,显著提升检测准确率
- 适合需要可靠异常检测的工业级视觉系统
针对图像分类模型在分布外(OOD)样本上过度自信的问题,提出几何约束异常合成(GCOS)训练正则化框架。该方法在隐藏特征空间生成尊重已学习数据流形结构的虚拟异常样本,分两步进行:首先从训练特征中提取主导方差子空间以确定几何引导的离流形方向;其次利用校准集非一致性得分的经验分位数定义类共形壳,自适应控制合成强度,生成边界样本。该壳体确保生成异常既不过于明显也不与正常数据混淆,促进稳健特征的学习。结合对比正则化目标,增强特定评分空间(如马氏距离或能量型)中ID与OOD样本的可分性。实验表明,GCOS在近分布外基准测试中优于现有最先进方法。作为探索性延伸,框架可自然过渡至共形分布外推断,将不确定性得分转化为具有统计保证的p值,实现带误差保障的阈值设定,为更可预测、可靠的异常检测提供路径。
原文摘要 · Abstract (English)
Deep neural networks for image classification often exhibit overconfidence on out-of-distribution (OOD) samples. To address this, we introduce Geometrically Constrained Outlier Synthesis (GCOS), a training-time regularization framework aimed at improving OOD robustness during inference. GCOS addresses a limitation of prior synthesis methods by generating virtual outliers in the hidden feature space that respect the learned manifold structure of in-distribution (ID) data. The synthesis proceeds in two stages: (i) a dominant-variance subspace extracted from the training features identifies geometrically informed, off-manifold directions; (ii) a conformally-inspired shell, defined by the empirical quantiles of a nonconformity score from a calibration set, adaptively controls the synthesis magnitude to produce boundary samples. The shell ensures that generated outliers are neither trivially detectable nor indistinguishable from in-distribution data, facilitating smoother learning of robust features. This is combined with a contrastive regularization objective that promotes separability of ID and OOD samples in a chosen score space, such as Mahalanobis or energy-based. Experiments demonstrate that GCOS outperforms state-of-the-art methods using standard energy-based inference on near-OOD benchmarks, defined as tasks where outliers share the same semantic domain as in-distribution data. As an exploratory extension, the framework naturally transitions to conformal OOD inference, which translates uncertainty scores into statistically valid p-values and enables thresholds with formal error guarantees, providing a pathway toward more predictable and reliable OOD detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。