通过几何视角提升残差分类的稳定性,不依赖反向传播训练。
A Geometric View of SRC: Learning Representations for Stable Residual Inference
- 用理想化跨度分析残差排序稳定性,定义残差裕度。
- 发现跨度重叠、主导和近重叠会破坏裕度,导致分类失效。
- 设计几何目标函数,提升类内自表达性,避免跨类干扰。
基于重建的推断通过比较各类别的重建残差来分配类别;稀疏表示分类(SRC)是典型实例,其可靠性取决于学习表征的几何结构。本文采用严格的训练-推理分离:仅在测试时使用固定不变的SRC规则,训练过程中不进行反向传播、展开或优化。基于类别条件跨度及其投影残差的区间理想化,我们通过残差裕度形式化残差排序稳定性,并揭示几何障碍——跨度重叠、主导性和近重叠(由小主角表示)——可在最坏方向上压缩该裕度。该跨度级理论是核心:它明确了理想残差族何时可分,并为实际残差近似(如OMP)提供了条件求解层解释,前提是其残差排序与跨度级保持一致。在显式覆盖与分离假设下,我们推导出理想残差裕度的定量下界。据此,提出几何塑形目标:促进掩码类内自表达,抑制跨类重建路径与类间跨度对齐,防止裕度坍塌。实验在图像(COIL-100)、文本(TREC)和脑电连接(EEG)数据上验证所有表征,统一使用固定SRC/OMP推理,报告残差裕度与几何诊断指标;交叉熵仅作为参考几何,在相同评估协议下对比。
原文摘要 · Abstract (English)
Reconstruction-based inference assigns a class by comparing class-wise reconstruction residuals; Sparse Representation Classification (SRC) is a canonical instance whose reliability depends on the geometry of the learned representation. We adopt a strict training-inference separation: SRC is used only as a fixed test-time rule and is never differentiated, unrolled, or optimized during training. In a span-level idealization based on class-conditional spans and their associated projection residuals, we formalize residual-ordering stability through a residual margin and characterize geometric obstructions -- span overlap, dominance, and near-overlap via small principal angles -- that can collapse this margin in worst-case directions. This span-level theory is primary: it specifies when the idealized residual family is well-separated, and it provides a conditional solver-level interpretation for practical residual approximations (e.g., OMP) insofar as they remain close to the span-level residual ordering. Under explicit coverage and separation assumptions, we derive a quantitative lower bound on the (idealized) residual margin. Guided by these targets, we propose geometry-shaping objectives that promote masked within-class self-expressiveness, discourage cross-class reconstruction pathways and inter-class span alignment, and prevent collapse -- without invoking SRC residuals or predictions during training. Experiments on images (COIL-100), text (TREC), and EEG connectivity evaluate all representations under identical fixed SRC/OMP inference and report residual margins and geometric diagnostics; cross-entropy is included only as a reference geometry under the same evaluation protocol.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。