arXiv:2608.21464cs.CVcs.AI2026-08

通过结构化数据扭曲,让普通CNN学会组合推理。

Complexity Induction: Compositional Generalization via Structured Training Distortion

论文配图:Complexity Induction: Compositional Generalization via Structured Training Distortion
图 1 · 摘自论文原文
  • 用类名相似性设计结构化噪声,诱导模型学习组合能力。
  • 模型能准确预测未训练过的颜色-形状组合,正确率超随机水平。
  • 适合研究模型泛化、认知启发的机器学习方向读者。

我们证明,对训练数据进行结构化扰动——即复杂度诱导——可在不修改架构的情况下,使标准卷积神经网络具备组合泛化能力。使用带有颜色几何形状的合成图像,类别以扁平字符串标签表示(如'红-圆'),且训练中排除部分颜色-形状组合。采用两种基于类名间杰卡德相似度的扰动方法:混合标签(软目标分布,编码类间重叠)与扩展数据集(具有结构化错误标签的虚假样本)。两者均促使模型预测未见组合,作用机制不同:混合标签利用CNN天然嵌入结构激活未见组合,扩展数据则改善嵌入因子分解本身。对照实验显示,随机虚假标签无效,说明效果依赖于扰动结构而非噪声本身。结果表明,结构化训练信号可影响表征内部组织及其组合解释方式,这一原理或可解释自然语言在认知发展中的作用。

原文摘要 · Abstract (English)

We demonstrate that structured distortion of training data - which we term complexity induction - can induce compositional generalization in a standard CNN classifier without architectural modification. Using synthetic images of colored geometric shapes, we encode classes as flat string labels (e.g., "red-circle") with no explicit attribute decomposition, and exclude certain color-shape combinations from training entirely. We apply two distortion methods derived from Jaccard string similarity between class names: mixed labels (soft target distributions encoding inter-class overlap) and expanded dataset (false training samples with structurally motivated incorrect labels). Both methods induce the ability to predict unseen class combinations, and act at different levels: mixed labels activate the classifier for unseen combinations by exploiting the CNN's natural embedding structure, while expanded training improves the embedding factorization itself. A control with random (unstructured) false labels confirms that the effect depends on the structure of the distortion, not on noise per se. These results suggest that structured complication of training signals can influence both the internal organization of learned representations and their compositional interpretation - a principle that may underlie the role of natural language in cognitive development.

组合泛化结构化扰动卷积神经网络表示学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。