无需人工规则,用神经元胞自动机实现语义解析的结构泛化。
Structural Generalization on SLOG without Hand-Written Rules
- 基于离散瓶颈的神经元胞自动机,通过局部迭代从数据中自动学习组合规则。
- 在SLOG上达67.3%整体准确率,11个结构泛化类别达100%类型精确匹配。
- 揭示失败本质为两类结构组合问题,验证了CCG类型对泛化能力的高分辨率刻画。
语义解析中的结构泛化要求系统将习得的组合规则应用于新颖的结构组合。现有方法或依赖手工编写的代数规则(AM-Parser),或无法实现结构泛化(基于Transformer的模型)。我们提出一种无需手工规则的新方法,基于具有离散瓶颈的神经元胞自动机(NCA),所有组合规则均通过局部迭代从数据中学习。在SLOG基准上,系统在10个种子下整体准确率为67.3±0.2%(AM-Parser:70.8±4.3%),17个结构泛化类别中有11个达到100%类型精确匹配,包括三个AM-Parser得分0–74%的类别。分析显示,全部5,539个失败实例可归结为两种机制:含疑问词提取上下文与减少动词类型的新型组合,以及修饰语出现在动词主语侧。按CCG结构特征分解结果发现,每个子模式要么全成功,要么全失败;中间分数(如41.4%)实为结构不同的CCG模式混合,并非部分泛化。结果表明,CCG有向类型比SLOG的现象级分类提供更高分辨率的结构泛化表征,且成功/失败边界由训练数据中覆盖的有向操作决定。
原文摘要 · Abstract (English)
Structural generalization in semantic parsing requires systems to apply learned compositional rules to novel structural combinations. Existing approaches either rely on hand-written algebraic rules (AM-Parser) or fail to generalize structurally (Transformer-based models). We present an alternative requiring no hand-written compositional rules, based on a neural cellular automaton (NCA) with a discrete bottleneck: all compositional rules are learned from data through local iteration. On the SLOG benchmark, the system achieves an overall accuracy of $67.3 \pm 0.2\%$ across 10 seeds (AM-Parser: $70.8 \pm 4.3\%$), with 11 of 17 structural generalization categories at $100\%$ type-exact match, including three where AM-Parser scores $0$--$74\%$. Analysis reveals that all 5,539 failure instances reduce to exactly two mechanisms: novel combinations of wh-extraction context with reduced verb types, and modifiers appearing on the subject side of verbs. When we decompose results by CCG structural features, each sub-pattern either succeeds on all instances or fails on all. Intermediate scores (e.g., $41.4\%$) are mixtures of structurally distinct CCG patterns, not partial generalization. These results suggest that CCG directed types provide higher resolution than SLOG's phenomenon-level categories for characterizing structural generalization, and that the success/failure boundary is determined by the coverage of directed operations in the training data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。